Talent.com
Big Data Engineer
Big Data EngineerC&L Group • Alpharetta, GA, US
Big Data Engineer

Big Data Engineer

C&L Group • Alpharetta, GA, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Description

This position is for Big data engineer for Brokerage Wealth Management? Framework CoE team at Brokerage's Alpharetta or New York offices.

CoE team is responsible to define and govern the data platforms.

We are looking for colleagues with strong sense of ownership and ability to drive solutions.

The role is primarily responsible to automate the existing process and bring new ideas and innovation.

The candidate is expected to code, conduct code reviews, and test framework as needed, along with participating in application architecture and design and other phases of the automation.

The ideal candidate will be a self-motivated team player committed to delivering on time and should be able to work with or without minimal supervision.

Responsibilities

  • Design & Develop new automation framework for ETL processing
  • Support existing framework and become technical point of contact for all related teams
  • Enhance existing ETL automation framework as per user requirements
  • Performance tuning of spark, snowflake ETL jobs
  • New technology POC and suitability analysis for Cloud migration
  • Process optimization with the help of automation and new utility development
  • Work in collaboration for any issues and new features
  • Support any batch issue
  • Support application team teams with any queries

Required Skills

  • 7+ years of Data engineering experience
  • Must be strong in UNIX Shell, Python scripting knowledge
  • Must be strong in Spark
  • Must have strong knowledge of SQL
  • Hands-on knowledge on how HDFS / Hive / Impala / Spark works
  • Strong in logical reasoning capabilities
  • Should have working knowledge of Github, DevOps, CICD / Enterprise code management tools
  • Strong collaboration and communication skills
  • Must possess strong team-player skills and should have excellent written and verbal communication skills
  • Ability to create and maintain a positive environment of shared success
  • Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
  • Good to have working experience on snowflake & any data integration tool i.e. informatica cloud

    • Primary skills : Python, Big Data & Apache Spark

    Desired skills

  • Snowflake / Azure / AWS any cloud
  • IDMC / any ETL tool
    • [job_alerts.create_a_job]

    Big Data Engineer • Alpharetta, GA, US

    [internal_linking.similar_jobs]
    SAP Data Migration Engineer

    SAP Data Migration Engineer

    Bright Vision Technologies • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    SAP Data Migration Engineer Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their...[show_more]
    [last_updated.last_updated_variable_days]
    Big Data Developer

    Big Data Developer

    San R&D Business Solutions LLC • Alpharetta, GA, us
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Big Data Developer (GCP / Dataflow).Open to local GA candidates only.We are seeking an experienced .The ideal candidate will have around . Big Data technologies and a strong background in ...[show_more]
    [last_updated.last_updated_variable_days]
    Data Engineer

    Data Engineer

    Blue Acorn iCi • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Bachelor’s or master’s degree in computer science, Information Systems, or related field 12+ years of experience in data engineering, with at least 3-5 years focused on MarTech, CDP, an...[show_more]
    [last_updated.last_updated_variable_days]
    AI / Data Engineer

    AI / Data Engineer

    WickedFile • Alpharetta, Georgia, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    AI / Data Engineer – Core Role at WickedFile.Automotive SaaS, AI-Driven Analytics.WickedFile is on a mission to redefine how automotive repair shops understand and act on their financial and operatio...[show_more]
    [last_updated.last_updated_30]
    Data Engineer

    Data Engineer

    INFT Solutions Inc • Alpharetta, GA, Georgia, US
    [job_card.full_time]
    Calibri, sans-serif"> Position : Data Engineer <...[show_more]
    [last_updated.last_updated_30]
    Sr. Biometrics Data Engineer

    Sr. Biometrics Data Engineer

    Syneos Health / inVentiv Health Commercial LLC • Atlanta, Georgia, United States
    [job_card.full_time]
    Syneos Health is a leading fully integrated biopharmaceutical solutions organization built to accelerate customer success. We translate unique clinical, medical affairs and commercial insights into ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Scientist

    Data Scientist

    Fincons.US, Inc. • Alpharetta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Fincons Group is looking for an experienced AI / Machine Learning Engineer to support data-driven initiatives across complex business and operational environments. This role focuses on identifying h...[show_more]
    [last_updated.last_updated_30]
    Staff Data Engineer

    Staff Data Engineer

    Inovalon, Inc. • Atlanta, Georgia, United States
    [job_card.full_time]
    Inovalon was founded in 1998 on the belief that technology, and data specifically, would empower the transformation of the entire healthcare ecosystem for the better, improving both outcomes and ec...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Looker Visualization Engineer

    Looker Visualization Engineer

    Cloudious LLC • Alpharetta, GA, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Job description Role Overview The Looker Visualization Engineer will design develop and optimize interactive dashboards and data visualizations usi...[show_more]
    [last_updated.last_updated_variable_days]
    Global Head, Data Evaluation and Enablement

    Global Head, Data Evaluation and Enablement

    UCB Inc. • Atlanta, GA, United States
    [job_card.full_time]
    Global Head of Data Evaluation and Enablement with strong patient data expertise.Global Data Acquisition and Advanced Analytics team. This position can be based in our.Atlanta, Georgia, Raleigh, Nor...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Principal Data Architect & Enterprise AI Strategy

    Senior Principal Data Architect & Enterprise AI Strategy

    UKG • Atlanta, GA, United States
    [job_card.full_time]
    A leading workforce technology company based in Atlanta, Georgia, is seeking an experienced Enterprise Architect-Data to drive its enterprise-wide data strategy. The role requires extensive experien...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Big Data Developer

    Big Data Developer

    Tror AI for everyone • Atlanta, GA, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    MsoNoSpacing"> Job Title : Big Data Developer Location : Georgia (GA)[show_more]
    [last_updated.last_updated_variable_days]
    OT Data Engineer

    OT Data Engineer

    Deep DSG • Atlanta, GA, US
    [job_card.full_time]
    Deep Digital are seeking an experienced.OT) and information technology (IT).This position involves working cross-functionally with. On-site for project in Atlanta Georgia.Lead and support OT-related...[show_more]
    [last_updated.last_updated_variable_days]
    Data Architect

    Data Architect

    Axelon Services Corporation • Alpharetta, GA
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Expertise in designing and implementing scalable data architectures, data modeling, schema design, and database optimization. Knowledge of various database management systems (RDBMS, NoSQL) and data...[show_more]
    [last_updated.last_updated_variable_days]
    MO1-613-Senior Azure Cloud Engineer 11694-1

    MO1-613-Senior Azure Cloud Engineer 11694-1

    FHR • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Our direct client has an opening for.Senior Azure Cloud Engineer 11694-1.This position is up to 12 months, with the option of extension, in. Please send rates and a resume.DEA needs an Architect or ...[show_more]
    [last_updated.last_updated_30]
    Lead Data Engineer - Finance & Accounting Focus

    Lead Data Engineer - Finance & Accounting Focus

    Zelis Healthcare, LLC • Atlanta, Georgia, United States
    [job_card.full_time]
    Zelis is modernizing the healthcare financial experience across payers, providers, and healthcare consumers.We serve more than 750 payers, including the top five national health plans, regional hea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Data Engineer (REMOTE)

    Sr. Data Engineer (REMOTE)

    TRAC Recruiting • Atlanta, Georgia, United States
    [filters.remote]
    [job_card.full_time] +1
    [filters_job_card.quick_apply]
    You can live in ET or CT time zones, but you will need to be available within their core working hours Mon-Fri from 9 : 00am-12 : 00pm ET. Data Engineer will be key in developing and managing the data i...[show_more]
    [last_updated.last_updated_variable_days]
    Data Architect

    Data Architect

    Trispoke managed services • Alpharetta, GA, United States
    [job_card.full_time] +1
    [filters_job_card.quick_apply]
    We are seeking an experienced Data Architect to design, implement, and manage scalable data architectures and big data solutions. The ideal candidate will have strong expertise in data modeling, clo...[show_more]
    [last_updated.last_updated_variable_days]