Talent.com
Big Data Engineer
Big Data EngineerVeterans Sourcing • Alpharetta, GA, US
Big Data Engineer

Big Data Engineer

Veterans Sourcing • Alpharetta, GA, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Responsibilities

  • Design & Develop new automation framework for ETL processing
  • Support existing framework and become technical point of contact for all related teams
  • Enhance existing ETL automation framework as per user requirements
  • Performance tuning of spark, snowflake ETL jobs
  • New technology POC and suitability analysis for Cloud migration
  • Process optimization with the help of automation and new utility development
  • Work in collaboration for any issues and new features
  • Support any batch issue
  • Support application team teams with any queries

Required Skills

  • 7+ years of Data engineering experience
  • Must be strong in UNIX Shell, Python scripting knowledge
  • Must be strong in Spark
  • Must have strong knowledge of SQL
  • Hands-on knowledge on how HDFS / Hive / Impala / Spark works
  • Strong in logical reasoning capabilities
  • Should have working knowledge of Github, DevOps, CICD / Enterprise code management tools
  • Strong collaboration and communication skills
  • Must possess strong team-player skills and should have excellent written and verbal communication skills
  • Ability to create and maintain a positive environment of shared success
  • Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
  • Good to have working experience on snowflake & any data integration tool i.e. informatica cloud
  • Primary skills : Python, Big Data & Apache Spark

    Desired skills

  • Snowflake / Azure / AWS any cloud
  • IDMC / any ETL tool
  • [job_alerts.create_a_job]

    Big Data Engineer • Alpharetta, GA, US

    [internal_linking.similar_jobs]
    Apache Flink Engineer

    Apache Flink Engineer

    Bright Vision Technologies • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Apache Flink Engineer Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their opera...[show_more]
    [last_updated.last_updated_variable_days]
    Big Data Developer

    Big Data Developer

    San R&D Business Solutions LLC • Alpharetta, GA, us
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Big Data Developer (GCP / Dataflow).Open to local GA candidates only.We are seeking an experienced .The ideal candidate will have around . Big Data technologies and a strong background in ...[show_more]
    [last_updated.last_updated_variable_days]
    AI / Data Engineer

    AI / Data Engineer

    WickedFile • Alpharetta, Georgia, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    AI / Data Engineer – Core Role at WickedFile.Automotive SaaS, AI-Driven Analytics.WickedFile is on a mission to redefine how automotive repair shops understand and act on their financial and operatio...[show_more]
    [last_updated.last_updated_30]
    Data Scientist

    Data Scientist

    Zone IT Solutions • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    We are looking for a talented Data Scientist skilled in Python and SQL.In this role, you will analyze large datasets, develop predictive models, and derive actionable insights that will guide busin...[show_more]
    [last_updated.last_updated_30]
    Shift Leader

    Shift Leader

    Captain D's • Canton, GA, US
    [job_card.full_time]
    We’ve built a culture that empowers and grows talent—because when our team thrives, so do we.Low-Cost Prescription Medications. Employee Assistance Program (EAP).Guest-focused and approachable.Compl...[show_more]
    [last_updated.last_updated_30]
    Data Engineer III : 26-00260 (No C2C allowed)

    Data Engineer III : 26-00260 (No C2C allowed)

    Akraya Inc • Atlanta, Georgia, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Skills : AWS (Expert), ETL (Advanced), SQL (Advanced), Data Modelling (Intermediate), Performance Tuning (Advanced).Duration : 6 Months with Possible Extension. Location : Atlanta, GA (Onsite).Our clie...[show_more]
    [last_updated.last_updated_variable_days]
    Data Scientist

    Data Scientist

    Fincons.US, Inc. • Alpharetta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Fincons Group is looking for an experienced AI / Machine Learning Engineer to support data-driven initiatives across complex business and operational environments. This role focuses on identifying h...[show_more]
    [last_updated.last_updated_30]
    Software Engineer

    Software Engineer

    Sales Demo Master Client - WFN4.0 • Alpharetta, Georgia, US
    [job_card.full_time]
    Job Description Job Description Responsibilities • Expand existing software to meet the changing needs of our key demographics • Develop a new software product from the ground up, staying true t...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Global Head, Data Evaluation and Enablement

    Global Head, Data Evaluation and Enablement

    UCB Inc. • Atlanta, GA, United States
    [job_card.full_time]
    Global Head of Data Evaluation and Enablement with strong patient data expertise.Global Data Acquisition and Advanced Analytics team. This position can be based in our.Atlanta, Georgia, Raleigh, Nor...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Principal Data Architect & Enterprise AI Strategy

    Senior Principal Data Architect & Enterprise AI Strategy

    UKG • Atlanta, GA, United States
    [job_card.full_time]
    A leading workforce technology company based in Atlanta, Georgia, is seeking an experienced Enterprise Architect-Data to drive its enterprise-wide data strategy. The role requires extensive experien...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI Engineer to deploy AI agents.

    Senior AI Engineer to deploy AI agents.

    INFT Solutions Inc • Atlanta, GA, Georgia, US
    [job_card.full_time]
    Senior AI Engineer to deploy AI agents.East Coast candidates) Length - 6 months from contractor retention Mission : Build and deploy AI agents t...[show_more]
    [last_updated.last_updated_variable_days]
    OT Data Engineer

    OT Data Engineer

    Deep DSG • Atlanta, GA, US
    [job_card.full_time]
    Deep Digital are seeking an experienced.OT) and information technology (IT).This position involves working cross-functionally with. On-site for project in Atlanta Georgia.Lead and support OT-related...[show_more]
    [last_updated.last_updated_variable_days]
    Staff Platform Engineer, Americas

    Staff Platform Engineer, Americas

    Ashby • Atlanta, GA, United States
    [job_card.full_time]
    We’re looking for a curious, rigorous, problem-hungry platform engineer (who codes!) to carry the ball as we bring Ashby to the big leagues. Ashby builds software that lets talent teams build an eff...[show_more]
    [last_updated.last_updated_30] • [promoted]
    MO1-613-Senior Azure Cloud Engineer 11694-1

    MO1-613-Senior Azure Cloud Engineer 11694-1

    FHR • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Our direct client has an opening for.Senior Azure Cloud Engineer 11694-1.This position is up to 12 months, with the option of extension, in. Please send rates and a resume.DEA needs an Architect or ...[show_more]
    [last_updated.last_updated_30]
    ELK Stack Engineer

    ELK Stack Engineer

    Zealogics.com • Alpharetta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Qualifications - 7+ years of experience with ELK Stack : ElasticSearch, Logstash, Kibana and beats.Good to have Ruby and / or Python, GIT and Unix Shell scripting knowledge. Build, maintain and optimiz...[show_more]
    [last_updated.last_updated_variable_days]
    Cloud Data Platform Architect

    Cloud Data Platform Architect

    Data Meaning • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    CLOUD DATA PLATFORM ARCHITECT Remote, USA Full-time position with Data Meaning Salary : .POSITION SUMMARY Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renown...[show_more]
    [last_updated.last_updated_variable_days]
    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Earn Haus • Canton, GA, US
    [filters.remote]
    [job_card.full_time] +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Information Technology Professional

    Information Technology Professional

    U.S. Navy • Jasper, GA, US
    [job_card.full_time] +1
    To be eligible to enlist in the U.Navy, candidates must be between the ages of 18-34.At any given moment, hundreds of complex networked computer systems are operating in tandem to keep ships and su...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]