Talent.com
Big Data Engineer
Big Data EngineerVeterans Sourcing • Alpharetta, GA, US
Big Data Engineer

Big Data Engineer

Veterans Sourcing • Alpharetta, GA, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Responsibilities

  • Design & Develop new automation framework for ETL processing
  • Support existing framework and become technical point of contact for all related teams
  • Enhance existing ETL automation framework as per user requirements
  • Performance tuning of spark, snowflake ETL jobs
  • New technology POC and suitability analysis for Cloud migration
  • Process optimization with the help of automation and new utility development
  • Work in collaboration for any issues and new features
  • Support any batch issue
  • Support application team teams with any queries

Required Skills

  • 7+ years of Data engineering experience
  • Must be strong in UNIX Shell, Python scripting knowledge
  • Must be strong in Spark
  • Must have strong knowledge of SQL
  • Hands-on knowledge on how HDFS / Hive / Impala / Spark works
  • Strong in logical reasoning capabilities
  • Should have working knowledge of Github, DevOps, CICD / Enterprise code management tools
  • Strong collaboration and communication skills
  • Must possess strong team-player skills and should have excellent written and verbal communication skills
  • Ability to create and maintain a positive environment of shared success
  • Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
  • Good to have working experience on snowflake & any data integration tool i.e. informatica cloud
  • Primary skills : Python, Big Data & Apache Spark

    Desired skills

  • Snowflake / Azure / AWS any cloud
  • IDMC / any ETL tool
  • [job_alerts.create_a_job]

    Big Data Engineer • Alpharetta, GA, US

    [internal_linking.similar_jobs]
    Senior Software Engineer, Data

    Senior Software Engineer, Data

    PlayOn • Alpharetta, Georgia, US
    [job_card.full_time] +1
    Job Description Job Description PlayOn Sports operates one of the largest real-time data ecosystems in high school sports, spanning streaming video, ticketing, scoring, and fan engagement across ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Clinical Data Engineer

    Senior Clinical Data Engineer

    McKesson • Alpharetta, GA, United States
    [job_card.full_time]
    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare.We are known for delivering insights, products, and services that make quality care more accessibl...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Apache Flink Engineer

    Apache Flink Engineer

    Bright Vision Technologies • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Apache Flink Engineer Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their opera...[show_more]
    [last_updated.last_updated_variable_days]
    Big Data Developer

    Big Data Developer

    San R&D Business Solutions LLC • Alpharetta, GA, us
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Big Data Developer (GCP / Dataflow).Open to local GA candidates only.We are seeking an experienced .The ideal candidate will have around . Big Data technologies and a strong background in ...[show_more]
    [last_updated.last_updated_variable_days]
    AI / Data Engineer

    AI / Data Engineer

    WickedFile • Alpharetta, Georgia, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    AI / Data Engineer – Core Role at WickedFile.Automotive SaaS, AI-Driven Analytics.WickedFile is on a mission to redefine how automotive repair shops understand and act on their financial and operatio...[show_more]
    [last_updated.last_updated_30]
    Data Scientist

    Data Scientist

    Zone IT Solutions • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    We are looking for a talented Data Scientist skilled in Python and SQL.In this role, you will analyze large datasets, develop predictive models, and derive actionable insights that will guide busin...[show_more]
    [last_updated.last_updated_30]
    Shift Leader

    Shift Leader

    Captain D's • Canton, GA, US
    [job_card.full_time]
    We’ve built a culture that empowers and grows talent—because when our team thrives, so do we.Low-Cost Prescription Medications. Employee Assistance Program (EAP).Guest-focused and approachable.Compl...[show_more]
    [last_updated.last_updated_30]
    Data Engineer III : 26-00260 (No C2C allowed)

    Data Engineer III : 26-00260 (No C2C allowed)

    Akraya Inc • Atlanta, Georgia, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Skills : AWS (Expert), ETL (Advanced), SQL (Advanced), Data Modelling (Intermediate), Performance Tuning (Advanced).Duration : 6 Months with Possible Extension. Location : Atlanta, GA (Onsite).Our clie...[show_more]
    [last_updated.last_updated_variable_days]
    Data Scientist

    Data Scientist

    Fincons.US, Inc. • Alpharetta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Fincons Group is looking for an experienced AI / Machine Learning Engineer to support data-driven initiatives across complex business and operational environments. This role focuses on identifying h...[show_more]
    [last_updated.last_updated_30]
    Senior Principal Data Architect — Hybrid, Equity

    Senior Principal Data Architect — Hybrid, Equity

    Invesco Real Estate • Atlanta, GA, United States
    [job_card.full_time]
    A leading investment firm is seeking a Senior Principal Data Architect to join their Global Data Architecture team.The role includes leading data architecture design, ensuring alignment with archit...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Information Technology Professional

    Information Technology Professional

    U.S. Navy • Canton, GA, US
    [job_card.full_time] +1
    To be eligible to enlist in the U.Navy, candidates must be between the ages of 18-34.At any given moment, hundreds of complex networked computer systems are operating in tandem to keep ships and su...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Global Head, Data Evaluation and Enablement

    Global Head, Data Evaluation and Enablement

    UCB Inc. • Atlanta, GA, United States
    [job_card.full_time]
    Global Head of Data Evaluation and Enablement with strong patient data expertise.Global Data Acquisition and Advanced Analytics team. This position can be based in our.Atlanta, Georgia, Raleigh, Nor...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Principal Data Architect & Enterprise AI Strategy

    Senior Principal Data Architect & Enterprise AI Strategy

    UKG • Atlanta, GA, United States
    [job_card.full_time]
    A leading workforce technology company based in Atlanta, Georgia, is seeking an experienced Enterprise Architect-Data to drive its enterprise-wide data strategy. The role requires extensive experien...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Reliability & Platform Engineer

    Software Reliability & Platform Engineer

    Renewed Vision • Alpharetta, Georgia, US
    [job_card.permanent]
    Job Description Job Description As a Software Reliability & Platform Engineer , you'll bring a developer's mindset to reliability, infrastructure, and deployment. This multi-hat role combines soft...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    OT Data Engineer

    OT Data Engineer

    Deep DSG • Atlanta, GA, US
    [job_card.full_time]
    Deep Digital are seeking an experienced.OT) and information technology (IT).This position involves working cross-functionally with. On-site for project in Atlanta Georgia.Lead and support OT-related...[show_more]
    [last_updated.last_updated_variable_days]
    ELK Stack Engineer

    ELK Stack Engineer

    Zealogics.com • Alpharetta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Qualifications - 7+ years of experience with ELK Stack : ElasticSearch, Logstash, Kibana and beats.Good to have Ruby and / or Python, GIT and Unix Shell scripting knowledge. Build, maintain and optimiz...[show_more]
    [last_updated.last_updated_variable_days]
    Cloud Data Platform Architect

    Cloud Data Platform Architect

    Data Meaning • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    CLOUD DATA PLATFORM ARCHITECT Remote, USA Full-time position with Data Meaning Salary : .POSITION SUMMARY Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renown...[show_more]
    [last_updated.last_updated_variable_days]
    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

    Earn Haus • Canton, GA, US
    [filters.remote]
    [job_card.full_time] +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...[show_more]
    [last_updated.last_updated_30] • [promoted]