Talent.com
SeniorLead Data Engineer (Azure Databricks) Fulltime Role
SeniorLead Data Engineer (Azure Databricks) Fulltime RoleSaransh Inc • Alpharetta, Georgia, USA
SeniorLead Data Engineer (Azure Databricks) Fulltime Role

SeniorLead Data Engineer (Azure Databricks) Fulltime Role

Saransh Inc • Alpharetta, Georgia, USA
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Role : Senior / Lead Data Engineer (Azure Databricks)

Location : Alpharetta GA (Onsite)

Job Type : Full Time

Description :

  • Looking for an experienced Senior / Lead Data Engineer with 8 years of expertise in designing and delivering scalable high-performing data solutions on the Azure ecosystem.
  • The ideal candidate will have deep hands-on experience with Databricks Spark modern data lakehouse architectures data modelling and both batch and real-time data processing.
  • You will be responsible for driving end-to-end data engineering initiatives influencing architectural decisions and ensuring robust high-quality data pipelines.

Experience and Qualifications (Required) :

  • 8 years of hands-on data engineering experience in enterprise environments.
  • Strong expertise in Azure services especially Azure Databricks Functions and Azure Data Factory (preferred).
  • Advanced proficiency in Apache Spark with Python (PySpark).
  • Strong command over SQL query optimization and performance tuning.
  • Deep understanding of ETL / ELT methodologies data pipelines and scheduling / orchestration.
  • Hands-on experience with Delta Lake (ACID transactions optimization schema evolution).
  • Strong experience in data modelling (normalized dimensional lakehouse modelling).
  • Experience in both batch processing and real-time / streaming data (Kafka Event Hub or similar).
  • Solid understanding of data architecture principles distributed systems and cloud-native design patterns.
  • Preferred :

  • Experience with CI / CD tools such as Azure DevOps and Git.
  • Familiarity with IaC tools (Terraform ARM).
  • Exposure to data governance and cataloging tools (Azure Purview).
  • Experience supporting machine learning or BI workloads on Databricks.
  • Note : Visa Independent candidates are highly preferred

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full Time

    Experience : years

    Vacancy : 1

    [job_alerts.create_a_job]

    Azure Data Engineer • Alpharetta, Georgia, USA

    [internal_linking.related_jobs]
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    Captech Consulting • Atlanta, Georgia, United States
    [job_card.full_time]
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do and the resul...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data & BI Senior Data Engineer

    Data & BI Senior Data Engineer

    Axiom Software Solutions Limited • Atlanta, GA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS...[show_more]
    [last_updated.last_updated_30]
    Senior / Lead Data Engineer

    Senior / Lead Data Engineer

    Sumeru Solutions • Alpharetta, GA, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    We are looking for an experienced Senior / Lead Data Engineer with 8+ years of expertise in designing and delivering scalable, high-performing data solutions on the Azure ecosyste...[show_more]
    [last_updated.last_updated_variable_days]
    Lead Azure Databrick Engineer (Atlanta)

    Lead Azure Databrick Engineer (Atlanta)

    Syren • Atlanta, GA, US
    [job_card.part_time]
    Individual Contractors (W2 / 1099) are encouraged to apply.Visa sponsorship is not available for this role at this time • • • • • • • • • • • •. An Azure Data Engineer is responsible for designing, implementing, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior / Lead Data Engineer

    Senior / Lead Data Engineer

    Wissen Technology • Alpharetta, GA, United States
    [job_card.full_time]
    The Wissen team continues to expand its footprint in the USA, Canada, UK, Australia, and India.More openings to come as we continue to grow the team!. Please read below for a brilliant career opport...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Plum Inc • Atlanta, GA, US
    [filters.remote]
    [job_card.full_time]
    [filters_job_card.quick_apply]
    PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...[show_more]
    [last_updated.last_updated_30]
    SR Data Engineer

    SR Data Engineer

    Alliance Technical Group • Atlanta, GA, United States
    [job_card.full_time]
    Alliance Technical Group is seeking an experienced Senior Data Engineer to design, build, and optimize the databases and data systems that power our business intelligence and analytics platforms.In...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer w / Python & SQL

    Data Engineer w / Python & SQL

    A2C • Alpharetta, GA, United States
    [job_card.full_time]
    We’re looking for a Data Engineer to build and maintain scalable data pipelines and cloud data infrastructure on.ETL / ELT to support analytics and ML workflows. A problem solver with ability to analy...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Engineer - Capital One Software (Remote)

    Lead Data Engineer - Capital One Software (Remote)

    Capital One • Atlanta, GA, US
    [filters.remote]
    [job_card.full_time] +1
    Lead Data Engineer - Capital One Software (Remote) Capital One Software is seeking a Lead Data Engineer who is passionate about marrying innovation with emerging technologies.In 2022, we publicly a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Norcross, Georgia, United States
    [job_card.full_time]
    A company is looking for a Senior Data Engineer (Independent Contractor).Key Responsibilities Implement maintenance strategies for all datasets Collaborate with stakeholders to deliver BI, data ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Release Engineer

    Senior Release Engineer

    Cloudera • Atlanta, GA, United States
    [job_card.full_time]
    At Cloudera, we empower people to transform complex data into clear and actionable insights.With as much data under management as the hyperscalers, we're the preferred data partner for the top comp...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer - Connex Integration

    Senior Data Engineer - Connex Integration

    Crunchtime • Atlanta, Georgia, United States
    [job_card.full_time]
    Global restaurant brands run their operation on the Crunchtime platform.Delivering a consistent guest experience across every location and managing food and labor costs are at the core of how Crunc...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Azure Data Analyst

    Lead Azure Data Analyst

    Bright Vision Technologies • Atlanta, Georgia, United States
    [job_card.full_time] +1
    Bright Vision Technologies has an immediate contract opportunity for Lead Azure Data Analyst at Atlanta, GA.Lead Data Analyst will be responsible for analysing and modelling data to support our wea...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Fanduel • Atlanta, Georgia, United States
    [job_card.full_time]
    Our roster has an opening with your name on it.At FanDuel, our data platform underpins critical business operations that need to run with maximum efficiency and scalability.As our business continue...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Techgene Solutions • Alpharetta, GA, United States
    [job_card.full_time]
    Position : Senior Data Engineer (PySpark + Databricks + Oracle / PostgreSQL Migration).Location : 5800 Windward Parkway, Alpharetta, GA 3000. Expert-level proficiency in PySpark and Databricks.Primary S...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Director, Data Analytics, & Reporting - Food NA

    Sr. Director, Data Analytics, & Reporting - Food NA

    Atlanta Staffing • Atlanta, GA, US
    [job_card.full_time]
    Director, Data & Analytics Reporting Food North America.Cargill's size and scale allows us to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible and sus...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Neo4j Role

    Neo4j Role

    Infotree Global Solutions • Atlanta, GA, United States
    [job_card.full_time]
    Location - New York (Hybrid 3 days onsite).Strong in Neo4j Cypher Queries & out of the box algorithms usage.Should be able to do query performance tuning by adopting optimization techniques such as...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer (Levels III \u2013 V)

    Data Engineer (Levels III \u2013 V)

    Oglethorpe Power • Tucker, Georgia, United States
    [job_card.full_time]
    IT, focuses on building and operating the data platforms, pipelines, and services that power analytics and decision\u2011making across the enterprise. You will design and maintain robust, scalable d...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]