Talent.com
AWS Databricks Lead
AWS Databricks LeadCognizant • Eagan, MN, United States
[error_messages.no_longer_accepting]
AWS Databricks Lead

AWS Databricks Lead

Cognizant • Eagan, MN, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Title : AWS Databricks Lead

Location : Eagan MN

Work Mode : Hybrid / Onsite

Experience : 10+ years overall, 4+ years in Databricks on AWS

Role Summary

The AWS Databricks Lead will own the technical vision and execution for data engineering solutions on Databricks deployed on AWS. This role combines leadership, architecture expertise, and hands-on development to deliver secure, scalable, and cost-optimized data platforms for advanced analytics and AI.

Key Responsibilities

  • Design and implement end-to-end data lakehouse architecture using Databricks on AWS.
  • Build ETL / ELT pipelines leveraging Databricks Medallion Architecture and Data Vault 2.0 principles.
  • Lead data migration projects from legacy systems to AWS cloud.
  • Orchestrate jobs and workflows using Databricks Workspace .
  • Define and enforce data governance, security, and compliance frameworks using Unity Catalog, AWS IAM, and KMS.
  • Mentor and guide teams on best practices for Databricks development and AWS-native integrations.
  • Collaborate with stakeholders to translate business requirements into technical solutions.

Required Skills

  • Strong Healthcare domain experience .
  • Proficient in SQL for data analysis and transformation.
  • Hands-on experience with AWS native services (S3, Glue, Redshift, EMR, Lambda).
  • Expertise in Databricks development using AWS or equivalent cloud tech stack.
  • Experience building ETL / ELT pipelines using Databricks Workspace and PySpark .
  • Knowledge of job orchestration within Databricks.
  • Familiarity with Data Vault 2.0 architecture for data modeling.
  • Proven track record in data migration projects .
  • Certifications (Preferred)

  • AWS Certified Solutions Architect – Professional .
  • Databricks Certified Professional Data Engineer .
  • [job_alerts.create_a_job]

    Lead Aws • Eagan, MN, United States

    [internal_linking.similar_jobs]
    Principal Cloud Data Engineer

    Principal Cloud Data Engineer

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Event Data Engineer - Remote

    Principal Event Data Engineer - Remote

    UnitedHealth Group • Eden Prairie, MN, United States
    [filters.remote]
    [job_card.full_time]
    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Director, Engineering - Data Breach Response

    Director, Engineering - Data Breach Response

    Relativity • Minneapolis, MN, United States
    [job_card.full_time]
    Relativity is a leading company in AI-powered data intelligence for the legal industry.Our cloud platform helps organizations worldwide manage investigations, lawsuits, and compliance efficiently.R...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Generalist / Sr. Data Engineer -

    Lead Data Generalist / Sr. Data Engineer -

    Medica • Minnetonka, MN, United States
    [job_card.full_time]
    Medica is a nonprofit health plan with more than a million members that serves communities in Minnesota, Nebraska, Wisconsin, Missouri, and beyond. We deliver personalized health care experiences an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    TALENT Software Services • Bloomington, MN, US
    [job_card.full_time]
    Are you an experienced Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Data Engineer to work at their compa...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sales Specialist, Data Engineering

    Sales Specialist, Data Engineering

    Minnesota Staffing • Minneapolis, MN, US
    [job_card.full_time]
    Principal Sales Specialist, Data Engineering Platform.Snowflake is about empowering enterprises to achieve their full potential - and people too. With a culture that's all in on impact, innovation, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Solutions Architect

    Data Solutions Architect

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Cloud Engineer

    Cloud Engineer

    Medica • Minnetonka, MN, United States
    [job_card.full_time]
    Medica is a nonprofit health plan with more than a million members that serves communities in Minnesota, Nebraska, Wisconsin, Missouri, and beyond. We deliver personalized health care experiences an...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Cloud DataOps Engineer

    Senior Cloud DataOps Engineer

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Solutions Partner Manager

    Data Solutions Partner Manager

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Analytics Platform Engineer

    Principal Analytics Platform Engineer

    DUOS • Minneapolis, MN, US
    [job_card.full_time]
    Principal Analytics Platform Engineer.This is a full-time, remote, and exempt position.We are seeking a Principal Analytics Platform Engineer who will own DUOS' entire data foundation.They build th...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Cloud Data Engineer

    Senior Cloud Data Engineer

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Stoneridge Software • Minneapolis, MN, United States
    [job_card.full_time]
    Stoneridge Software began with the desire and understanding of what it takes to succeed in implementing business software solutions for the benefit of client's business goals.Stoneridge founders re...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Engineer, Data & Analytics

    Senior Engineer, Data & Analytics

    Anaplan • Minneapolis, MN, United States
    [job_card.full_time]
    At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their comp...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr Data Engineer

    Sr Data Engineer

    Compeer Financial • Lakeville, MN, United States
    [job_card.full_time]
    Compeer Financial is a member-owned cooperative located in Illinois, Minnesota and Wisconsin.We bring together team members with a variety of backgrounds and experiences to help provide financial s...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr Data Analytics Engineer HR

    Sr Data Analytics Engineer HR

    Compeer Financial • Lakeville, MN, United States
    [job_card.full_time]
    Compeer Financial is a member-owned cooperative located in Illinois, Minnesota and Wisconsin.We bring together team members with a variety of backgrounds and experiences to help provide financial s...[show_more]
    [last_updated.last_updated_30] • [promoted]
    EACX Lead / Data Engineer Lead

    EACX Lead / Data Engineer Lead

    Purple Drive • Minneapolis, MN, Minnesota, USA
    [job_card.full_time]
    Role : EACX Lead / Data Engineer Lead Locatio...[show_more]
    [last_updated.last_updated_variable_days]
    Principal Cloud DataOps Engineer

    Principal Cloud DataOps Engineer

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]