Talent.com
AWS Databricks Lead
AWS Databricks LeadCognizant • Eagan, MN, United States
[error_messages.no_longer_accepting]
AWS Databricks Lead

AWS Databricks Lead

Cognizant • Eagan, MN, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Title : AWS Databricks Lead

Location : Eagan MN

Work Mode : Hybrid / Onsite

Experience : 10+ years overall, 4+ years in Databricks on AWS

Role Summary

The AWS Databricks Lead will own the technical vision and execution for data engineering solutions on Databricks deployed on AWS. This role combines leadership, architecture expertise, and hands-on development to deliver secure, scalable, and cost-optimized data platforms for advanced analytics and AI.

Key Responsibilities

  • Design and implement end-to-end data lakehouse architecture using Databricks on AWS.
  • Build ETL / ELT pipelines leveraging Databricks Medallion Architecture and Data Vault 2.0 principles.
  • Lead data migration projects from legacy systems to AWS cloud.
  • Orchestrate jobs and workflows using Databricks Workspace .
  • Define and enforce data governance, security, and compliance frameworks using Unity Catalog, AWS IAM, and KMS.
  • Mentor and guide teams on best practices for Databricks development and AWS-native integrations.
  • Collaborate with stakeholders to translate business requirements into technical solutions.

Required Skills

  • Strong Healthcare domain experience .
  • Proficient in SQL for data analysis and transformation.
  • Hands-on experience with AWS native services (S3, Glue, Redshift, EMR, Lambda).
  • Expertise in Databricks development using AWS or equivalent cloud tech stack.
  • Experience building ETL / ELT pipelines using Databricks Workspace and PySpark .
  • Knowledge of job orchestration within Databricks.
  • Familiarity with Data Vault 2.0 architecture for data modeling.
  • Proven track record in data migration projects .

    • Certifications (Preferred)

  • AWS Certified Solutions Architect – Professional .
  • Databricks Certified Professional Data Engineer .
    • [job_alerts.create_a_job]

    Lead Aws • Eagan, MN, United States

    [internal_linking.similar_jobs]
    Principal Cloud Data Engineer

    Principal Cloud Data Engineer

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Event Data Engineer - Remote

    Principal Event Data Engineer - Remote

    UnitedHealth Group • Eden Prairie, MN, United States
    [filters.remote]
    [job_card.full_time]
    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Director, Engineering - Data Breach Response

    Director, Engineering - Data Breach Response

    Relativity • Minneapolis, MN, United States
    [job_card.full_time]
    Relativity is a leading company in AI-powered data intelligence for the legal industry.Our cloud platform helps organizations worldwide manage investigations, lawsuits, and compliance efficiently.R...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Generalist / Sr. Data Engineer -

    Lead Data Generalist / Sr. Data Engineer -

    Medica • Minnetonka, MN, United States
    [job_card.full_time]
    Medica is a nonprofit health plan with more than a million members that serves communities in Minnesota, Nebraska, Wisconsin, Missouri, and beyond. We deliver personalized health care experiences an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Tech Lead, Android Core Product - Minneapolis, USA

    Tech Lead, Android Core Product - Minneapolis, USA

    Speechify • Minneapolis, MN, US
    [job_card.full_time]
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Salesforce Lead Developer

    Salesforce Lead Developer

    Avalon Software Services LLC • Minneapolis, MN, US
    [job_card.full_time]
    Candidates must possess at least 3 years of project experience in the following areas : .Salesforce Health Cloud Must have experience working with Person Accounts and Care Plans.Salesforce Code Must ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Solutions Architect

    Data Solutions Architect

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Cloud Engineer

    Cloud Engineer

    Zone IT Solutions • Minneapolis, MN, US
    [job_card.full_time]
    We are looking for a Cloud Engineer, where you will be a key player in shaping our cloud strategy and enhancing the services we provide to our clients. In this role, you will design, implement, and ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Cloud Engineer

    Cloud Engineer

    Medica • Minnetonka, MN, United States
    [job_card.full_time]
    Medica is a nonprofit health plan with more than a million members that serves communities in Minnesota, Nebraska, Wisconsin, Missouri, and beyond. We deliver personalized health care experiences an...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Tech Lead, Web Core Product & Chrome Extension - Minneapolis, USA

    Tech Lead, Web Core Product & Chrome Extension - Minneapolis, USA

    Speechify • Minneapolis, MN, US
    [job_card.full_time]
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Cloud DataOps Engineer

    Senior Cloud DataOps Engineer

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI / ML Engineer

    AI / ML Engineer

    Simarn Solutions • Minneapolis, MN, US
    [job_card.full_time]
    Information Technology / AI & CRM Integration.We are seeking an AI / ML Engineer with strong expertise in Salesforce enhancements, real-time model deployment, and intelligent automation.The role ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Solutions Partner Manager

    Data Solutions Partner Manager

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Cloud Data Engineer

    Senior Cloud Data Engineer

    Surescripts • Minneapolis, MN, United States
    [job_card.full_time]
    We deliver insights at critical points of care for better decisions - from streamlining prior authorizations to delivering comprehensive medication histories to facilitating messages between provid...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Stoneridge Software • Minneapolis, MN, United States
    [job_card.full_time]
    Stoneridge Software began with the desire and understanding of what it takes to succeed in implementing business software solutions for the benefit of client's business goals.Stoneridge founders re...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Engineer, Data & Analytics

    Senior Engineer, Data & Analytics

    Anaplan • Minneapolis, MN, United States
    [job_card.full_time]
    At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their comp...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr Data Engineer

    Sr Data Engineer

    Compeer Financial • Lakeville, MN, United States
    [job_card.full_time]
    Compeer Financial is a member-owned cooperative located in Illinois, Minnesota and Wisconsin.We bring together team members with a variety of backgrounds and experiences to help provide financial s...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr Data Analytics Engineer HR

    Sr Data Analytics Engineer HR

    Compeer Financial • Lakeville, MN, United States
    [job_card.full_time]
    Compeer Financial is a member-owned cooperative located in Illinois, Minnesota and Wisconsin.We bring together team members with a variety of backgrounds and experiences to help provide financial s...[show_more]
    [last_updated.last_updated_30] • [promoted]