Talent.com
Lead Data Engineer
Lead Data EngineerC The Signs • Boston, Massachusetts, United States
Lead Data Engineer

Lead Data Engineer

C The Signs • Boston, Massachusetts, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

We are seeking a Lead Data Engineer to architect, build, and scale our next-generation healthcare data platform. In this role, you will lead the effort to design robust pipelines, modernize data architecture, and ensure high-quality ingestion and transformation of clinical and operational data. You’ll collaborate closely with product, analytics, clinical informatics, machine learning, and engineering teams to deliver trusted, timely, and compliant insights.

This is a hands-on leadership role ideal for someone who enjoys setting technical direction while still contributing code and guiding stakeholders through complex healthcare data challenges.

Responsibilities

Architecture & Strategy

  • Lead design and evolution of our cloud-native data platform built primarily on Google Cloud Platform, including BigQuery, Cloud Storage, Pub / Sub, Cloud Run, Airflow (Cloud Composer), and Healthcare API.
  • Inform strategic decisions around multi-cloud or AWS interoperability when needed.
  • Establish data engineering best practices, coding standards, and architectural patterns.

Pipeline Development

  • Build scalable ETL / ELT pipelines using dbt for transformations and Airflow for orchestration.
  • Develop ingestion pipelines for clinical and administrative data in HL7, FHIR, DICOM, and custom formats.
  • Develop ingestion and transformation pipelines to be used for AI / ML development and model training.
  • Implement streaming and batch dataflows using Pub / Sub, Dataflow, and serverless compute.
  • Support or guide integrations with AWS-based partner systems or AWS-hosted data sources when applicable.
  • Data Modeling & Warehousing

  • Design and maintain BigQuery datasets, semantic layers, and warehouse structures.
  • Leverage industry standards such as FHIR resources for canonical healthcare models.
  • Provide guidance on data modeling and warehouse best practices across both GCP and AWS ecosystems.
  • Data Quality, Observability & Governance

  • Implement data quality frameworks, automated testing, and monitoring.
  • Ensure HIPAA compliance and proper handling of PHI / PII across all pipelines and cloud environments.
  • Drive lineage, documentation, metadata governance, and dbt docs adoption.
  • Leadership & Collaboration

  • Partner with analytics, product, clinical informatics, and security teams to deliver high-quality, trustworthy data products.
  • Provide oversight and technical direction for multi-cloud data integrations with AWS-based systems or partners.
  • Assist in the recruitment and development of junior data engineers
  • 7+ years of data engineering experience; 2–3+ years in a lead or senior technical role.
  • Deep, hands-on expertise in GCP, particularly :
  • BigQuery
  • GCP Healthcare API (FHIR and DICOM stores)
  • Cloud Storage, Pub / Sub, Cloud Run / Functions
  • Strong proficiency with :
  • dbt (Core or Cloud)
  • Airflow (Cloud Composer or self-managed)
  • Python and advanced SQL (BigQuery preferred)
  • Hands-on experience with healthcare standards :
  • FHIR (R4 / US Core), HL7 v2 / v3, DICOM, C-CDA, X12
  • Strong understanding of PHI handling, HIPAA compliance, and healthcare interoperability.
  • Preferred

  • AWS experience, especially with :
  • Redshift, Lambda, S3, Glue, Kinesis, Athena, API Gateway, Step Functions
  • Experience building or maintaining multi-cloud pipelines bridging GCP and AWS.
  • Background with Dataflow / Beam or other stream processing frameworks.
  • Experience working with EHR integrations, claims processing, HIEs, or clinical data networks.
  • Familiarity with ML-enabled data pipelines or feature engineering in healthcare contexts.
  • Why Join Us?

    Joining  C the Signs  is not just about building AI; it’s about shaping the future of healthcare. If you are a technical leader with an unshakable belief in the power of AI to save lives and the ability to make it happen at scale, this is your opportunity to create a tangible, global impact.

    Benefits :

  • Competitive salary and benefits package.
  • Flexible working arrangements (remote or hybrid options available).
  • The opportunity to work on life-changing AI technology that directly impacts patient outcomes.
  • Join a team that combines cutting-edge innovation with a mission to save lives and improve health equity.
  • Continuous learning opportunities with access to the latest tools and advancements in AI and healthcare.
  • [job_alerts.create_a_job]

    Lead Data Engineer • Boston, Massachusetts, United States

    [internal_linking.related_jobs]
    Clinical Data Engineering Lead

    Clinical Data Engineering Lead

    Novartis Group Companies • Cambridge, MA, United States
    [job_card.full_time]
    Are you ready to make a lasting impact by building the future of oncology research? Novartis Biomedical Research (NBR) is searching for a visionary Associate Director to lead Clinical Data Engineer...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Simplisafe • Boston, Massachusetts, United States
    [job_card.full_time]
    SimpliSafe is a leading innovator in the home security industry, dedicated to making every home a safe home.With a mission to provide accessible and comprehensive security solutions, we design and ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Pharmeng Technology • Boston, Massachusetts, United States
    [filters.remote]
    [job_card.full_time]
    PharmEng Technology is seeking a skilled.Data Optimization & Engineering Consultant.The consultant will lead efforts to enhance manufacturing data analytics, streamline document and data flow, and ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer

    Data Engineer

    Suno • Boston, Massachusetts, United States
    [job_card.full_time]
    Suno is a music company for the next generation of creators.Its AI-powered platform makes it easy for anyone to create original music. Built by musicians and engineers, Suno empowers users to turn i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer for Audio ML Research

    Data Engineer for Audio ML Research

    Native Instruments • Boston, Massachusetts, United States
    [job_card.full_time]
    For over 25 years, Native Instruments has been at the forefront of sonic innovation.Guided by our mission to inspire and enable creators to express themselves, we develop integrated audio hardware ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Data Engineer

    Staff Data Engineer

    Starburst • Boston, Massachusetts, United States
    [filters.remote]
    [job_card.full_time]
    Starburst is the data platform for analytics, applications, and AI, unifying data across clouds and on-premises to accelerate AI innovation. Organizations—from startups to Fortune 500 enterprises in...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sales Director (27723)

    Sales Director (27723)

    Supermicro • Boston, MA, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Level99 Entertainment • Boston, Massachusetts, United States
    [job_card.full_time]
    Level99 is a real-world gaming venue designed for adults, featuring over 50 mental and physical challenges in artistic environments. Games range from ninja warrior obstacle course style challenges t...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Topline Pro • Boston, Massachusetts, United States
    [job_card.full_time]
    We’re building AI powered Shopify for service businesses.Up and running within minutes using Gen AI, our digital storefront products help pros get discovered, trusted, and booked repeatedly.CPO) wi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer II - Data Curation

    Senior Data Engineer II - Data Curation

    Formation Bio • Boston, Massachusetts, United States
    [job_card.full_time]
    Formation Bio is a tech and AI driven pharma company differentiated by radically more efficient drug development.Advancements in AI and drug discovery are creating more candidate drugs than the ind...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer, Business Solutions

    Data Engineer, Business Solutions

    Audax Group • Boston, Massachusetts, United States
    [job_card.full_time]
    Founded in 1999, Audax Group is a leading alternative investment manager with offices in Boston, New York, San Francisco, London and Hong Kong. With approximately $42 billion of assets under managem...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Scientific Data Engineer

    Scientific Data Engineer

    Tetrascience • Cambridge, Massachusetts, United States
    [job_card.full_time]
    TetraScience is the Scientific Data and AI company.We are catalyzing the Scientific AI revolution by designing and industrializing AI-native scientific data sets, which we bring to life in a growin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead / Senior AI Engineer

    Lead / Senior AI Engineer

    Thought Industries • Boston, MA, United States
    [job_card.full_time]
    Thought Industries powers the business of value with our industry-leading Learning Platform and AI-driven innovations.Founded in 2013, we believe customer learning should be modern, intuitive, enga...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Data Engineer - AI Architect

    Principal Data Engineer - AI Architect

    American Family Insurance • Boston, MA, United States
    [job_card.full_time]
    As the Principal Data Engineer - AI Architect you will lead the architectural design (conceptual, logical and physical) of large-scale AI business solutions. As a technical lead, you will guide and ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    The Brattle Group • Boston, Massachusetts, United States
    [job_card.full_time]
    The Brattle Group, a privately held, global economics consulting firm, is looking for a.The Senior Data Engineer plays a pivotal role in shaping our data engineering practices, providing expert tec...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Data Engineer, Baseball Systems

    Sr. Data Engineer, Baseball Systems

    Boston Red Sox And Fenway Sports Management • Boston, Massachusetts, United States
    [filters.remote]
    [job_card.full_time]
    Members of the Baseball Systems team at the Boston Red Sox are focused on designing, building, and refining the software and data pipelines used within Baseball Operations.These tools and applicati...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead AI Engineer

    Lead AI Engineer

    Cd Projekt Red • Boston, MA, United States
    [job_card.full_time]
    To create revolutionary, story-driven RPGs which go straight to the hearts of gamers — this is our mission.Want to dive deeper into our company’s culture? Explore our social media and check out our...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Engineer

    Senior Data Engineer

    Str • Woburn, Massachusetts, United States
    [job_card.full_time]
    STR’s Intelligence division researches and develops advanced analytics and machine learning-based solutions to solve challenging problems related to national security. Our team consists of passionat...[show_more]
    [last_updated.last_updated_30] • [promoted]