Talent.com
Data Engineer, Scientific Data Ingestion
Data Engineer, Scientific Data IngestionMithrl • San Francisco, CA, US
Data Engineer, Scientific Data Ingestion

Data Engineer, Scientific Data Ingestion

Mithrl • San Francisco, CA, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Description

ABOUT MITHRL

We envision a world where novel drugs and therapies reach patients in months, not years, accelerating breakthroughs that save lives.

Mithrl is building the world’s first commercially available AI Co-Scientist—a discovery engine that empowers life science teams to go from messy biological data to novel insights in minutes. Scientists ask questions in natural language, and Mithrl answers with real analysis, novel targets, and patent-ready reports.

Our traction speaks for itself :

12X year-over-year revenue growth

Trusted by leading biotechs and big pharma across three continents

Driving real breakthroughs from target discovery to patient outcomes.

WHAT YOU WILL DO

Build and own an AI-powered ingestion & normalization pipeline to import data from a wide variety of sources — unprocessed Excel / CSV uploads, lab and instrument exports, as well as processed data from internal pipelines.

Develop robust schema mapping, coercion, and conversion logic (think : units normalization, metadata standardization, variable-name harmonization, vendor-instrument quirks, plate-reader formats, reference-genome or annotation updates, batch-effect correction, etc.).

Use LLM-driven and classical data-engineering tools to structure “semi-structured” or messy tabular data — extracting metadata, inferring column roles / types, cleaning free-text headers, fixing inconsistencies, and preparing final clean datasets.

Ensure all transformations that should only happen once (normalization, coercion, batch-correction) execute during ingestion — so downstream analytics / the AI “Co-Scientist” always works with clean, canonical data.

Build validation, verification, and quality-control layers to catch ambiguous, inconsistent, or corrupt data before it enters the platform.

Collaborate with product teams, data science / bioinformatics colleagues, and infrastructure engineers to define and enforce data standards, and ensure pipeline outputs integrate cleanly into downstream analysis and storage systems.

WHAT YOU BRING

Must-have

5+ years of experience in data engineering / data wrangling with real-world tabular or semi-structured data.

Strong fluency in Python, and data processing tools (Pandas, Polars, PyArrow, or similar).

Excellent experience dealing with messy Excel / CSV / spreadsheet-style data — inconsistent headers, multiple sheets, mixed formats, free-text fields — and normalizing it into clean structures.

Comfort designing and maintaining robust ETL / ELT pipelines, ideally for scientific or lab-derived data.

Ability to combine classical data engineering with LLM-powered data normalization / metadata extraction / cleaning.

Strong desire and ability to own the ingestion & normalization layer end-to-end — from raw upload → final clean dataset — with an eye for maintainability, reproducibility, and scalability.

Good communication skills; able to collaborate across teams (product, bioinformatics, infra) and translate real-world messy data problems into robust engineering solutions.

Nice-to-have

Familiarity with scientific data types and “modalities” (e.g. plate-readers, genomics metadata, time-series, batch-info, instrumentation outputs).

Experience with workflow orchestration tools (e.g. Nextflow, Prefect, Airflow, Dagster), or building pipeline abstractions.

Experience with cloud infrastructure and data storage (AWS S3, data lakes / warehouses, database schemas) to support multi-tenant ingestion.

Past exposure to LLM-based data transformation or cleansing agents — building or integrating tools that clean or structure messy data automatically.

Any background in computational biology / lab-data / bioinformatics is a bonus — though not required.

WHAT YOU WILL LOVE AT MITHRL

Mission-driven impact : you’ll be the gatekeeper of data quality — ensuring that all scientific data entering Mithrl becomes clean, consistent, and analysis-ready. You’ll have outsized influence over the reliability and trustworthiness of our entire data + AI stack.

High ownership & autonomy : this role is yours to shape. You decide how ingestion works, define the standards, build the pipelines. You’ll work closely with our product, data science, and infrastructure teams — shaping how data is ingested, stored, and exposed to end users or AI agents.

Team : Join a tight-knit, talent-dense team of engineers, scientists, and builders

Culture : We value consistency, clarity, and hard work. We solve hard problems through focused daily execution

Speed : We ship fast (2x / week) and improve continuously based on real user feedback

Location : Beautiful SF office with a high-energy, in-person culture

Benefits : Comprehensive PPO health coverage through Anthem (medical, dental, and vision) + 401(k) with top-tier plans

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

Compensation Range : $150K - $200K

[job_alerts.create_a_job]

Data Engineer • San Francisco, CA, US

[internal_linking.similar_jobs]
Senior Associate - AI Data Engineer

Senior Associate - AI Data Engineer

Andersen • San Francisco, CA, United States
[job_card.full_time]
We encourage you to apply thoughtfully by selecting one position that best matches your qualifications and interests.You may submit up to two active applications at a time.Please consider your loca...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Senior Platform Engineer, Data Pipelines & Ingestion

Senior Platform Engineer, Data Pipelines & Ingestion

Trunk.io • San Francisco, CA, United States
[job_card.full_time]
A leading software company in San Francisco seeks a Senior Software Engineer to join their Platform / Data Engineering team. You will be responsible for designing and optimizing data ingestion pipelin...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Data Science Sr Engineer - US Remote

Data Science Sr Engineer - US Remote

Anywhere Real Estate • San Francisco, CA, United States
[filters.remote]
[job_card.full_time]
Work back from the business problems to be solved, collect proper data to do statistical analysis, select proper machine learning and / or deep learning modeling approaches, eventually rollout ML mod...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Data Science Engineer

Data Science Engineer

Lawrence Berkeley National Laboratory • Berkeley, CA, United States
[job_card.full_time]
Lawrence Berkeley National Laboratory is hiring a Data Science Engineer within the Scientific Data division.Computational Biosciences Group. CSE2) in the area of multi-modal data modeling and analys...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI-Driven Scientific Data Ingestion Engineer

AI-Driven Scientific Data Ingestion Engineer

Mithrl • San Francisco, CA, United States
[job_card.full_time]
A leading life sciences technology company in San Francisco seeks an experienced Data Engineer to develop an AI-powered pipeline for data ingestion and normalization. The role requires over 5 years ...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Research Engineer, Data Ingestion

Research Engineer, Data Ingestion

The Rundown AI, Inc. • San Francisco, CA, United States
[job_card.full_time]
We are looking for an experienced Research Engineer to join the Data Ingestion team, which owns the problem of acquiring all of the available data on the internet through a large scale web crawler....[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Research Engineer, Synthetic Data

Research Engineer, Synthetic Data

Cartesia, Inc. • San Francisco, CA, United States
[job_card.full_time]
Our mission is to build the next generation of AI : ubiquitous, interactive intelligence that runs wherever you are.Today, not even the best models can continuously process and reason over a year-lo...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer for Large-Scale Cyber Defense Platform

Data Engineer for Large-Scale Cyber Defense Platform

Alaris • San Francisco, CA, United States
[job_card.full_time]
A cutting-edge cybersecurity firm in San Francisco is seeking a Data Engineer to design and architect their data infrastructure. In this high-impact position, you will be responsible for building sc...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Research Engineer, Synthetic Data

Research Engineer, Synthetic Data

Cartesia • San Francisco, CA, United States
[job_card.full_time]
Our mission is to build the next generation of AI : ubiquitous, interactive intelligence that runs wherever you are.Today, not even the best models can continuously process and reason over a year-lo...[show_more]
[last_updated.last_updated_30] • [promoted]
Staff Data Engineer

Staff Data Engineer

Visa • Foster City, CA, United States
[job_card.full_time]
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...[show_more]
[last_updated.last_updated_30] • [promoted]
Data Analytics & Engineering - Data Scientist II

Data Analytics & Engineering - Data Scientist II

Mindlance • Menlo Park, CA, United States
[job_card.full_time]
The main function of the Data Scientist is to produce innovative solutions driven by exploratory data analysis from complex and high-dimensional datasets. Apply knowledge of statistics, machine lear...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Sr Databricks Engineer

Sr Databricks Engineer

Purple Drive • San Francisco, CA, United States
[job_card.full_time]
We are seeking a highly skilled.The ideal candidate will have strong expertise in.Databricks, Delta Lake, and Azure Data Services. Architect & Design Lakehouse Solutions.Build scalable, secure, and ...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Sr. Distinguished, Data Engineer - Enterprise Data Storage and Consumption Platforms Data Engineer

Sr. Distinguished, Data Engineer - Enterprise Data Storage and Consumption Platforms Data Engineer

Capital One • San Francisco, CA, United States
[job_card.full_time]
Distinguished, Data Engineer - Enterprise Data Storage and Consumption Platforms Data Engineer.Be among the first 25 applicants. Distinguished Data Engineers are individual contributors who strive t...[show_more]
[last_updated.last_updated_30] • [promoted]
Data / Full Stack Engineer, Data Storage & Ingestion Consultant

Data / Full Stack Engineer, Data Storage & Ingestion Consultant

Eon Systems PBC • San Francisco, CA, United States
[job_card.full_time]
At Eon, we are at the forefront of large-scale neuroscientific data collection.Our mission is to enable the safe and scalable development of brain emulation technology to empower humanity over the ...[show_more]
[last_updated.last_updated_30] • [promoted]
Research Engineer, Data Ingestion

Research Engineer, Data Ingestion

Menlo Ventures • San Francisco, CA, United States
[job_card.full_time]
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Dataiku Engineer - Oakland, CA, Rancho Cordova, CA or Alpharetta, GA

Dataiku Engineer - Oakland, CA, Rancho Cordova, CA or Alpharetta, GA

Rootshell Enterprise Technologies • Oakland, CA, United States
[job_card.full_time]
Location : Oakland, CA, Rancho Cordova, CA or Alpharetta, GA.Duration : 6-12 months, potential contract-to-hire.This role is critical to advancing enterprise-wide analytics at CLIENT.The Expert Techn...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Engineer - Scalable AWS Data Platform

Senior Data Engineer - Scalable AWS Data Platform

Rippling • San Francisco, CA, United States
[job_card.full_time]
A leading HR and IT solutions provider based in San Francisco is looking for an experienced data engineer to drive key projects and develop scalable data infrastructure. Candidates should have over ...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Senior AI & Data Platform Engineer (Onsite)

Senior AI & Data Platform Engineer (Onsite)

Icon Ventures • San Francisco, CA, United States
[job_card.full_time]
A leading technology firm in San Francisco is looking for a Staff AI & Data Platform Engineer to design and develop scalable machine learning infrastructure. This role involves cross-functional coll...[show_more]
[last_updated.last_updated_30] • [promoted]