Talent.com
Bedrock Robotics
Machine Learning Engineer: EvaluationBedrock Robotics • San Francisco, CA, United States
No longer accepting applications
Machine Learning Engineer: Evaluation

Machine Learning Engineer: Evaluation

Bedrock Robotics • San Francisco, CA, United States
5 days ago
Job type
  • Full-time
Job description
Join the team bringing advanced autonomy to the built world

At Bedrock, we're moving AI out of the lab and into the real world. Our team is composed of industry veterans who helped launch Waymo, scaled Segment to a $3.2B acquisition, and grew Uber Freight to $5B in revenue. Today, we're deploying autonomous systems on heavy construction machinery across the country, accelerating project schedules of billion-dollar infrastructure projects and improving safety on job sites. Backed by $350M in funding, we're working quickly to close the gap between America's surging demand for housing, data centers, manufacturing hubs, and the construction industry's growing labor shortage.

This is where algorithms meet steel-toed boots. You'll collaborate with construction veterans and world-class engineers to solve physical-world problems that simulations can't touch. If you're ready to apply cutting-edge technology to solve meaningful problems alongside a talented team-we'd love to have you join us.

Machine Learning Engineer: Evaluation

Bedrock is bringing autonomy to the construction industry! We're a group of veterans from the autonomous vehicle industry who are passionate about bringing the benefits of automation to areas in the construction industry currently underserved by the market.

We're looking for a highly motivated engineer with experience evaluating complex ML systems deployed in the real world. Your Mission: Translate the infinite nuance of the built world into actionable, AI-native evaluations that accelerate Bedrock Operator adoption.

The ideal candidate has hands-on experience in building evaluation systems and designing and executing statistical tests to gauge performance deltas between system iterations. More importantly, you've iterated on complex ML systems run in production environments, and you understand the complexities that come with it.

What you'll do:
Design and maintain eval systems:
  • Build pipelines for measuring system performance - across open loop and closed loop simulation, hardware in the loop systems, and field data from Bedrock Operator equipped machinery. Excite other teams to gain insights earlier in the development cycle through streamlined workflows.
Develop metrics:
  • Connect product goals and system behavior - by bridging real-world specification to measurable indicators from logged data. Empower confident decision making from parameter tuning to program planning by slicing through the noise and delivering objective insights.
Classify data sources for training and testing:
  • Implement infrastructure and classifiers - to self-annotate data and allow creation of datasets for a variety of training and evaluation use cases. Leverage models to source rich annotations for massive datasets to accelerate model iteration.
Predict system performance:
  • Model metrics and interpret results - from various sources ranging from raw sensor data to key leading indicators. Determine whether new construction sites pose hidden challenges and drive business decisions about deployment readiness.
What we're looking for:
  • Engineers who are currently Senior or Staff level with 5+ years of professional software engineering, data science, or research experience
  • 2+ years of professional experience analyzing modern ML or robotics system performance on real-world problems
  • Proficiency in Python and a data warehouse query language and comfort with development on infrastructure within parallelized cloud-based frameworks
  • Strong statistical analysis skills (e.g. classification, model fit bias determination, hypothesis testing, and uncertainty quantification)
  • Experience working with large datasets

***Bonus points: We're especially interested in engineers who have applied statistical backgrounds to ML research or real-world robotics applications.

Our roles are often flexible. If you don't fit all the criteria, or are in another location (especially one where we have an office like SF or NY) please apply anyway! We'd love to consider you.

Our roles are often flexible. If you don't fit all the criteria, or are in another location (especially one where we have an office like SF or NY) please apply anyway! We'd love to consider you.
Create a job alert for this search

Machine Learning Engineer: Evaluation • San Francisco, CA, United States

Similar jobs

Machine Learning Engineer

King River Capital GroupSan Francisco, California, United States
Full-time

We are searching for a Machine Learning Engineer to help us build upon the intelligence and capabilities of our robots and the machine learning systems that power them.Our products combine state-of... Show more

 • Promoted

Staff Machine Learning Engineer

TwilioSan Francisco, California, United States
Full-time

At Twilio, we're shaping the future of communications, all from the comfort of our homes.We deliver innovative solutions tohundreds of thousands of businessesand empower millions of developers worl... Show more

 • Promoted

Founding Machine Learning Engineer

Greylock PartnersRedwood City, California, United States
Full-time

Early-stage, cybersecurity investment (valued over $100M at Seed), founded by a successful serial entrepreneur, is looking to hire a Founding MLE with a strong background standing up training/infer... Show more

 • Promoted

Founding Machine Learning Engineer

TroveSan Francisco, California, United States
Full-time

Trove is developing an AI associate for financial firms - think enterprise search & agents for private equity, hedge funds, and banks.Our mission is to deliver associate‑level AGI.We’ve raised near... Show more

 • Promoted

Senior Staff Machine Learning Engineer - Trusted Identity

UberSan Francisco, CA, United States
Full-time

We are looking for an experienced Senior Staff Machine Learning Engineer to join the Account Integrity team within Trusted Identity engineering org at Uber.The Trusted Identity org plays a crucial ... Show more

 • Promoted

Machine Learning Engineer

AkkodisSan Francisco, CA, United States
Temporary

Get AI-powered advice on this job and more exclusive features.This range is provided by Akkodis.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.... Show more

 • Promoted

Machine Learning Engineer

Apiphany CorporationSan Francisco, California, United States
Full-time

Apiphany is a pioneering foundational AI company for physical product development.We empower global innovators in automotive, aerospace, medtech, and energy to transform mountains of unstructured t... Show more

 • Promoted

Machine Learning Research Engineer

Workshop LabsSan Francisco, California, United States
Full-time

We're building the first truly private, personal AI that learns your skills, judgment, and preferences without big tech—or us—ever seeing your data.Our core ML challenge: how do we train the world’... Show more

 • Promoted

Machine Learning Infrastructure Engineer- Model Inference

AbridgeSan Francisco, CA, United States
Full-time

Machine Learning Infrastructure Engineer.Machine Learning Infrastructure Engineer.Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare.Our AI‑powered platform... Show more

 • Promoted

Machine Learning Engineer

GoodfireSan Francisco, California, United States
Full-time

Behind our name: Like fire, AI holds the potential for both immense benefit and significant risk.Just as mastering fire transformed human history, we believe the safe and intentional development of... Show more

 • Promoted

AI & Machine Learning Engineer

Synergistic itSan Francisco, CA, US
Full-time

Job Search Feeling Like Guesswork? Applied to 200+ Jobs and Still No Interviews? Applied Everywhere? Still No Interviews or Offers? Get Hired with a Process! Many job seekers assume the tech market... Show more

 • Promoted

Machine Learning Engineer

Alexander ChapmanSan Francisco, CA, United States
Full-time

Get AI-powered advice on this job and more exclusive features.This range is provided by Alexander Chapman.Your actual pay will be based on your skills and experience — talk with your recruiter to l... Show more

 • Promoted

Machine Learning Engineer

EPM ScientificSan Francisco, California, United States
Full-time

We are looking for a Founding Machine Learning Engineer to lead the development of scalable ML systems for RNA biology at EPM Scientific.Design and implement high-performance training pipelines for... Show more

 • Promoted

Machine Learning Engineer

TrypulseSan Francisco, California, United States
Full-time

Pulse is tackling one of the most persistent challenges in data infrastructure: extracting accurate, structured information from complex documents at scale.We have a breakthrough approach to docume... Show more

 • Promoted

Machine Learning Engineer

PulseSan Francisco, California, United States
Full-time

Pulse is tackling one of the most persistent challenges in data infrastructure: extracting accurate, structured information from complex documents at scale.We have a breakthrough approach to docume... Show more

 • Promoted

Machine Learning Engineer

BaselayerSan Francisco, CA, United States
Full-time

Get AI-powered advice on this job and more exclusive features.Trusted by 2,200+ financial institutions, Baselayer is the intelligent business identity platform that helps verify any business, autom... Show more

 • Promoted

Machine Learning Research Engineer, GenAI Applied ML

ScaleSan Francisco, California, United States
Full-time

Machine Learning Research Engineer, GenAI Applied ML.At Scale AI, our mission is to accelerate the development of AI applications.For 8 years, Scale has been the leading AI data foundry, helping fu... Show more

 • Promoted

Machine Learning Engineer

ApiphanySan Francisco, California, United States
Full-time

Apiphany is a pioneering foundational AI company for physical product development.We empower global innovators in automotive, aerospace, medtech, and energy to transform mountains of unstructured t... Show more

 • Promoted

AIML - Machine Learning Engineer, Batch processing team

AppleSan Francisco, CA, United States
Full-time

Imagine what you could do here.At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly.Bring passion and dedication to your job and there’s no t... Show more

 • Promoted

Staff Machine Learning Engineer

Metric BioSan Francisco, California, United States
Full-time

This range is provided by Metric Bio.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job poster from Metric Bio.Metric Bio is... Show more