Talent.com
Senior Software Engineer, Quantitative Evaluations
Senior Software Engineer, Quantitative EvaluationsWaymo • San Francisco, CA, United States
Senior Software Engineer, Quantitative Evaluations

Senior Software Engineer, Quantitative Evaluations

Waymo • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Software Engineer, Quantitative Evaluations

Join to apply for the Senior Software Engineer, Quantitative Evaluations role at Waymo.

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo DriverThe World's Most Experienced Driverto improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymos fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases.

The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The Planner Evaluation team works on one of the key challenges in autonomous driving : measuring and improving the quality of the software that drives the car. We are looking for experienced data?minded software engineers and data scientists to help us improve how we characterize and evaluate changes to the Onboard software stack (Planner, Perception, etc). If you are passionate about autonomous vehicles and how to use rich, complex data to drive decision making, this is the role for you!

This role follows a hybrid work schedule and reports to a Senior Engineering Manager.

You Will

  • Develop novel methodologies and metrics to measure simulation realism across multiple simulator technologies (e.g., agent behavior, sensor rendering, environmental effects).
  • Design scalable and efficient platforms and pipelines for measuring simulation realism across massive datasets.
  • Research and implement systems that can guide simulator development priorities.
  • Collaborate with world?class engineering and research teams who develop and use large?scale ML models to enhance simulator fidelity.
  • Play an important role in a collaborative engineering team dedicated to building a high?fidelity simulator that directly powers the safety validation and performance evaluation of the Waymo Driver.

You Have

  • MS in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
  • 5+ years of industry experience in software development.
  • Software Engineering Fundamentals :
  • Proficiency in programming in Python or C++, including experience with relevant libraries for data handling and computation (e.g., NumPy, Pandas for Python).

  • Experience with SQL for data querying and analysis.
  • Experience with software design principles, coding best practices, testing methodologies, and version control software.
  • Quantitative Application & Metric Development :
  • Identify potential system performance or realism gaps (e.g., from specific examples or initial data exploration) and create data?driven approaches to investigate them.

  • Experience designing, implementing, and interpreting quantitative analyses or metrics to systematically evaluate system behavior and validate hypotheses (using concepts such as distributions, confidence intervals, etc.).
  • Demonstrated experience taking quantitative findings through to implementation, resulting in productionized metrics, automated evaluation tools, or improvements to validation systems.
  • Software Development for Data / Evaluation Pipelines :
  • Experience building software pipelines for data processing, system evaluation, or metric computation, in the context of large?scale systems.

    We Prefer

  • Demonstrated expertise and influence in designing quantitative evaluation methodologies and building scalable data processing / evaluation infrastructure.
  • Experience navigating complex technical and product landscapes, defining technical strategy, and creating roadmaps.
  • Experience with simulation systems, robotics, or autonomous vehicles.
  • Salary Range : $204,000$259,000 USD.

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Senior Software Engineer Quantitative Evaluations • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    Senior / Staff Software Engineer, Applied AI

    Senior / Staff Software Engineer, Applied AI

    Zip • San Francisco, California, United States
    [job_card.full_time]
    The simple task of buying software, services, or tools at work has become hopelessly complicated at even the most innovative companies in the world. Today, enterprises spend $120T+ per year globally...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Monograph • San Francisco, CA, United States
    [job_card.full_time]
    At Quanta, we're re-thinking the accounting and finance system of record in order to drastically improve how businesses understand their finances. We are solving a top cited pain point from finance ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI Evaluation Engineer

    Senior AI Evaluation Engineer

    Sentry • San Francisco, CA, United States
    [job_card.full_time]
    A software monitoring firm is seeking a Senior Software Engineer to join its AI / ML team in San Francisco.In this role, you will design evaluation frameworks to measure AI system performance, develo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Pantera Capital • San Francisco, CA, United States
    [job_card.full_time]
    Our unified platform, spanning AI-powered analytics, study management, and grant automation, streamlines the entire research lifecycle, enabling faster, smarter, and more impactful discoveries acro...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, Invest

    Senior Software Engineer, Invest

    Social Finance, Inc. (SoFi) • San Francisco, CA, United States
    [job_card.full_time]
    We are a next‑generation financial services company and national bank using innovative, mobile‑first technology to help millions of members reach their goals. We are seeking a Senior Software Engine...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer — AI Incubator, Founding Team

    Senior Software Engineer — AI Incubator, Founding Team

    Sprinter Health, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A healthcare innovation company in San Francisco seeks a Senior Software Engineer to join their new AI-focused incubator teams. The ideal candidate should have at least 5 years of full-stack or back...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, Storage

    Senior Software Engineer, Storage

    Crusoe Energy Systems LLC • San Francisco, CA, United States
    [job_card.full_time]
    Crusoe's mission is to accelerate the abundance of energy and intelligence.We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, spe...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Wispr AI, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Wispr Flow is making it as effortless to interact with your devices as talking to a close friend.Voice is the most natural, powerful way to communicate — and we’re building the interfaces to make t...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    LiveRamp • San Francisco, CA, United States
    [job_card.full_time]
    Build innovative solutions to some of the most challenging Identity Resolution problems.Collaborate closely with internal teams and external partners to drive product delivery.Be actively involved ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Quantitative Developer for Systematic Investing Platform

    Senior Quantitative Developer for Systematic Investing Platform

    Bloomberg New Energy Finance • San Francisco, CA, United States
    [job_card.full_time]
    A leading financial technology firm in San Francisco seeks a Senior Quantitative Developer to develop investment strategies using Python and large datasets. You will design frameworks for signal gen...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    GenAI Evaluations Engineer — Build Trusted AI Systems

    GenAI Evaluations Engineer — Build Trusted AI Systems

    Apple Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A leading technology company in San Francisco is seeking a driven Software Engineer to join its Generative AI Evaluations team. The role involves designing evaluation frameworks, collaborating close...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Idler • San Francisco, CA, United States
    [job_card.full_time]
    Idler builds reinforcement learning environments that teach AI models to code like 0.Our training environments are based on real-world coding scenarios that frontier models will actually encounter....[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - Search and Discovery

    Senior Software Engineer - Search and Discovery

    Ironclad Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Ironclad is the leading AI contracting platform that transforms agreements into assets.Contracts move faster, insights surface instantly, and agents push work forward, all with you in control.Wheth...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer, Senior

    Software Engineer, Senior

    Limohealth • San Francisco, CA, United States
    [job_card.full_time]
    At Charta, we're pioneering a transformative approach to healthcare administration and patient care through the power of generative AI. Our mission is to revolutionize this critical yet often cumber...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - Search and Discovery

    Senior Software Engineer - Search and Discovery

    Ironclad • San Francisco, California, United States
    [job_card.full_time]
    Ironclad is the leading AI contracting platform that transforms agreements into assets.Contracts move faster, insights surface instantly, and agents push work forward, all with you in control.Wheth...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    F2 • San Francisco, CA, United States
    [job_card.full_time]
    Own and implement software features that help to power our AI platform helping private markets investors analyze deals with velocity and accuracy. In this role you will be actively coding and delive...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - Intelligence

    Senior Software Engineer - Intelligence

    Hard Yaka • San Francisco, CA, United States
    [job_card.full_time]
    We exist to accelerate innovation.We do this by giving more people the opportunity to participate in the venture economy by building the financial infrastructure that makes it possible for more peo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, Capabilities

    Senior Software Engineer, Capabilities

    Amplitude • San Francisco, CA, United States
    [job_card.full_time]
    Amplitude is the leading Amplitude is the leading digital analytics platform, helping over 4,300 customers—including Atlassian, Burger King, NBCUniversal, Square, and Under Armour—build better prod...[show_more]
    [last_updated.last_updated_30] • [promoted]