Talent.com
Senior Software Engineer, Quantitative Evaluations
Senior Software Engineer, Quantitative EvaluationsWaymo • San Francisco, CA, United States
Senior Software Engineer, Quantitative Evaluations

Senior Software Engineer, Quantitative Evaluations

Waymo • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Software Engineer, Quantitative Evaluations

Join to apply for the Senior Software Engineer, Quantitative Evaluations role at Waymo.

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo DriverThe World's Most Experienced Driverto improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymos fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases.

The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The Planner Evaluation team works on one of the key challenges in autonomous driving : measuring and improving the quality of the software that drives the car. We are looking for experienced data?minded software engineers and data scientists to help us improve how we characterize and evaluate changes to the Onboard software stack (Planner, Perception, etc). If you are passionate about autonomous vehicles and how to use rich, complex data to drive decision making, this is the role for you!

This role follows a hybrid work schedule and reports to a Senior Engineering Manager.

You Will

  • Develop novel methodologies and metrics to measure simulation realism across multiple simulator technologies (e.g., agent behavior, sensor rendering, environmental effects).
  • Design scalable and efficient platforms and pipelines for measuring simulation realism across massive datasets.
  • Research and implement systems that can guide simulator development priorities.
  • Collaborate with world?class engineering and research teams who develop and use large?scale ML models to enhance simulator fidelity.
  • Play an important role in a collaborative engineering team dedicated to building a high?fidelity simulator that directly powers the safety validation and performance evaluation of the Waymo Driver.

You Have

  • MS in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
  • 5+ years of industry experience in software development.
  • Software Engineering Fundamentals :
  • Proficiency in programming in Python or C++, including experience with relevant libraries for data handling and computation (e.g., NumPy, Pandas for Python).

  • Experience with SQL for data querying and analysis.
  • Experience with software design principles, coding best practices, testing methodologies, and version control software.
  • Quantitative Application & Metric Development :
  • Identify potential system performance or realism gaps (e.g., from specific examples or initial data exploration) and create data?driven approaches to investigate them.

  • Experience designing, implementing, and interpreting quantitative analyses or metrics to systematically evaluate system behavior and validate hypotheses (using concepts such as distributions, confidence intervals, etc.).
  • Demonstrated experience taking quantitative findings through to implementation, resulting in productionized metrics, automated evaluation tools, or improvements to validation systems.
  • Software Development for Data / Evaluation Pipelines :
  • Experience building software pipelines for data processing, system evaluation, or metric computation, in the context of large?scale systems.

    We Prefer

  • Demonstrated expertise and influence in designing quantitative evaluation methodologies and building scalable data processing / evaluation infrastructure.
  • Experience navigating complex technical and product landscapes, defining technical strategy, and creating roadmaps.
  • Experience with simulation systems, robotics, or autonomous vehicles.
  • Salary Range : $204,000$259,000 USD.

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Senior Software Engineer Quantitative Evaluations • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    Senior / Staff Software Engineer, Applied AI

    Senior / Staff Software Engineer, Applied AI

    Zip • San Francisco, California, United States
    [job_card.full_time]
    The simple task of buying software, services, or tools at work has become hopelessly complicated at even the most innovative companies in the world. Today, enterprises spend $120T+ per year globally...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Monograph • San Francisco, CA, United States
    [job_card.full_time]
    At Quanta, we're re-thinking the accounting and finance system of record in order to drastically improve how businesses understand their finances. We are solving a top cited pain point from finance ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI Evaluation Engineer

    Senior AI Evaluation Engineer

    Sentry • San Francisco, CA, United States
    [job_card.full_time]
    A software monitoring firm is seeking a Senior Software Engineer to join its AI / ML team in San Francisco.In this role, you will design evaluation frameworks to measure AI system performance, develo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Pantera Capital • San Francisco, CA, United States
    [job_card.full_time]
    Our unified platform, spanning AI-powered analytics, study management, and grant automation, streamlines the entire research lifecycle, enabling faster, smarter, and more impactful discoveries acro...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, Invest

    Senior Software Engineer, Invest

    Social Finance, Inc. (SoFi) • San Francisco, CA, United States
    [job_card.full_time]
    We are a next‑generation financial services company and national bank using innovative, mobile‑first technology to help millions of members reach their goals. We are seeking a Senior Software Engine...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer — AI Incubator, Founding Team

    Senior Software Engineer — AI Incubator, Founding Team

    Sprinter Health, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A healthcare innovation company in San Francisco seeks a Senior Software Engineer to join their new AI-focused incubator teams. The ideal candidate should have at least 5 years of full-stack or back...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, Storage

    Senior Software Engineer, Storage

    Crusoe Energy Systems LLC • San Francisco, CA, United States
    [job_card.full_time]
    Crusoe's mission is to accelerate the abundance of energy and intelligence.We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, spe...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Wispr AI, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Wispr Flow is making it as effortless to interact with your devices as talking to a close friend.Voice is the most natural, powerful way to communicate — and we’re building the interfaces to make t...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    jobr.pro • San Francisco, CA, United States
    [job_card.full_time]
    We live in a world where technology is rapidly changing the educational experiences of students and teachers everywhere, and we have the opportunity to shape how this change takes place.It is Kira ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    LiveRamp • San Francisco, CA, United States
    [job_card.full_time]
    Build innovative solutions to some of the most challenging Identity Resolution problems.Collaborate closely with internal teams and external partners to drive product delivery.Be actively involved ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer

    Senior Software Engineer

    Idler • San Francisco, CA, United States
    [job_card.full_time]
    Idler builds reinforcement learning environments that teach AI models to code like 0.Our training environments are based on real-world coding scenarios that frontier models will actually encounter....[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - Search and Discovery

    Senior Software Engineer - Search and Discovery

    Ironclad Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Ironclad is the leading AI contracting platform that transforms agreements into assets.Contracts move faster, insights surface instantly, and agents push work forward, all with you in control.Wheth...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer, Senior

    Software Engineer, Senior

    Limohealth • San Francisco, CA, United States
    [job_card.full_time]
    At Charta, we're pioneering a transformative approach to healthcare administration and patient care through the power of generative AI. Our mission is to revolutionize this critical yet often cumber...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - Search and Discovery

    Senior Software Engineer - Search and Discovery

    Ironclad • San Francisco, California, United States
    [job_card.full_time]
    Ironclad is the leading AI contracting platform that transforms agreements into assets.Contracts move faster, insights surface instantly, and agents push work forward, all with you in control.Wheth...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer, Unification

    Senior Software Engineer, Unification

    IXL • San Mateo, CA, United States
    [job_card.full_time]
    IXL Learning, a leading developer of personalized learning products used by millions worldwide, is looking for a Senior Software Engineer to join our Unification Team—a high-impact group driving te...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - Advisory Suite

    Senior Software Engineer - Advisory Suite

    Diagram • San Mateo, CA, United States
    [job_card.full_time]
    Alpaca is a US-headquartered self-clearing broker-dealer and brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24 / 5 trading, and more. Our recent Series C funding round broug...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - Intelligence

    Senior Software Engineer - Intelligence

    Hard Yaka • San Francisco, CA, United States
    [job_card.full_time]
    We exist to accelerate innovation.We do this by giving more people the opportunity to participate in the venture economy by building the financial infrastructure that makes it possible for more peo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, Capabilities

    Senior Software Engineer, Capabilities

    Amplitude • San Francisco, CA, United States
    [job_card.full_time]
    Amplitude is the leading Amplitude is the leading digital analytics platform, helping over 4,300 customers—including Atlassian, Burger King, NBCUniversal, Square, and Under Armour—build better prod...[show_more]
    [last_updated.last_updated_30] • [promoted]