Talent.com

Program evaluation Jobs in Sunnyvale, CA

Create a job alert for this search

Program evaluation • sunnyvale ca

Last updated: 9 days ago

LLM Evaluation Engineer

The Fountain GroupMountain View, CA
Full-time

This isn’t your typical QA role – it’s a unique blend of technical engineering, machine learning evaluation, and data analysis.You’ll work closely with cutting-edge conversational AI technology, de... Show more

Staff Software Engineer, Autonomy Evaluation

General MotorsSunnyvale,GM Automation,Sunnyvale,GM Automation
$172,800.00 yearly
Remote
Full-time

General Motors is a global leader in advanced driverassistance.With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 millionhands‑fre... Show more

Senior Product Manager - Simulation Evaluation Applications

General MotorsSunnyvale, California, United States of America
Full-time

General Motors pioneers the innovations that move and connect people to what matters.We see a world with zero crashes, zero emissions, and zero congestion.Autonomous vehicles are central to achievi... Show more

AI Safety & Evaluation Engineer

DeWinter GroupCampbell, CA
$50.00 hourly
Full-time

AI Safety and Evaluations Engineer.Our client, a leader in AI testing and Generative AI solutions, is looking for a skilled.AI Safety and Evaluations Engineer.This project involves designing and bu... Show more

Senior Software Engineer, Autonomy Evaluation

General MotorsSunnyvale, California, United States of America
$136,000.00 yearly
Full-time

General Motors is a global leader in advanced driverassistance.WithSuper Cruisehands-free technology in more than 500,000 Super Cruise–equipped vehicles on the road and over 700 million hands-free ... Show more

Program Manager

Amphenol HSIOSanta Clara, CA, US
Full-time

Amphenol Communications Solutions (ACS), a division of Amphenol Corporation, is a world leader in interconnect solutions for Communications, Mobile, RF, Optics, and Commercial electronics markets.A... Show more

Program Manager

Glint Tech Solutions LLCSunnyvale, CA, USA
Full-time
Quick Apply

We are seeking an experienced Program Manager to support customer programs and drive cross-functional coordination within the Flex PCB / electronics manufacturing industry.This role serves as the p... Show more

Evaluation Systems Engineer, Autonomous Vehicles

General MotorsSunnyvale,GM Automation,Sunnyvale,GM Automation
Full-time

You will be part of a team that drives systematic and data-driven improvementsto the Autonomous Vehicle softwareby designing, implementing, and maintainingrobust processes for evaluation and valida... Show more

Staff Design Evaluation Engineer

Analog DevicesRio Robles, San Jose, CA, US
$150,978.00 yearly
Full-time

About Learn more at and on and.Staff Design Evaluation Engineer in Power Module Group: .Analog Devices is committed to investing in our people and their growth.Our hiring program features high impa... Show more

Senior Engineer, Design Evaluation Engineering

Analog DevicesRio Robles, San Jose, CA, US
$156,853.00 yearly
Full-time

NASDAQ: ) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge.ADI combines analog, digital, and software technologies into ... Show more

Director, Simulation and Evaluation - Autonomous Driving

Bosch GroupSunnyvale, California, United States
$240,000.00 yearly
Full-time

Company Description* *We Are Bosch.At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people’s lives.Our areas of activity are ever... Show more

People also ask
The highest-paying jobs are:
LLM Evaluation Engineer

LLM Evaluation Engineer

The Fountain GroupMountain View, CA
30+ days ago
Job type
  • Full-time
Job description
About the Role:
We are seeking a LLM Evaluation Engineer to join a forward-thinking team responsible for developing a sophisticated voice assistant platform. This isn’t your typical QA role – it’s a unique blend of technical engineering, machine learning evaluation, and data analysis. You’ll work closely with cutting-edge conversational AI technology, designing evaluation frameworks, building custom scripts, and creating data visualizations to assess platform performance.

Key Responsibilities:
  • Design and implement evaluation strategies for voice and language models, including automated testing approaches.
  • Analyze unstructured data from log store systems to identify performance gaps and optimize user experiences.
  • Build and maintain custom Python scripts to streamline data processing and generate actionable insights.
  • Develop visual reports to communicate findings and drive continuous improvement.
  • Collaborate with cross-functional teams globally to identify and address pain points in conversational AI performance.
  • Use prompt engineering techniques to refine LLM outputs and articulate system health.

Ideal Candidate:
  • 3+ years of experience in machine learning evaluation, data analysis, or related technical roles.
  • Intermediate to advanced Python scripting, including log parsing and API testing.
  • Familiarity with GenAI and LLMs, including automated workflows and API integrations.
  • Strong analytical mindset, capable of working independently and identifying innovative solutions.
  • Excellent communication skills, able to present complex findings clearly to both technical and non-technical stakeholders.