Talent.com

Program evaluation [h1.location_city]

[job_alerts.create_a_job]

Program evaluation • seattle wa

[last_updated.last_updated_variable_days]
  • [promoted]
Sr. Engineering Manager, AI Evaluation Platform

Sr. Engineering Manager, AI Evaluation Platform

Seattle StaffingSeattle, WA, US
[job_card.full_time]
Join Apple Services Engineering to build the next generation of AI evaluation systems.We are seeking a hands-on Engineering Manager to architect high-availability services and internal tools that e...[show_more][last_updated.last_updated_variable_days]
Test & Evaluation Engineer 3

Test & Evaluation Engineer 3

Indotronix International CorporationSeattle, Washington
[job_card.full_time]
Test & Evaluation Engineer 3 Seattle, Washington, United States | Posted : 8 / 11 / 2025.[show_more][last_updated.last_updated_30]
Program Manager

Program Manager

Blue OriginSeattle, WA, United States
[job_card.permanent]
Salary range updated, see changes below.Applications will be accepted on an ongoing basis until the requisition is closed. At Blue Origin, we envision millions of people living and working in space ...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Manager

Program Manager

KaavSeattle, WA, US
[job_card.full_time]
A day in the life : The Program Manager is responsible for the overall delivery of either a group of related projects, 1-2 programs across 3+ functions within the company, or 3+ well.[show_more][last_updated.last_updated_30]
Test & Evaluation Lab Technician

Test & Evaluation Lab Technician

SSi PeopleTukwila / Washington
[job_card.full_time]
Job Title : Test & Evaluation Lab Technician.Conduct tests and evaluations in our client's lab, supporting various projects across the enterprise. Collaborate effectively with team members and partne...[show_more][last_updated.last_updated_30]
Program Manager

Program Manager

CHIEF SEATTLE CLUBSeattle, WA, US
[job_card.full_time] +2
Program Manager (Permanent Supportive Housing).Director of Supportive Housing.Status : ☒Regular ☐Temporary ☒Full-Time ☐Part-Time FLSA : ☒ Exempt OR.This position re...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Manager

Program Manager

F5Seattle, WA, US
[job_card.full_time]
At F5, we strive to bring a better digital world to life.Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Manager

Program Manager

Blueprint TechnologiesBellevue, WA, US
[job_card.full_time]
We are a technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States. Unified by a shared passion for solving complicated problems, our people ar...[show_more][last_updated.last_updated_variable_days]
Head of Evaluation and Oversight Research

Head of Evaluation and Oversight Research

Scale AI, Inc.Seattle, WA, United States
[job_card.full_time]
Scale is the leading data and evaluation partner for frontier AI companies, playing an integral role in advancing the science of evaluating and characterizing large language models (LLMs).Our resea...[show_more][last_updated.last_updated_30]
  • [promoted]
Senior Program Manager, Program Services

Senior Program Manager, Program Services

Washington StaffingSeattle, WA, US
[job_card.full_time]
Northwest Center has been a vendor at Amazon for over 20 years.The NWC @ Amazon division has grown to over 360 employees, providing a wide variety of customer service support on Amazon's thriving c...[show_more][last_updated.last_updated_variable_days]
  • [promoted]
Program Manager

Program Manager

StaffingSeattle, WA, US
[job_card.full_time]
Location : Seattle Based client Seattle 3 days office is must to have Rate get me what you have -open Strong Data Experience MDM Experience Enterprise Integration experience Financial and Reportin...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Manager

Program Manager

RIT SolutionsSeattle, WA, US
[job_card.full_time]
This position is an opportunity to be part of the Engagement Experiences and Platforms organization within DE&E Technology. We collect real-experiences and insights to drive innovation and growth.Lo...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Specialist 2, High School Program

Program Specialist 2, High School Program

Government JobsBellevue, WA, US
[job_card.full_time] +1
Program Specialist 2, High School Program.The overall focus of this position is to support Bellevue College in the High School program (CHS), a concurrent enrollment program for high school student...[show_more][last_updated.last_updated_30]
Program Manager

Program Manager

Quickparts Acquisition IncSeattle, WA, US
[job_card.full_time]
Quickparts is passionate about powering the world’s product continuum.We provide end-to-end manufacturing solutions including CNC machining, injection molding, and 3D printing, serving thousa...[show_more][last_updated.last_updated_30]
AIML - Sr Data Engineer, Evaluation

AIML - Sr Data Engineer, Evaluation

AppleSeattle, WA, United States
[job_card.full_time]
Weekly Hours : • • 40 • •Role Number : • • 200621026-3337 • •Summary • • The SWE Data organization seeks to improve products by using data as the voice of our customers. Within this organization, the Sea...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Manager

Program Manager

AZXSeattle, WA, US
[job_card.full_time]
Our mission is to accelerate positive impact in critical industries through AI transformation.We're growing quickly and already work with category-leaders in real estate (CBRE), energy (LevelTen En...[show_more][last_updated.last_updated_variable_days]
Program Manager

Program Manager

VirtualVocationsRenton, Washington, United States
[job_card.full_time]
A company is looking for a Program Manager to provide support through program management in various functional areas.Key Responsibilities Ensure well-documented policies, workflows, program contr...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Manager

Program Manager

BrightSpring Health ServicesSeattle, WA, US
[job_card.full_time]
Operations Management focuses on efficiently meeting the needs of our clients across various lines of business.If your passion is managing and developing staff to ensure quality care to help our cl...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Manager

Program Manager

ApotheComSeattle, WA, US
[job_card.full_time]
ApotheCom is an exciting leader in the field of medical communications.Drawn together from several backgrounds including the pharmaceutical industry, research, marketing, medical and regulatory wri...[show_more][last_updated.last_updated_30]
Sr. Engineering Manager, AI Evaluation Platform

Sr. Engineering Manager, AI Evaluation Platform

Seattle StaffingSeattle, WA, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Engineering Manager

Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking a hands-on Engineering Manager to architect high-availability services and internal tools that enable self-service evaluation at scale. You will partner with researchers to operationalize their innovations, transforming complex workflows into intuitive, developer-first platforms. We are looking for a leader who thrives in the ambiguity of new initiatives and is passionate about building scalable infrastructure.

You will build and lead the engineering team responsible for democratizing AI evaluation across the organization. Your focus will be on architecting the developer experiencedesigning the APIs, SDKs, and platform services that turn complex evaluation metrics into simple, self-service calls. You will work hand-in-hand with researchers to operationalize sophisticated measurement techniques, ensuring they scale reliably within our high-availability infrastructure. In this role, you will define the engineering standards for a new organization, establishing the code quality, automation, and testing rigor required to support the rapid evolution of Generative AI and Agentic systems.

Minimum Qualifications :

  • 5+ years of direct engineering management experience, with a proven track record of hiring, mentoring, and retaining high-performing engineers. You have successfully managed teams that ship production-grade software.
  • 7+ years of hands-on software engineering experience with deep proficiency in the Python ecosystem (e.g., FastAPI, Pydantic, Pandas). You are capable of contributing to code reviews and architectural discussions on day one.
  • Customer Obsession & Product Thinking : Experience acting as a technical partner to internal customers. You can translate vague requirements from other teams into concrete engineering specifications and are comfortable prioritizing the roadmap in the absence of a dedicated Product Manager.
  • Demonstrated experience partnering with Applied Scientists or Researchers : You have the ability to navigate the ambiguity of research workflows and operationalize scientific code.
  • Functional literacy in AI / ML concepts : You understand the fundamental lifecycle of machine learning (datasets, training vs. inference, evaluation metrics) and can discuss the engineering challenges involved in serving models.
  • Strong expertise in API Design & Internal Tools : You have architected APIs that other developers rely on, with a focus on versioning, backward compatibility, and developer experience.
  • Operational excellence background : You have practical experience establishing CI / CD pipelines, containerization (Docker / Kubernetes), and monitoring (Datadog / Prometheus).

Preferred Qualifications :

  • Experience building MLOps & Platform Infrastructure : You have architected or managed teams that built the foundational infrastructure for AI, such as model registries, inference services, or feature stores (using tools like Kubernetes, Ray, or Kubeflow).
  • Deep familiarity with AI Evaluation Frameworks : You have used or contributed to modern evaluation tools like DeepEval, Ragas, TruLens, or LangSmith. You understand how to implement and scale model-based evaluation workflows.
  • Deep understanding of Generative AI & Agents : You understand the engineering challenges of relying on LLMs and Agents as software componentsspecifically managing token economics, handling rate limits, and evaluating non-deterministic, multi-step reasoning capabilities.
  • Builder Experience : You have thrived in startup-like environments or incubated new teams within larger orgs, navigating high ambiguity to define roadmaps where none existed.
  • Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.