Program evaluation [h1.location_city]
[job_alerts.create_a_job]
Program evaluation • seattle wa
- [promoted]
Sr. Engineering Manager, AI Evaluation Platform
Seattle StaffingSeattle, WA, USTest & Evaluation Engineer 3
Indotronix International CorporationSeattle, WashingtonProgram Manager
Blue OriginSeattle, WA, United States- [promoted]
Program Manager
KaavSeattle, WA, USTest & Evaluation Lab Technician
SSi PeopleTukwila / WashingtonProgram Manager
CHIEF SEATTLE CLUBSeattle, WA, US- [promoted]
Program Manager
F5Seattle, WA, US- [promoted]
Program Manager
Blueprint TechnologiesBellevue, WA, USHead of Evaluation and Oversight Research
Scale AI, Inc.Seattle, WA, United States- [promoted]
Senior Program Manager, Program Services
Washington StaffingSeattle, WA, US- [promoted]
Program Manager
StaffingSeattle, WA, US- [promoted]
Program Manager
RIT SolutionsSeattle, WA, US- [promoted]
Program Specialist 2, High School Program
Government JobsBellevue, WA, USProgram Manager
Quickparts Acquisition IncSeattle, WA, USAIML - Sr Data Engineer, Evaluation
AppleSeattle, WA, United States- [promoted]
Program Manager
AZXSeattle, WA, USProgram Manager
VirtualVocationsRenton, Washington, United States- [promoted]
Program Manager
BrightSpring Health ServicesSeattle, WA, US- [promoted]
Program Manager
ApotheComSeattle, WA, USSr. Engineering Manager, AI Evaluation Platform
Seattle StaffingSeattle, WA, US- [job_card.full_time]
Engineering Manager
Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking a hands-on Engineering Manager to architect high-availability services and internal tools that enable self-service evaluation at scale. You will partner with researchers to operationalize their innovations, transforming complex workflows into intuitive, developer-first platforms. We are looking for a leader who thrives in the ambiguity of new initiatives and is passionate about building scalable infrastructure.
You will build and lead the engineering team responsible for democratizing AI evaluation across the organization. Your focus will be on architecting the developer experiencedesigning the APIs, SDKs, and platform services that turn complex evaluation metrics into simple, self-service calls. You will work hand-in-hand with researchers to operationalize sophisticated measurement techniques, ensuring they scale reliably within our high-availability infrastructure. In this role, you will define the engineering standards for a new organization, establishing the code quality, automation, and testing rigor required to support the rapid evolution of Generative AI and Agentic systems.
Minimum Qualifications :
- 5+ years of direct engineering management experience, with a proven track record of hiring, mentoring, and retaining high-performing engineers. You have successfully managed teams that ship production-grade software.
- 7+ years of hands-on software engineering experience with deep proficiency in the Python ecosystem (e.g., FastAPI, Pydantic, Pandas). You are capable of contributing to code reviews and architectural discussions on day one.
- Customer Obsession & Product Thinking : Experience acting as a technical partner to internal customers. You can translate vague requirements from other teams into concrete engineering specifications and are comfortable prioritizing the roadmap in the absence of a dedicated Product Manager.
- Demonstrated experience partnering with Applied Scientists or Researchers : You have the ability to navigate the ambiguity of research workflows and operationalize scientific code.
- Functional literacy in AI / ML concepts : You understand the fundamental lifecycle of machine learning (datasets, training vs. inference, evaluation metrics) and can discuss the engineering challenges involved in serving models.
- Strong expertise in API Design & Internal Tools : You have architected APIs that other developers rely on, with a focus on versioning, backward compatibility, and developer experience.
- Operational excellence background : You have practical experience establishing CI / CD pipelines, containerization (Docker / Kubernetes), and monitoring (Datadog / Prometheus).
Preferred Qualifications :
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.