Talent.com
Sr Engineering Program Manager, Evaluation - Special Projects
Sr Engineering Program Manager, Evaluation - Special ProjectsApple • Cupertino, CA, United States
[error_messages.no_longer_accepting]
Sr Engineering Program Manager, Evaluation - Special Projects

Sr Engineering Program Manager, Evaluation - Special Projects

Apple • Cupertino, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Weekly Hours : 40

Role Number : 200624254-0836

Summary

Apple's Special Projects team is seeking a Senior Engineering Program Manager (EPM) to lead our AI evaluation framework at the forefront of next-generation AI experiences. This is a highly visible role where you'll drive the strategic direction for how we measure and validate AI model performance across modalities.

You will organize and lead teams to architect our evaluation methodology, translating ambiguous product requirements into concrete success metrics that determine if our models meet Apple's quality bar. Your work will directly influence product roadmaps and drive critical hill-climbing decisions that shape the AI experiences millions of users will interact with daily.

This role requires mastery of both technical depth in ML evaluation and the ability to influence across teams at the executive level. You'll lead complex, high-stakes programs while mentoring teams and establishing best practices that will define Apple's approach to AI quality.

Description

As the EPM for Evaluation, you will :

Strategic Leadership & Vision :

  • Partner with technical teams to define and drive the evaluation strategy for Apple's AI models, influencing product roadmaps and technology investments.
  • Partner with stakeholders to align evaluation frameworks with product vision and business objectives.

Technical Program Management :

  • Develop end-to-end programs to measure and validate performance of state-of-the-art multi-modal models.
  • Drive consensus on subjective quality metrics, establishing clear success criteria for ambiguous use cases.
  • Orchestrate complex data collection initiatives, simulation infrastructure, and evaluation pipelines.
  • Deliver process improvements that increase efficiency across the broader organization.
  • Cross-functional Leadership :

  • Coordinate distributed teams across design, engineering, research, and operations.
  • Communicate complex technical concepts and program status directly to executive leadership.
  • Minimum Qualifications

    7+ years of technical program management experience, with at least 3 years leading complex AI / ML programs.

    Proven track record of delivering complex programs by defining clear requirements and driving engineering teams to successful outcomes.

    Experience influencing and driving decisions at Director / VP level.

    Strong ability to navigate ambiguity and lead teams through uncertainty while maintaining program momentum.

    Excellence in executive communication - ability to distill complex technical information with the right balance of detail.

    Preferred Qualifications

    Master's or PhD in Computer Science, Machine Learning, Statistics, or related quantitative field.

    Deep hands-on experience with large language models (LLMs), vision-language models (VLMs), and multi-modal architectures.

    Demonstrated mastery of ML concepts, evaluation methodologies, and the end-to-end model development lifecycle.

    Experience with reinforcement learning from human feedback (RLHF) and preference optimization.

    Expertise in statistical analysis, A / B testing, and experimental design at scale.

    Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant (https : / / www.eeoc.gov / sites / default / files / 2023-06 / 22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf) .

    [job_alerts.create_a_job]

    Sr Program Manager • Cupertino, CA, United States

    [internal_linking.similar_jobs]
    Engineering Build Program Manager

    Engineering Build Program Manager

    TCWGlobal • Santa Clara, CA, United States
    [job_card.full_time]
    Overtime Required (Time & a half).You will lead cross-functional teams and work closely with internal stakeholders and external partners to ensure builds are successfully planned, executed, tracked...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Technical Program Manager (26913)

    Sr. Technical Program Manager (26913)

    Supermicro • San Jose, California, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Technical Program Manager - electrical engineering teams experience

    Technical Program Manager - electrical engineering teams experience

    Intelliswift - An LTTS Company • Sunnyvale, CA, United States
    [job_card.full_time]
    Our team is searching for a Technical Program Manager (TPM) that can manage the complexity and vast technical workstreams across all aspects of our program. As the TPM, you seek to maximize decision...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Engineering Project Manager (semiconductor / capital equipment)

    Engineering Project Manager (semiconductor / capital equipment)

    KLA • Milpitas, CA, United States
    [job_card.full_time]
    KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, smartpho...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Engineering Program Manager

    Engineering Program Manager

    Syntricate Technologies • Cupertino, CA, US
    [job_card.full_time]
    Location : Cupertino, CA (Onsite) Duration : C2C / W2 Contract Experience : 10+ Years.Job Description : Engineering Program Manager The Product Calibration and Test team is looking for a highly motivat...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Engineering Program Manager (Mission Critical)

    Engineering Program Manager (Mission Critical)

    Insight Global • San Jose, CA, United States
    [job_card.full_time]
    The Engineering Program Manager is responsible for the development, implementation and compliance of policies and procedures for the maintenance and operational up-time of a mission critical, missi...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Engineering Program Manager

    Engineering Program Manager

    Staffing • Santa Clara, CA, US
    [job_card.full_time]
    Location : Santa Clara, CA Duration : Full-time.At Client, we believe that infrastructure powers progress.That execution is as essential as innovation. That better collaboration builds better technolo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Fintech Program Manager – Global Delivery & Strategy

    Senior Fintech Program Manager – Global Delivery & Strategy

    Intuit Inc. • Mountain View, CA, United States
    [job_card.full_time]
    A leading fintech company is seeking a Staff Technical Program Manager to join its Fintech PMO team in Mountain View.The role demands over 10 years of program management experience in a matrix envi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Program Manager, GTM Strategic Initiatives

    Sr. Program Manager, GTM Strategic Initiatives

    NYC Staffing • Sunnyvale, CA, US
    [job_card.full_time]
    LinkedIn is the world's largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exci...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    UX Program Manager

    UX Program Manager

    Bayone • Mountain View, CA, United States
    [job_card.full_time]
    Months with possibility of extension.BayOne is a minority-owned Technology and Talent Solutions Partner with a global footprint, headquartered in the San Francisco Bay Area.We excel at bridging tal...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr Staff Technical Program Manager - Compliance

    Sr Staff Technical Program Manager - Compliance

    Coupang • Mountain View, CA, United States
    [job_card.full_time]
    Description We exist to wow our customers.We know we're doing the right thing when we hear our customers say, "How did I ever live without Coupang?" Born out of an obsession to make shopping, eati...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Engineering Program Manager

    Principal Engineering Program Manager

    Adobe • San Jose, CA, US
    [job_card.full_time]
    Our Company Changing the world through digital experiences is what Adobe's all about.We give everyonefrom emerging artists to global brandseverything they need to design and deliver exceptional dig...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Program Integration Engineer

    Sr. Program Integration Engineer

    Reliable Robotics • Mountain View, CA, United States
    [job_card.permanent]
    We're building safety-enhancing technology for aviation that will save lives.Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally tra...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Program Manager - Source Testing

    Sr. Program Manager - Source Testing

    Picarro • Santa Clara, CA, United States
    [job_card.full_time]
    Picarro is the global leader in emissions measurement and analytics, delivering trusted monitoring solutions for the world's most challenging industrial emissions. Our solutions include Continuous E...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Risk Adjustment Program Manager (Defined Term)

    Risk Adjustment Program Manager (Defined Term)

    Central California Alliance for Health • Santa Cruz, CA, United States
    [job_card.full_time] +2
    This is a Defined Term position, which is designated by the Alliance and is a position of limited duration.Defined Term employees are usually hired to work in a specific department on specific long...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Engineering Program Manager

    Staff Engineering Program Manager

    Nextracker • Fremont, CA, US
    [job_card.full_time]
    Staff Engineering Program Manager.Nextracker is a global leader in intelligent solar tracker and software solutions, enabling solar panels to follow the sun's movement and maximize energy output.Ou...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Engineering Program Manager, Megapack

    Engineering Program Manager, Megapack

    Tesla • Palo Alto, CA, United States
    [job_card.full_time]
    Tesla’s Energy Engineering group is looking for a highly motivated individual to program manage existing and new design engineering for Industrial Energy Products, including the Megapack and Powerp...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Program Manager, Explore Energy

    Program Manager, Explore Energy

    Stanford • Stanford, CA, US
    [job_card.full_time]
    Program Manager for Shultz Energy Fellowships, Schneider Sustainable Energy Fellowships, and Summer Undergraduate Program on Energy Research (SUPER). The Precourt Institute for Energy is seeking exc...[show_more]
    [last_updated.last_updated_30] • [promoted]