Talent.com
Sr. Product Manager - Conversational AI Evaluation, Metrics & Quality
Sr. Product Manager - Conversational AI Evaluation, Metrics & QualityIdaho Staffing • Boise, ID, US
Sr. Product Manager - Conversational AI Evaluation, Metrics & Quality

Sr. Product Manager - Conversational AI Evaluation, Metrics & Quality

Idaho Staffing • Boise, ID, US
[job_card.1_day_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Product Manager, Conversational AI Evaluation, Metrics & Quality

We are looking for a Senior Product Manager to lead the strategy, roadmap, and execution for optimizing Zoom Virtual Agent performance. This cross-functional role partners with Product, Data Science, Engineering, and Conversational Design to translate data into features that elevate contact center quality and customer experience.

The Zoom Virtual Agent team is dedicated to building state-of-the-art conversational AI solutions that resolve customer issues quickly and efficiently. Play a critical role in developing metrics, intelligence, and evaluation systems that drive continuous improvement using advanced LLMs and data science.

Responsibilities

  • Defining and delivering the complete analytics experience for Zoom Virtual Agent which includes core operational metrics, end-to-end journey analytics, and AI-driven metrics.
  • Leading the development of a conversational AI evaluation engine to programmatically assess quality, accuracy, tone, and overall effectiveness of Virtual Agent interactions at scale.
  • Partnering with engineering and AI / ML teams to define schema for engagement analytics, APIs, and AI-generated metadata.
  • Analyzing large-scale agent performance data, conversational logs, and customer feedback to identify high-impact product improvements in close collaboration with engineering and AI / ML teams.
  • Defining a 1218 month roadmap for data infrastructure, reporting, analytics, and evaluation systems enabling teams and customers to optimize Virtual Agent deployments.
  • Partnering with Product Marketing, Sales, and Customer Success to communicate the value and ROI of performance reporting and optimization capabilities to contact center customers.
  • Persisting benchmark Virtual Agent performance against industry standards and competitors using data and LLM-based evaluations to identify feature gaps and growth opportunities.

What we're looking for :

  • B.S. or M.S. in Computer Science, Engineering, Statistics, or a related technical field.
  • 5+ years of Product Management experience, with at least 3 years focused on data, analytics, machine learning, or intelligence platforms.
  • Proven experience working on conversational AI products, Virtual Agents, chatbots, or other enterprise contact center technologies.
  • Deep familiarity with core contact center metrics (e.g., AHT, FCR, CSAT, Containment, Deflection).
  • Solid understanding of statistical analysis, data visualization, and the ability to define metrics that meaningfully drive product decisions.
  • Solid technical acumen, capable of articulating requirements for data pipelines, reporting APIs, and machine learning / LLM models.
  • Salary Range or On Target Earnings : Minimum : $146,700.00 Maximum : $339,300.00. In addition to the base salary and / or OTE listed, Zoom has a Total Direct Compensation philosophy that takes into consideration; base salary, bonus, and equity value. Note : Starting pay will be based on a number of factors and commensurate with qualifications & experience. We also have a location-based compensation structure; there may be a different range for candidates in this and other locations.

    At Zoom, we offer a window of at least 5 days for you to apply because we believe in giving you every opportunity. Below is the potential closing date, just in case you want to mark it on your calendar. We look forward to receiving your application!

    Anticipated Position Close Date : 12 / 29 / 25

    Ways of Working : Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description / posting.

    Benefits : As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways.

    About Us : Zoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars. We're problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Find room to grow with opportunities to stretch your skills and advance your career in a collaborative, growth-focused environment.

    Our Commitment : At Zoom, we believe great work happens when people feel supported and empowered. We're committed to fair hiring practices that ensure every candidate is evaluated based on skills, experience, and potential. If you require an accommodation during the hiring process, let us knowwe're here to support you at every step.

    [job_alerts.create_a_job]

    Sr Product Manager • Boise, ID, US

    [internal_linking.similar_jobs]
    Product Marketing Manager - Oracle AI Database Product Launches

    Product Marketing Manager - Oracle AI Database Product Launches

    Idaho Staffing • Boise, ID, US
    [job_card.full_time]
    Oracle is seeking an experienced Product Marketing Manager to orchestrate global product and feature introductions for the Oracle AI Database portfolio. In this high-visibility role, you'll collabor...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote ML Technical Quality Assurance Lead - AI Trainer

    Remote ML Technical Quality Assurance Lead - AI Trainer

    SuperAnnotate • Boise City, Idaho, US
    [filters.remote]
    [job_card.full_time]
    AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with mode...[show_more]
    [last_updated.last_updated_less] • [new]
    Senior Product Manager

    Senior Product Manager

    Idaho Staffing • Boise, ID, US
    [job_card.full_time]
    Senior Product Manager, Incident Analysis.Trusted by nearly half of both the Fortune 500 and the Forbes AI 50, as well as approximately two-thirds of the Fortune 100, PagerDuty is essential for del...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Product Manager

    Product Manager

    Idaho Staffing • Boise, ID, US
    [job_card.full_time]
    Highmark Health Product Manager.Job Summary : This job defines the product's fundamental value proposition, outlines vision and execution plan, gains alignment and support from key strategic partner...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Product Manager / Strategy 5-ProdDev

    Product Manager / Strategy 5-ProdDev

    Idaho Staffing • Boise, ID, US
    [job_card.full_time]
    Senior Principal Product Manager.We are seeking a Senior Principal Product Manager to lead the strategy, vision, and execution of the OCI Data Services platform. The ideal candidate will have hands-...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Engineer & Researcher, Inference - Boise, USA

    AI Engineer & Researcher, Inference - Boise, USA

    Speechify • Boise, ID, US
    [job_card.full_time]
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Product Manager - Clinical Platforms & Transformation

    Principal Product Manager - Clinical Platforms & Transformation

    Idaho Staffing • Boise, ID, US
    [job_card.full_time]
    Become a part of our caring community and help us put health first.The Principal Product Manager conceives of, develops, delivers, and manages products for customer use. The Principal Product Manage...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Product Manager, AIOps

    Senior Product Manager, AIOps

    Idaho Staffing • Boise, ID, US
    [job_card.full_time]
    Trusted by nearly half of both the Fortune 500 and the Forbes AI 50, as well as approximately two-thirds of the Fortune 100, PagerDuty is essential for delivering always-on digital experiences to m...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Clinical Research Associate II / Sr CRA - Full Service - ONC + Gen Med (Home-Based in Western US)

    Clinical Research Associate II / Sr CRA - Full Service - ONC + Gen Med (Home-Based in Western US)

    Syneos Health / inVentiv Health Commercial LLC • Boise, ID, United States
    [filters.remote]
    [job_card.temporary]
    Clinical Research Associate II / Sr CRA - Full Service - ONC + Gen Med (Home-Based in Western US).Syneos Health is a leading fully integrated biopharmaceutical solutions organization built to accel...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Senior C Engineer - AI Trainer

    Remote Senior C Engineer - AI Trainer

    SuperAnnotate • Meridian, Idaho, US
    [filters.remote]
    [job_card.full_time]
    As a Senior C Engineer, you will work remotely on an hourly paid basis to review AI-generated C code, low-level systems designs, and technical explanations, as well as generate high-quality referen...[show_more]
    [last_updated.last_updated_less] • [new]
    Principal Product Manager

    Principal Product Manager

    Blue Cross and Blue Shield of North Carolina • Boise, ID, United States
    [job_card.full_time]
    As a Principal Product Manager, you will oversee product roadmaps, strategy, and vision for strategic product offerings across all business units and domains. In this capacity, you will collaborate ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Product Manager - AI Solutions

    Lead Product Manager - AI Solutions

    Idaho Staffing • Boise, ID, US
    [job_card.full_time]
    Become a part of our caring community and help us put health first.The Enterprise AI organization at Humana is a pioneering force, driving AI innovation across our Insurance and CenterWell business...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Applied AI Engineer & Researcher - Boise, USA

    Applied AI Engineer & Researcher - Boise, USA

    Speechify • Boise, ID, US
    [job_card.full_time]
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote R Engineer - AI Trainer

    Remote R Engineer - AI Trainer

    SuperAnnotate • Meridian, Idaho, US
    [filters.remote]
    [job_card.full_time]
    As a remote, hourly paid R Engineer, you will review AI-generated responses and generate high-quality R and data-analysis-focused content, evaluating the reasoning quality and step-by-step problem-...[show_more]
    [last_updated.last_updated_less] • [new]
    Senior Specialist, Technical Evaluations & Proposals

    Senior Specialist, Technical Evaluations & Proposals

    Resilience • Boise, ID, United States
    [job_card.full_time]
    A career at Resilience is more than just a job - it's an opportunity to change the future.Resilience is a technology-focused biomanufacturing company that's. We're building a sustainable network of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Clinical Product Manager Medical Device Safety & Usability

    Clinical Product Manager Medical Device Safety & Usability

    Idaho Staffing • Boise, ID, US
    [job_card.full_time]
    Clinical Product Manager (Medical Device Focus).Oracle Health is standing up a specialized clinical product management team focused on medical devicealigned products. This team bridges clinical prac...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Director, Transformation (AI) - Remote

    Director, Transformation (AI) - Remote

    Molina Healthcare • Meridian, ID, US
    [filters.remote]
    [job_card.full_time]
    Leads and directs enterprise initiatives that drive strategic, operational, and technology-enabled transformation across the organization. Partners with senior leadership to evaluate opportunities, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Product Manager, Connected Cameras

    Staff Product Manager, Connected Cameras

    Motive • Boise, ID, US
    [job_card.full_time]
    Staff Product Manager, Connected Cameras.Motive empowers the people who run physical operations with tools to make their work safer, more productive, and more profitable. For the first time ever, sa...[show_more]
    [last_updated.last_updated_30] • [promoted]