Talent.com
Sr. Product Manager - Conversational AI Evaluation, Metrics & Quality
Sr. Product Manager - Conversational AI Evaluation, Metrics & QualityIllinois Staffing • Springfield, IL, US
Sr. Product Manager - Conversational AI Evaluation, Metrics & Quality

Sr. Product Manager - Conversational AI Evaluation, Metrics & Quality

Illinois Staffing • Springfield, IL, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Product Manager, Conversational AI Evaluation, Metrics & Quality

We are looking for a Senior Product Manager to lead the strategy, roadmap, and execution for optimizing Zoom Virtual Agent performance. This cross-functional role partners with Product, Data Science, Engineering, and Conversational Design to translate data into features that elevate contact center quality and customer experience.

The Zoom Virtual Agent team is dedicated to building state-of-the-art conversational AI solutions that resolve customer issues quickly and efficiently. Play a critical role in developing metrics, intelligence, and evaluation systems that drive continuous improvement using advanced LLMs and data science.

Responsibilities

  • Defining and delivering the complete analytics experience for Zoom Virtual Agent which includes core operational metrics, end-to-end journey analytics, and AI-driven metrics.
  • Leading the development of a conversational AI evaluation engine to programmatically assess quality, accuracy, tone, and overall effectiveness of Virtual Agent interactions at scale.
  • Partnering with engineering and AI / ML teams to define schema for engagement analytics, APIs, and AI-generated metadata.
  • Analyzing large-scale agent performance data, conversational logs, and customer feedback to identify high-impact product improvements in close collaboration with engineering and AI / ML teams.
  • Defining a 1218 month roadmap for data infrastructure, reporting, analytics, and evaluation systems enabling teams and customers to optimize Virtual Agent deployments.
  • Partnering with Product Marketing, Sales, and Customer Success to communicate the value and ROI of performance reporting and optimization capabilities to contact center customers.
  • Persisting benchmark Virtual Agent performance against industry standards and competitors using data and LLM-based evaluations to identify feature gaps and growth opportunities.

What we're looking for :

  • B.S. or M.S. in Computer Science, Engineering, Statistics, or a related technical field.
  • 5+ years of Product Management experience, with at least 3 years focused on data, analytics, machine learning, or intelligence platforms.
  • Proven experience working on conversational AI products, Virtual Agents, chatbots, or other enterprise contact center technologies.
  • Deep familiarity with core contact center metrics (e.g., AHT, FCR, CSAT, Containment, Deflection).
  • Solid understanding of statistical analysis, data visualization, and the ability to define metrics that meaningfully drive product decisions.
  • Solid technical acumen, capable of articulating requirements for data pipelines, reporting APIs, and machine learning / LLM models.
  • Salary Range or On Target Earnings : Minimum : $146,700.00 Maximum : $339,300.00. In addition to the base salary and / or OTE listed, Zoom has a Total Direct Compensation philosophy that takes into consideration; base salary, bonus, and equity value. Note : Starting pay will be based on a number of factors and commensurate with qualifications & experience. We also have a location-based compensation structure; there may be a different range for candidates in this and other locations.

    At Zoom, we offer a window of at least 5 days for you to apply because we believe in giving you every opportunity. Below is the potential closing date, just in case you want to mark it on your calendar. We look forward to receiving your application!

    Anticipated Position Close Date : 12 / 29 / 25

    Ways of Working : Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description / posting.

    Benefits : As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways.

    About Us : Zoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars. We're problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Find room to grow with opportunities to stretch your skills and advance your career in a collaborative, growth-focused environment.

    Our Commitment : At Zoom, we believe great work happens when people feel supported and empowered. We're committed to fair hiring practices that ensure every candidate is evaluated based on skills, experience, and potential. If you require an accommodation during the hiring process, let us knowwe're here to support you at every step.

    [job_alerts.create_a_job]

    Sr Product Manager • Springfield, IL, US

    [internal_linking.similar_jobs]
    Travel Cath Lab Tech

    Travel Cath Lab Tech

    Medical Solutions Allied • Springfield, IL, US
    [job_card.full_time]
    Medical Solutions Allied is seeking a travel Cath Lab Technologist for a travel job in Springfield, Illinois.Job Description & Requirements. We’re seeking talented healthcare professionals...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote ML Technical Quality Assurance Lead AI Trainer

    Remote ML Technical Quality Assurance Lead AI Trainer

    SuperAnnotate • Springfield, Illinois, US
    [filters.remote]
    [job_card.full_time]
    AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with mode...[show_more]
    [last_updated.last_updated_variable_hours] • [new]
    Travel Cath Lab Tech - $3366 / Week

    Travel Cath Lab Tech - $3366 / Week

    Pulse Healthcare Services • Springfield, IL, US
    [job_card.full_time]
    Pulse Healthcare Services is seeking an experienced Cath Lab Tech for an exciting Travel Allied job in Springfield, IL.Shift : 4x10 hr days Start Date : 12 / 08 / 2025 Duration : 14 weeks Pay : $3366 / Wee...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Nurse RN - Electrophysiology Lab

    Travel Nurse RN - Electrophysiology Lab

    Springboard Healthcare • Springfield, IL, US
    [job_card.full_time]
    Springboard Healthcare is seeking a travel nurse RN Electrophysiology Lab for a travel nursing job in Springfield, Illinois. Job Description & Requirements.Springboard Healthcare Job ID #797190....[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote FP&A Manager – AI Trainer ($50-$60 / hour)

    Remote FP&A Manager – AI Trainer ($50-$60 / hour)

    Data Annotation • Springfield, Illinois
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote AI Content Reviewer

    Remote AI Content Reviewer

    Outlier • Springfield, IL, United States
    [filters.remote]
    [job_card.full_time]
    Additional pay available based on project performance.Freelance / 1099 contract — not an internship.Flexible hours — you choose when and how much to work. Weekly via our secure platform.Outlier, a pla...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Cath Lab Tech - $3366 / Week

    Travel Cath Lab Tech - $3366 / Week

    Cynet Health • Springfield, IL, US
    [job_card.full_time]
    Cynet Health is seeking an experienced Cath Lab Tech for an exciting Travel Allied job in Springfield, IL.Shift : 4x10 hr days Start Date : ASAP Duration : 14 weeks Pay : $3366 / Week.Ranked #5 Best Tr...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Cath Lab Tech - $2790.7 / Week

    Travel Cath Lab Tech - $2790.7 / Week

    Host Healthcare • Springfield, IL, US
    [job_card.full_time]
    Host Healthcare is seeking an experienced Cath Lab Tech for an exciting Travel Allied job in Springfield, IL.Shift : Inquire Start Date : 01 / 19 / 2026 Duration : 13 weeks Pay : $2790.At Host Healthcare, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Cath Lab Tech - $3028 / Week

    Travel Cath Lab Tech - $3028 / Week

    Cynet Health • Springfield, IL, US
    [job_card.full_time]
    Cynet Health is seeking an experienced Cath Lab Tech for an exciting Travel Allied job in Springfield, IL.Shift : 3x12 hr days Start Date : 01 / 19 / 2026 Duration : 13 weeks Pay : $3028 / Week.Ranked #5 B...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Cath Lab Tech

    Travel Cath Lab Tech

    Medical Solutions • Springfield, IL, US
    [job_card.full_time]
    Medical Solutions is seeking a travel Cath Lab Technologist for a travel job in Springfield, Illinois.Job Description & Requirements. We’re seeking talented healthcare professionals whose ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Text Quality Evaluator

    Remote Text Quality Evaluator

    Outlier • Springfield, IL, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Product Marketing Manager Oracle AI Data Platform

    Product Marketing Manager Oracle AI Data Platform

    Illinois Staffing • Springfield, IL, US
    [job_card.full_time]
    As a Product Marketing Manager on the Market Engineering team covering the AI Data Platform (AIDP), you will serve as the strategic link between product innovation and market impact.You'll define h...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Remote R Engineer AI Trainer

    Remote R Engineer AI Trainer

    SuperAnnotate • Springfield, Illinois, US
    [filters.remote]
    [job_card.full_time]
    As a remote, hourly paid R Engineer, you will review AI-generated responses and generate high-quality R and data-analysis-focused content, evaluating the reasoning quality and step-by-step problem-...[show_more]
    [last_updated.last_updated_variable_hours] • [new]
    Principal Product Manager - Health Knowledge Platform

    Principal Product Manager - Health Knowledge Platform

    Veterans Staffing • Springfield, IL, US
    [job_card.full_time]
    Product Manager For Healthcare Knowledge Graph Initiatives.Join us to shape the future of healthcare, transforming how clinicians deliver care through AI-driven solutions that enhance efficiency, r...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Travel Cath Lab Technologist

    Travel Cath Lab Technologist

    Ethos Medical Staffing • Springfield, IL, US
    [job_card.full_time]
    Ethos Medical Staffing is seeking a travel Cath Lab Technologist for a travel job in Springfield, Illinois.Job Description & Requirements. Ethos Medical Staffing Job ID #35247131.Pay package is ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Data Annotation • Springfield, Illinois
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel CVOR Technologist

    Travel CVOR Technologist

    Ethos Medical Staffing • Springfield, IL, US
    [job_card.full_time]
    Ethos Medical Staffing is seeking a travel CVOR Technologist for a travel job in Springfield, Illinois.Job Description & Requirements. Ethos Medical Staffing Job ID #35256577.Pay package is base...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Cath Lab Tech - $2729 / Week

    Travel Cath Lab Tech - $2729 / Week

    LRS Healthcare - Allied • Springfield, IL, US
    [job_card.full_time]
    LRS Healthcare - Allied is seeking an experienced Cath Lab Tech for an exciting Travel Allied job in Springfield, IL.Shift : Inquire Start Date : 01 / 19 / 2026 Duration : 13 weeks Pay : $2729 / Week.Ready...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]