Talent.com
Sr. Product Manager - Conversational AI Evaluation, Metrics & Quality
Sr. Product Manager - Conversational AI Evaluation, Metrics & QualityIdaho Staffing • Boise, ID, US
[error_messages.no_longer_accepting]
Sr. Product Manager - Conversational AI Evaluation, Metrics & Quality

Sr. Product Manager - Conversational AI Evaluation, Metrics & Quality

Idaho Staffing • Boise, ID, US
[job_card.1_day_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Product Manager, Conversational AI Evaluation, Metrics & Quality

We are looking for a Senior Product Manager to lead the strategy, roadmap, and execution for optimizing Zoom Virtual Agent performance. This cross-functional role partners with Product, Data Science, Engineering, and Conversational Design to translate data into features that elevate contact center quality and customer experience.

The Zoom Virtual Agent team is dedicated to building state-of-the-art conversational AI solutions that resolve customer issues quickly and efficiently. Play a critical role in developing metrics, intelligence, and evaluation systems that drive continuous improvement using advanced LLMs and data science.

Responsibilities

  • Defining and delivering the complete analytics experience for Zoom Virtual Agent which includes core operational metrics, end-to-end journey analytics, and AI-driven metrics.
  • Leading the development of a conversational AI evaluation engine to programmatically assess quality, accuracy, tone, and overall effectiveness of Virtual Agent interactions at scale.
  • Partnering with engineering and AI / ML teams to define schema for engagement analytics, APIs, and AI-generated metadata.
  • Analyzing large-scale agent performance data, conversational logs, and customer feedback to identify high-impact product improvements in close collaboration with engineering and AI / ML teams.
  • Defining a 1218 month roadmap for data infrastructure, reporting, analytics, and evaluation systems enabling teams and customers to optimize Virtual Agent deployments.
  • Partnering with Product Marketing, Sales, and Customer Success to communicate the value and ROI of performance reporting and optimization capabilities to contact center customers.
  • Persisting benchmark Virtual Agent performance against industry standards and competitors using data and LLM-based evaluations to identify feature gaps and growth opportunities.

What we're looking for :

  • B.S. or M.S. in Computer Science, Engineering, Statistics, or a related technical field.
  • 5+ years of Product Management experience, with at least 3 years focused on data, analytics, machine learning, or intelligence platforms.
  • Proven experience working on conversational AI products, Virtual Agents, chatbots, or other enterprise contact center technologies.
  • Deep familiarity with core contact center metrics (e.g., AHT, FCR, CSAT, Containment, Deflection).
  • Solid understanding of statistical analysis, data visualization, and the ability to define metrics that meaningfully drive product decisions.
  • Solid technical acumen, capable of articulating requirements for data pipelines, reporting APIs, and machine learning / LLM models.
  • Salary Range or On Target Earnings : Minimum : $146,700.00 Maximum : $339,300.00. In addition to the base salary and / or OTE listed, Zoom has a Total Direct Compensation philosophy that takes into consideration; base salary, bonus, and equity value. Note : Starting pay will be based on a number of factors and commensurate with qualifications & experience. We also have a location-based compensation structure; there may be a different range for candidates in this and other locations.

    At Zoom, we offer a window of at least 5 days for you to apply because we believe in giving you every opportunity. Below is the potential closing date, just in case you want to mark it on your calendar. We look forward to receiving your application!

    Anticipated Position Close Date : 12 / 29 / 25

    Ways of Working : Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description / posting.

    Benefits : As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways.

    About Us : Zoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars. We're problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Find room to grow with opportunities to stretch your skills and advance your career in a collaborative, growth-focused environment.

    Our Commitment : At Zoom, we believe great work happens when people feel supported and empowered. We're committed to fair hiring practices that ensure every candidate is evaluated based on skills, experience, and potential. If you require an accommodation during the hiring process, let us knowwe're here to support you at every step.

    [job_alerts.create_a_job]

    Sr Product Manager • Boise, ID, US

    [internal_linking.similar_jobs]
    Remote R Engineer AI Trainer

    Remote R Engineer AI Trainer

    SuperAnnotate • Meridian, Idaho, US
    [filters.remote]
    [job_card.full_time]
    As a remote, hourly paid R Engineer, you will review AI-generated responses and generate high-quality R and data-analysis-focused content, evaluating the reasoning quality and step-by-step problem-...[show_more]
    [last_updated.last_updated_variable_hours] • [new]
    AI Strategic Partnership Success Coordinator

    AI Strategic Partnership Success Coordinator

    Micron • Boise, Idaho, USA
    [job_card.full_time]
    Our vision is to transform how the world uses information to enrich life for.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of inf...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Data Annotation • Meridian, ID, United States
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Trainer -Remote Content QA Reviewer

    AI Trainer -Remote Content QA Reviewer

    Outlier • Boise, ID, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Director, Consumer Products

    Director, Consumer Products

    Consolidated Communications • Boise, ID, United States
    [job_card.full_time]
    Classification : Exempt / Non-Bargaining.Position may be located remote.Join a team that offers growth potential, competitive compensation, an excellent benefits package and the opportunity to make ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Solutions Architect and Technical Program Manager

    AI Solutions Architect and Technical Program Manager

    Micron • Boise, Idaho, USA
    [job_card.full_time]
    Our vision is to transform how the world uses information to enrich life for.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of inf...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Data Annotation • Boise, ID, United States
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Manager, Quality

    Senior Manager, Quality

    PHOTRONICS INC • Boise, ID, US
    [job_card.full_time]
    For more than 50 years, Photronics has been a global leader in photomask technology—powering the innovation behind smartphones, computers, automotive technology, and countless devices used ev...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Engineer & Researcher, Inference - Boise, USA

    AI Engineer & Researcher, Inference - Boise, USA

    Speechify • Boise, ID, US
    [job_card.full_time]
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Clinical Research Associate II / Sr CRA - Full Service - ONC + Gen Med (Home-Based in Western US)

    Clinical Research Associate II / Sr CRA - Full Service - ONC + Gen Med (Home-Based in Western US)

    Syneos Health / inVentiv Health Commercial LLC • Boise, ID, United States
    [filters.remote]
    [job_card.temporary]
    Clinical Research Associate II / Sr CRA - Full Service - ONC + Gen Med (Home-Based in Western US).Syneos Health is a leading fully integrated biopharmaceutical solutions organization built to accel...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Semiconductor Professional - Semiconductor Product Engineer - Customer Quality - Project Management

    Semiconductor Professional - Semiconductor Product Engineer - Customer Quality - Project Management

    ProSearch Recruiting Partners Inc • Boise, ID, US
    [job_card.full_time]
    Project Manager needed for Leading OEM.A renowned global leader in clean room, robotics, and fabrication machinery is seeking a dynamic Project Manager to join their team.The Project Manager will p...[show_more]
    [last_updated.last_updated_30] • [promoted]
    machine learning engineer

    machine learning engineer

    innovitusa • Boise, Idaho, USA
    [job_card.full_time]
    Visa : Open to any visa type with valid work authorization in the USA.We are hiring a machine learning engineer to build production-grade machine learning models pipelines and real-time inference sy...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Trainer -Remote Content Reviewer

    AI Trainer -Remote Content Reviewer

    Outlier • Boise, ID, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Product Manager

    Principal Product Manager

    Blue Cross and Blue Shield of North Carolina • Boise, ID, United States
    [job_card.full_time]
    As a Principal Product Manager, you will oversee product roadmaps, strategy, and vision for strategic product offerings across all business units and domains. In this capacity, you will collaborate ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Applied AI Engineer & Researcher - Boise, USA

    Applied AI Engineer & Researcher - Boise, USA

    Speechify • Boise, ID, US
    [job_card.full_time]
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Product Manager, Platforms and Mobile Apps

    Product Manager, Platforms and Mobile Apps

    American Red Cross • Boise, ID, United States
    [job_card.full_time]
    Please use Google Chrome or Mozilla Firefox when accessing Candidate Home.By joining the American Red Cross you will touch millions of lives every year and experience the greatness of the human spi...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Specialist, Technical Evaluations & Proposals

    Senior Specialist, Technical Evaluations & Proposals

    Resilience • Boise, ID, United States
    [job_card.full_time]
    A career at Resilience is more than just a job - it's an opportunity to change the future.Resilience is a technology-focused biomanufacturing company that's. We're building a sustainable network of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Director, Transformation (AI) - Remote

    Director, Transformation (AI) - Remote

    Molina Healthcare • Meridian, ID, US
    [filters.remote]
    [job_card.full_time]
    Leads and directs enterprise initiatives that drive strategic, operational, and technology-enabled transformation across the organization. Partners with senior leadership to evaluate opportunities, ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]