Talent.com
AI Testing Specialist
AI Testing SpecialistVirtualVocations • Oakland, California, United States
[error_messages.no_longer_accepting]
AI Testing Specialist

AI Testing Specialist

VirtualVocations • Oakland, California, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.

Key Responsibilities

Create structured test cases that simulate complex human workflows

Define gold-standard behavior and scoring logic to evaluate agent actions

Analyze agent logs, failure modes, and decision paths

Required Qualifications

Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence

Background in QA, software testing, data analysis, or NLP annotation

Good understanding of test design principles

Comfortable with structured formats like JSON / YAML for scenario description

Basic experience with Python and JS

[job_alerts.create_a_job]

Testing Specialist • Oakland, California, United States

[internal_linking.similar_jobs]
AI Specialist

AI Specialist

Zendesk • San Francisco, CA, United States
[job_card.full_time]
As an AI Sales Specialist, you'll be responsible for driving the growth and adoption of our full suite of AI products.In this quota-carrying overlay role, you’ll work alongside our Core Account Exe...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote M&A Associate - AI Trainer ($50-$60 / hour)

Remote M&A Associate - AI Trainer ($50-$60 / hour)

Data Annotation • Berkeley, California
[filters.remote]
[job_card.full_time] +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Testing Engineer

AI Testing Engineer

Crowe • San Francisco, CA, United States
[job_card.full_time]
Your Journey at Crowe Starts Here : .At Crowe, you can build a meaningful and rewarding career.With real flexibility to balance work with life moments, you're trusted to deliver results and make an i...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Product Engineer

Product Engineer

Confero • San Francisco, CA, United States
[job_card.full_time]
This range is provided by Confero.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Direct message the job poster from Confero.Hiring Staff / Princi...[show_more]
[last_updated.last_updated_30] • [promoted]
Hybrid AI Automation Analyst : Build Agentic Workflows

Hybrid AI Automation Analyst : Build Agentic Workflows

Tink • Foster City, CA, United States
[job_card.full_time]
A global payments technology leader is seeking an AI Automation Analyst to design and implement workflows that optimize operations and automate processes. The ideal candidate will have experience wi...[show_more]
[last_updated.last_updated_30] • [promoted]
Assistant Research Scientist - AI Safety Center for Human-Compatible Artificial Intelligence (Computer Science Division)

Assistant Research Scientist - AI Safety Center for Human-Compatible Artificial Intelligence (Computer Science Division)

University of California-Berkeley • Berkeley, CA, United States
[job_card.full_time]
The UC academic salary scales set the minimum pay determined by rank and step at appointment.See the following table for the salary scale for this position : https : / / www. The current base salary rang...[show_more]
[last_updated.last_updated_1_day] • [promoted]
AI Engineer

AI Engineer

Elicit • Oakland, CA, United States
[job_card.full_time]
Elicit is an AI research assistant that uses language models to help researchers figure out what's true and make better decisions, starting with common research tasks like literature review.Elicit ...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Sr. Worldwide Specialist – GenAI / ML, Data & AI GTM

Sr. Worldwide Specialist – GenAI / ML, Data & AI GTM

Amazon • San Francisco, CA, United States
[job_card.full_time]
Do you want to help define the future of Go to Market (GTM) at AWS using generative AI? You will be part of the core worldwide GenAI Models team, responsible for helping our customers build and dep...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Specialist

AI Specialist

Zendesk, Inc. • San Francisco, CA, United States
[job_card.full_time]
Job Description • •Job Description • •As an AI Sales Specialist, you'll be responsible for driving the growth and adoption of our full suite of AI products. In this quota-carrying overlay role, you’ll w...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Senior Solution Consultant - AI Specialist

Senior Solution Consultant - AI Specialist

Anaplan • San Francisco, CA, United States
[job_card.full_time]
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their comp...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Product Specialist

AI Product Specialist

VirtualVocations • Oakland, California, United States
[job_card.full_time]
A company is looking for an AI Product Specialist to ensure the quality and documentation of AI solutions.Key Responsibilities Test new and existing AI solutions, logging bugs for developers Tro...[show_more]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
AI Strategy Associate

AI Strategy Associate

ZS • San Francisco, CA, United States
[job_card.full_time]
ZS is a place where passion changes lives.As a management consulting and technology firm focused on improving life and how we live it, we transform ideas into impact by bringing together data, scie...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Associate Director, AI Data Scientist

Associate Director, AI Data Scientist

Jazz Pharmaceuticals • Atherton, California, USA
[job_card.full_time]
If you are a current Jazz employee please apply via the Internal Career site.Jazz Pharmaceuticals is a global biopharma company whose purpose is to innovate to transform the lives of patients and ...[show_more]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Applied AI Engineer

Applied AI Engineer

Zania • San Francisco, CA, United States
[job_card.full_time]
Join to apply for the Applied AI Engineer role at Zania.Every enterprise spends millions of dollars on Governance, Risk, and Compliance (GRC). It's one of the most critical, yet universally painful,...[show_more]
[last_updated.last_updated_30] • [promoted]
Test Automation Architect (AI / ML Focus) - Remote

Test Automation Architect (AI / ML Focus) - Remote

EPAM Systems • San Francisco, CA, United States
[filters.remote]
[job_card.full_time]
We are seeking a Test Automation Architect (AI / ML Focus) - Remote to join our team.In this role, you will drive innovation in automated testing for complex systems and help shape the future of qual...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Specialist

AI Specialist

Zendesk Group • San Francisco, CA, United States
[job_card.full_time]
Job Description • •Job Description • •As an AI Sales Specialist, you'll be responsible for driving the growth and adoption of our full suite of AI products. In this quota-carrying overlay role, you’ll w...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer

AI Engineer

Fathom - AI Meeting Assistant • San Francisco, CA, United States
[job_card.full_time]
Fathom - AI Meeting Assistant provided pay range.This range is provided by Fathom - AI Meeting Assistant.Your actual pay will be based on your skills and experience — talk with your recruiter to le...[show_more]
[last_updated.last_updated_30] • [promoted]
Simulation and Test Engineer (Conversational AI) - US Based

Simulation and Test Engineer (Conversational AI) - US Based

Andromeda • San Francisco, CA, United States
[job_card.full_time]
Simulation and Test Engineer (Conversational AI) – US Based.Be among the first 25 applicants.This range is provided by Andromeda. Your actual pay will be based on your skills and experience — talk w...[show_more]
[last_updated.last_updated_30] • [promoted]