AI Testing SpecialistVirtualVocations • Norwalk, California, United States
AI Testing Specialist
VirtualVocations • Norwalk, California, United States
[job_card.30_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.
Key Responsibilities
Create structured test cases that simulate complex human workflows
Define gold-standard behavior and scoring logic to evaluate agent actions
Analyze agent logs, failure modes, and decision paths
Required Qualifications
Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence
Background in QA, software testing, data analysis, or NLP annotation
Good understanding of test design principles
Comfortable with structured formats like JSON / YAML for scenario description
Basic experience with Python and JS
[job_alerts.create_a_job]
Testing Specialist • Norwalk, California, United States
[internal_linking.similar_jobs]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
As a Senior C Engineer, you will work remotely on an hourly paid basis to review AI-generated C code, low-level systems designs, and technical explanations, as well as generate high-quality referen...[show_more] A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.Key Responsibilities Create structured test cases that simulate complex human workflows Define gold-standard ...[show_more] 
Senior HR Manager – Fashion & Creative Industry.Beverly Hills, CA (Fully Onsite, 9AM–6PM).We are seeking a highly experienced, polished, and people-focused.
This role supports a large employee popul...[show_more] The Payroll Specialist is responsible for accurate and timely payroll processing within a manufacturing environment.This role supports hourly and salaried employees, ensures compliance with wage an...[show_more] 
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...[show_more]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
A reasonable estimate for this position is $90,000-$188,200 for Exempt and $43.See Specialist Series Exempt table.Specialist Series Non-Exempt table.
Sunday, Jul 27, 2025 at 11 : 59pm (Pacific Time).A...[show_more]
Position : AI Data Architect Location : Santa Ana, CA Duration : 12+ months Job description Senior AI Data Architect role, you should focus on these 5 high-impact skill clusters.These combine the "mus...[show_more]
Our client is a leading force in advancing safer, smarter AI technology.Their work has been featured in.They have built a global community of expert contributors and have paid more than.No contract...[show_more]
Are you looking to earn extra income from the comfort of your home? We're seeking motivated individuals to explore and test a variety of remote side hustle opportunities featured on FinanceBuzz.Thi...[show_more]
Join Our Team as a Work-From-Home Data Entry Research Panelist!.Are you ready to earn money from the comfort of your own home? This exciting opportunity is perfect for anyone with a variety of skil...[show_more]
The AI Engineer is responsible for the development of AI solutions, typically leveraging pretrained models and copilots, to support GEI's priority digital and AI initiatives.This role focuses on bu...[show_more]
Premier litigation law firm in California, dedicated to pioneering the future of legal services through advanced artificial intelligence.
Our goal is to become one of the nation's first law firms bu...[show_more]
Samson Rose has been exclusively engaged by a pioneering Robotics & AI company in Southern California to find top-tier engineers for multiple high-impact roles, including Robotics AI Engineers focu...[show_more]
This position is for an experienced professional in the full-time employment type, with hybrid work mode.The job is located in multiple cities across the United States including Bellevue, Charlotte...[show_more]
Senior Software Engineer, AI Model serving (Europe) – Speechify.Apply for the Senior Software Engineer, AI Model serving (Europe) role at Speechify.
APPLY THROUGH THIS LINK : https : / / job-boards.Speec...[show_more] We're on the hunt for curious, motivated individuals to test and review online money-making opportunities featured on FinanceBuzz.
If you enjoy discovering new platforms and sharing your experience,...[show_more]
Remote M&A Associate - AI Trainer ($50-$60 / hour)
Data Annotation • Norwalk, California
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Remote Senior C Engineer - AI Trainer
SuperAnnotate • Alhambra, California, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days]
AI Testing Specialist
VirtualVocations • West Covina, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Sr HR Manager
Vaco by Highspring • Altadena, California, United States
[job_card.permanent]
[last_updated.last_updated_variable_days] • [promoted]
Payroll Specialist
Vaco by Highspring • Altadena, California, United States
[job_card.permanent]
[last_updated.last_updated_30] • [promoted]
Online Survey Taker. Earn up to $25 per survey. - Remote
Earn Haus • Mount Wilson, CA, United States
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Get Paid to Test Products at Home – Flexible Hours, Weekly Pay
OCPA • Cedar Flat, California, us
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
Research Imaging Specialist
University of California - Irvine • Orange, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
AI Data Architect
Global IT Con • Santa Ana, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Analyst
Quality Talent Group • Altadena, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Side Hustle Evaluator - Flexible Online Gig Work
Finance Buzz • Altadena, California, US
[filters.remote]
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
Remote Data Entry Work From Home Focus Research Panelist
Maxion Corp LLC • Altadena, CA, United States
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
AI Engineer
GEI Consultants • Pasadena, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Agentic AI Engineer
Jobot • Costa Mesa, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Robotics AI - Calibration, Localization, and Mapping
Samson Rose • Orange, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Director, Agentic AI
Siemens • Costa Mesa, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Senior Software Engineer, AI Model serving (Europe)
Speechify • San Marino, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Work-from-Home Tester - Try Online Side Gigs and Give Feedback
Finance Buzz • Altadena, California, US
[filters.remote]
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]