AI Testing SpecialistVirtualVocations • Long Beach, California, United States
AI Testing Specialist
VirtualVocations • Long Beach, California, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.
Key Responsibilities
Create structured test cases that simulate complex human workflows
Define gold-standard behavior and scoring logic to evaluate agent actions
Analyze agent logs, failure modes, and decision paths
Required Qualifications
Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence
Background in QA, software testing, data analysis, or NLP annotation
Good understanding of test design principles
Comfortable with structured formats like JSON / YAML for scenario description
Basic experience with Python and JS
[job_alerts.create_a_job]
Testing Specialist • Long Beach, California, United States
[internal_linking.similar_jobs]
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...[show_more] A company is looking for a Compensation, Benefits, and Job Analysis Specialist - AI Trainer (Contract).Key Responsibilities Evaluate AI model outputs related to your field and provide structured ...[show_more] 
As an experienced engineer, you know that machine learning is critical to understanding and processing massive datasets.Your ability to conduct statistical analyses on business processes using ML t...[show_more]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
The Good Life MedStaff is seeking a travel nurse RN Med Surg for a travel nursing job in Avalon, California.Job Description & Requirements.
Beautiful Island location travel contract is in need o...[show_more]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
Drive the future of quality for the world's most complex devices by building agentic workflows and intelligent frameworks.
In this role, you will architect and develop tools that empower autonomous ...[show_more]
At Henkel, you’ll be part of an organization that’s shaping the future through innovation, sustainability and collaboration.
With our trusted brands like Persil®, ‘all®, Loctite®, Snuggle®, and Schw...[show_more]
We are actively looking to hire talented therapists in the Glendale area, who are passionate about patient care and committed to clinical excellence.
Wanting to deliver high quality behavioral healt...[show_more] Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more] 
A globally recognized entertainment organization is hiring an AI Engineer to build and scale internal AI agents that enhance productivity across creative, operational, and business teams.This role ...[show_more]
Outsmart is an early-stage startup on a mission to reimagine higher education.We are democratizing access to higher education by creating an entirely new collegiate experience.With $38M in backing ...[show_more]
You will work closely with engineering to improve overall test processes across the company.Fabricate, assemble and test high quality, high reliability propulsion components, combustion devices and...[show_more] A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.Key Responsibilities Create structured test cases that simulate complex human workflows Define gold-standard ...[show_more] 
Capsule is building the world's most intuitive AI-powered video editing tool, designed for modern teams.We're a Series A startup led by two serial founders who have built and scaled creative platfo...[show_more])
Wednesday, Dec 31, 2025 at 11 : 59pm (Pacific Time).Apply by this date to ensure full consideration by the committee.Tuesday, Jun 30, 2026 at 11 : 59pm (Pacific Time).
Applications will continue to be a...[show_more]
A leading defense and technology firm is seeking a Principal Solutions Architect - AI Systems to lead the architecture of an AI-enabled decision-support system.
This remote / hybrid position requires ...[show_more] At Henkel, you’ll be part of an organization that’s shaping the future through innovation, sustainability and collaboration.
With our trusted brands like Persil®, ‘all®, Loctite®, Snuggle®, and Schw...[show_more]
Research Lead - AI Cyber Testing & Evaluation
RAND Corporation • Santa Monica, CA, United States
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
AI Trainer Specialist
VirtualVocations • Long Beach, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Booz Allen Hamilton • El Segundo, CA, United States
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]
Remote M&A Associate - AI Trainer ($50-$60 / hour)
Data Annotation • Rancho Palos Verdes, California
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Travel Nurse RN - Med Surg
The Good Life MedStaff • Avalon, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Get Paid to Test Products at Home – Flexible Hours, Weekly Pay
OCPA • Avalon, California, us
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
AI Engineer, Reality Labs Foundation
META • Los Angeles, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Director AI Engineering & Innovation - Now Hiring!
Henkel • Culver City, CA, United States
[job_card.full_time]
[last_updated.last_updated_30]
Child & Family Therapist (LCSW, LMFT, & LPCC) - Hybrid Role or 100% Remote - Avalon, CA
LifeStance Health • Avalon, CA, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Test Products from Home – $25-$45 / hr + Freebies
OCPA • Avalon, California, us
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
AI Engineer / Entertainment
Motion Recruitment Partners LLC • Santa Monica, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Outsmart • Culver City, CA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Test Specialist
Impulse Space • Redondo Beach, CA, US
[job_card.full_time] +1
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
AI Agent Testing Specialist
VirtualVocations • Long Beach, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Capsule.Video Inc • Los Angeles, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Artificial Intelligence (AI) Technology Instructor - Pool - UCLA Extension
University of California - Los Angeles (UCLA) • Los Angeles, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior AI Systems Architect, Remote / Hybrid
Systems Planning and Analysis, Inc. • El Segundo, CA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Director AI Engineering & Innovation - Urgently Hiring!
Henkel • Culver City, CA, United States
[job_card.full_time]
[last_updated.last_updated_30]