AI Testing SpecialistVirtualVocations • Long Beach, California, United States
AI Testing Specialist
VirtualVocations • Long Beach, California, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.
Key Responsibilities
Create structured test cases that simulate complex human workflows
Define gold-standard behavior and scoring logic to evaluate agent actions
Analyze agent logs, failure modes, and decision paths
Required Qualifications
Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence
Background in QA, software testing, data analysis, or NLP annotation
Good understanding of test design principles
Comfortable with structured formats like JSON / YAML for scenario description
Basic experience with Python and JS
[job_alerts.create_a_job]
Testing Specialist • Long Beach, California, United States
[internal_linking.similar_jobs] A company is looking for a Senior AI Search Specialist to redefine organic search strategies in an AI-first environment.Key Responsibilities Own and scale Answer Engine Optimization (AEO) strateg...[show_more] 
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...[show_more]
RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda.As Research Lead - AI Cyb...[show_more]
Northwood is a modern space infrastructure company focused on connecting space and Earth.Our global ground network ensures that missions ranging from national security, to global connectivity, to d...[show_more] A company is looking for a Compensation, Benefits, and Job Analysis Specialist - AI Trainer (Contract).Key Responsibilities Evaluate AI model outputs related to your field and provide structured ...[show_more] 
WebMD seeks a Senior Clinical Specialist to contribute to our AI content initiatives across HCP and DTC.This role is operational, working with editorial teams (creating reference and news content) ...[show_more]
As an experienced engineer, you know that machine learning is critical to understanding and processing massive datasets.Your ability to conduct statistical analyses on business processes using ML t...[show_more]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
IS Senior Specialist, Data Analytics and AI.The IS Senior Specialist, Data Analytics and AI is the key contributor to our machine learning initiatives, will manage the full development lifecycle, i...[show_more]
Drive the future of quality for the world's most complex devices by building agentic workflows and intelligent frameworks.
In this role, you will architect and develop tools that empower autonomous ...[show_more]
A globally recognized entertainment organization is hiring an AI Engineer to build and scale internal AI agents that enhance productivity across creative, operational, and business teams.This role ...[show_more]
Outsmart is an early-stage startup on a mission to reimagine higher education.We are democratizing access to higher education by creating an entirely new collegiate experience.With $38M in backing ...[show_more]
You will work closely with engineering to improve overall test processes across the company.Fabricate, assemble and test high quality, high reliability propulsion components, combustion devices and...[show_more] A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.Key Responsibilities Create structured test cases that simulate complex human workflows Define gold-standard ...[show_more] 
All Covered, IT Managed Services Division of Konica Minolta Business Solutions, has an exciting opportunity available for a Sr.
Developed and deliver Copilot and AI training sessions to end-users an...[show_more]
Capsule is building the world's most intuitive AI-powered video editing tool, designed for modern teams.We're a Series A startup led by two serial founders who have built and scaled creative platfo...[show_more])
Wednesday, Dec 31, 2025 at 11 : 59pm (Pacific Time).Apply by this date to ensure full consideration by the committee.Tuesday, Jun 30, 2026 at 11 : 59pm (Pacific Time).
Applications will continue to be a...[show_more]
Join a cutting-edge research initiative developing AI systems that protect against digital fraud and deepfakes.We're seeking participants across major North American cities to contribute to this im...[show_more]
Senior AI Search Specialist
VirtualVocations • Long Beach, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Research Lead - AI Cyber Testing & Evaluation
RAND Corporation • Santa Monica, CA, United States
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
Research Lead - AI Cyber Testing & Evaluation
RAND • Santa Monica, CA, United States
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
Development Test Specialist
Northwoodspace • Torrance, CA, United States
[job_card.permanent]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
AI Trainer Specialist
VirtualVocations • Long Beach, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Sr Clinical Specialist, AI Content
Internet Brands • El Segundo, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Booz Allen Hamilton • El Segundo, CA, United States
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]
Remote M&A Associate - AI Trainer ($50-$60 / hour)
Data Annotation • Rancho Palos Verdes, California
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
IS Senior Specialist, Data Analytics and AI
AptarGroup • El Segundo, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer, Reality Labs Foundation
META • Los Angeles, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer / Entertainment
Motion Recruitment Partners LLC • Santa Monica, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Outsmart • Culver City, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Test Specialist
Impulse Space • Redondo Beach, CA, US
[job_card.full_time] +1
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
AI Agent Testing Specialist
VirtualVocations • Long Beach, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Sr. M365 AI Engineer
Konica Minolta Business Solutions • Los Angeles, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
AI Engineer
Capsule.Video Inc • Los Angeles, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Artificial Intelligence (AI) Technology Instructor - Pool - UCLA Extension
University of California - Los Angeles (UCLA) • Los Angeles, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote Video Research Participant $25 / Session Help Build AI Security Tools
Your Personal AI • Los Angeles, CA, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30]