AI Testing SpecialistVirtualVocations • Littleton, Colorado, United States
AI Testing Specialist
VirtualVocations • Littleton, Colorado, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.
Key Responsibilities
Create structured test cases that simulate complex human workflows
Define gold-standard behavior and scoring logic to evaluate agent actions
Analyze agent logs, failure modes, and decision paths
Required Qualifications
Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence
Background in QA, software testing, data analysis, or NLP annotation
Good understanding of test design principles
Comfortable with structured formats like JSON / YAML for scenario description
Basic experience with Python and JS
[job_alerts.create_a_job]
Testing Specialist • Littleton, Colorado, United States
[internal_linking.similar_jobs]
Insight Global is hiring an AI Engineer to join an AI software development company based in Denver, CO.In this role, you will design, build, and optimize multi-agent systems using LangGraph on GCP....[show_more]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
Applications will be accepted on an ongoing basis until the requisition is closed.At Blue Origin, we envision millions of people living and working in space for the benefit of Earth.We're working t...[show_more]
Sales Professional Opportunity At Nutanix.Hungry, Humble, Honest, with Heart.The Opportunity Are you a driven sales professional with a strong background in generative AI technologies and exception...[show_more]
We're on the hunt for curious, motivated individuals to test and review online money-making opportunities featured on FinanceBuzz.
If you enjoy discovering new platforms and sharing your experience,...[show_more]
Vetted is seeking a Surgical Tech for a travel job in Castle Rock, Colorado.Must have 2+ years of experience.This contract pays approximately $6,627 / month gross.
Assignment details : Contract length : ...[show_more]
Joining AdventHealth is about being part of something bigger.It’s about belonging to a community that believes in the wholeness of each person, and serves to uplift others in body, mind and s...[show_more]
The retail industry continues to see unprecedented dynamics as it pivots to a true omni-channel shopping experience.Informed retailers are succeeding, and RDSolutions is providing them with the con...[show_more]
Take quick online surveys and earn rewards for sharing your thoughts.Join today — it's free and easy!.[show_more]
We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.[show_more]
Remote Opportunity : Link Posting Marketing Rep (No Experience Needed!) Are you self-driven, reliable, and ready to earn from anywhere? We’re looking for motivated individuals to jo...[show_more]
Host Healthcare is seeking a travel Cath Lab Technologist for a travel job in Castle Rock, Colorado.Job Description & Requirements.
Host Healthcare Job ID #a1fVJ0000074If3YAE.Pay package is based on...[show_more]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
Driven by human and artificial intelligence - Stem is unlocking energy intelligence.Stem is a global leader reimagining technology to support the energy transition.
Turning complexity into clarity, ...[show_more] Vetted is seeking a Surgical Tech for a travel job in Castle Rock, Colorado.Must have 2+ years of experience.This contract pays approximately $10,331 / month gross.
Assignment details : Contract length...[show_more] 
Mercor uses RippleMatch to find top talent.Mercor is seeking a highly skilled.AI evaluation and technical quality assurance team.
In this role, you will analyze, evaluate, and fact-check AI-generate...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] 
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
AI Engineer
Insight Global • Denver, CO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Get Paid to Test Products at Home – Flexible Hours, Weekly Pay
OCPA • Castle Rock, Colorado, us
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
Lunar AI Engineer
Blue Origin • Denver, CO, United States
[job_card.permanent]
[last_updated.last_updated_30] • [promoted]
AI Sales Specialist
Denver Staffing • Denver, CO, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Work-from-Home Tester - Try Online Side Gigs and Give Feedback
Finance Buzz • Castle Rock, Colorado, US
[filters.remote]
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
Travel Surgical Tech Job in Castle Rock, CO - $1,529 per Week (2 Years Experience Needed)
Vetted Health • Castle Rock, CO, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Cardiovascular Lab Spec FT Days
AdventHealth Castle Rock • Castle Rock, CO, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Store Scanning Specialist
RDSolutions formerly RetailData • Castle Rock, CO, US
[job_card.part_time]
[last_updated.last_updated_1_day] • [promoted]
Work From Home - Remote Market Research Contributor
Opinion Bureau • Castle Rock, Colorado, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Entry Product Support - No Experience
GLOCPA • Castle Pines, Colorado
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Work from Home
HomeJobFinder • Castle Pines, CO
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Travel Cath Lab Technologist - $3,002 per week
Host Healthcare • Castle Rock, CO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote Accounting Expert - AI Trainer ($50-$60 / hour)
Data Annotation • Thornton, Colorado
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]
AI Solutions Engineer
Stem • Broomfield, CO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Travel Surgical Tech Job in Castle Rock, CO - $2,384 per Week (2 Years Experience Needed)
Vetted Health • Castle Rock, CO, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Mercor STEM Expert application via RippleMatch
Promote Project • Denver, CO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote FP&A Manager – AI Trainer ($50-$60 / hour)
Data Annotation • Thornton, Colorado
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Remote Product Tester - $25-45 per hour
Online Consumer Panels America • Westminster, Colorado, US
[filters.remote]
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]