AI Testing SpecialistVirtualVocations • Littleton, Colorado, United States
AI Testing Specialist
VirtualVocations • Littleton, Colorado, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.
Key Responsibilities
Create structured test cases that simulate complex human workflows
Define gold-standard behavior and scoring logic to evaluate agent actions
Analyze agent logs, failure modes, and decision paths
Required Qualifications
Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence
Background in QA, software testing, data analysis, or NLP annotation
Good understanding of test design principles
Comfortable with structured formats like JSON / YAML for scenario description
Basic experience with Python and JS
[job_alerts.create_a_job]
Testing Specialist • Littleton, Colorado, United States
[internal_linking.similar_jobs]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
Applications will be accepted on an ongoing basis until the requisition is closed.At Blue Origin, we envision millions of people living and working in space for the benefit of Earth.We're working t...[show_more]
Must have 2+ years of experience.This contract pays approximately $10,631 / month gross.Guaranteed Pay : Never worry about canceled shifts.
Premium Overtime : 2x hourly rate for overtime on travel assig...[show_more]
We're on the hunt for curious, motivated individuals to test and review online money-making opportunities featured on FinanceBuzz.
If you enjoy discovering new platforms and sharing your experience,...[show_more]
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.
You will help influence brand decisions on se...[show_more]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
Joining AdventHealth is about being part of something bigger.It’s about belonging to a community that believes in the wholeness of each person, and serves to uplift others in body, mind and s...[show_more]
We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.[show_more]
Remote Opportunity : Link Posting Marketing Rep (No Experience Needed!) Are you self-driven, reliable, and ready to earn from anywhere? We’re looking for motivated individuals to jo...[show_more]
Recruitment Incentive : Applicants may be eligible for a $40,000 recruitment incentive in accordance with regulatory requirements.
Click apply for complete details on the recruitment incentive detail...[show_more]
Host Healthcare is seeking a travel Cath Lab Technologist for a travel job in Castle Rock, Colorado.Job Description & Requirements.
Host Healthcare Job ID #a1fVJ0000074If3YAE.Pay package is based on...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] 
Driven by human and artificial intelligence - Stem is unlocking energy intelligence.Stem is a global leader reimagining technology to support the energy transition.
Turning complexity into clarity, ...[show_more])
We want you to help us shape the future of shopping experiences and deliver on our purpose of connecting people with the products and experiences that enrich their lives.
Joining Advantage Solutions...[show_more]
Mercor uses RippleMatch to find top talent.Mercor is seeking a highly skilled.AI evaluation and technical quality assurance team.
In this role, you will analyze, evaluate, and fact-check AI-generate...[show_more] Must have 2+ years of experience.This contract pays approximately $11,365 / month gross.Guaranteed Pay : Never worry about canceled shifts.
Premium Overtime : 2x hourly rate for overtime on travel assig...[show_more] 
We are seeking a highly skilled and forward-thinking AI Data Architect to play a pivotal role in shaping our data-driven initiatives within the public sector.
This role demands a deep understanding ...[show_more]
Get Paid to Test Products at Home – Flexible Hours, Weekly Pay
OCPA • Castle Rock, Colorado, us
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
Lunar AI Engineer
Blue Origin • Denver, CO, United States
[job_card.permanent]
[last_updated.last_updated_30] • [promoted]
Travel Cath Lab Tech Job in Castle Pines, CO - $10,631 per Month (2 Years Experience Needed)
Vetted Health • Castle Pines, CO, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Work-from-Home Tester - Try Online Side Gigs and Give Feedback
Finance Buzz • Castle Rock, Colorado, US
[filters.remote]
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
Survey Taker : Earn up to $25 per survey (Remote)
Earn Haus • Roxborough Park, CO, US
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_1_hour] • [promoted] • [new]
Remote Product Tester - $25-45 per hour
Online Consumer Panels America • Thornton, Colorado, US
[filters.remote]
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
Remote Financial Advising Expert - AI Trainer ($50-$60 / hour)
Data Annotation • Castle Rock, Colorado
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Cardiovascular Lab Spec FT Days
AdventHealth Castle Rock • Castle Rock, CO, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Entry Product Support - No Experience
GLOCPA • Castle Pines, Colorado
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Work from Home
HomeJobFinder • Castle Pines, CO
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Special Agent, $40,000 Recruitment Incentive
The United States Secret Service • Castle Rock, CO, US
[job_card.full_time]
[last_updated.last_updated_1_hour] • [promoted] • [new]
Travel Cath Lab Technologist - $3,002 per week
Host Healthcare • Castle Rock, CO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote M&A Associate - AI Trainer ($50-$60 / hour)
Data Annotation • Castle Rock, Colorado
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
AI Solutions Engineer
Stem • Broomfield, CO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Part Time Product Demonstrator in Costco
CDS (Club Demonstration Services) • Castle Rock, CO, US
[job_card.part_time]
[last_updated.last_updated_variable_days] • [promoted]
Mercor STEM Expert application via RippleMatch
Promote Project • Denver, CO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Travel Cath Lab Tech Job in Castle Pines, CO - $11,365 per Month (2 Years Experience Needed)
Vetted Health • Castle Pines, CO, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Artificial Intelligence Architect
Talent Software Services • Denver, CO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]