Talent.com
AI Testing Specialist
AI Testing SpecialistVirtualVocations • Littleton, Colorado, United States
AI Testing Specialist

AI Testing Specialist

VirtualVocations • Littleton, Colorado, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.

Key Responsibilities

Create structured test cases that simulate complex human workflows

Define gold-standard behavior and scoring logic to evaluate agent actions

Analyze agent logs, failure modes, and decision paths

Required Qualifications

Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence

Background in QA, software testing, data analysis, or NLP annotation

Good understanding of test design principles

Comfortable with structured formats like JSON / YAML for scenario description

Basic experience with Python and JS

[job_alerts.create_a_job]

Testing Specialist • Littleton, Colorado, United States

[internal_linking.similar_jobs]
Get Paid to Test Products at Home – Flexible Hours, Weekly Pay

Get Paid to Test Products at Home – Flexible Hours, Weekly Pay

OCPA • Lafayette, Colorado, us
[job_card.part_time] +1
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
[last_updated.last_updated_30] • [promoted]
Lunar AI Engineer

Lunar AI Engineer

Blue Origin • Denver, CO, United States
[job_card.permanent]
Applications will be accepted on an ongoing basis until the requisition is closed.At Blue Origin, we envision millions of people living and working in space for the benefit of Earth.We're working t...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Technology Solutions Professional - AI and Automation

Senior Technology Solutions Professional - AI and Automation

Humana • Denver, CO, United States
[job_card.full_time]
Become a part of our caring community and help us put health first.The Senior Technology Solutions Professional devises an effective strategy for executing and delivering on IT business initiatives...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote M&A Associate - AI Trainer ($50-$60 / hour)

Remote M&A Associate - AI Trainer ($50-$60 / hour)

Data Annotation • Broomfield, Colorado
[filters.remote]
[job_card.full_time] +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
[last_updated.last_updated_30] • [promoted]
Travel Cath Lab Tech Job in Castle Pines, CO - $10,631 per Month (2 Years Experience Needed)

Travel Cath Lab Tech Job in Castle Pines, CO - $10,631 per Month (2 Years Experience Needed)

Vetted Health • Castle Pines, CO, United States
[job_card.full_time]
Must have 2+ years of experience.This contract pays approximately $10,631 / month gross.Guaranteed Pay : Never worry about canceled shifts. Premium Overtime : 2x hourly rate for overtime on travel assig...[show_more]
[last_updated.last_updated_1_day] • [promoted]
Work-from-Home Tester - Try Online Side Gigs and Give Feedback

Work-from-Home Tester - Try Online Side Gigs and Give Feedback

Finance Buzz • Castle Rock, Colorado, US
[filters.remote]
[job_card.temporary]
We're on the hunt for curious, motivated individuals to test and review online money-making opportunities featured on FinanceBuzz. If you enjoy discovering new platforms and sharing your experience,...[show_more]
[last_updated.last_updated_30] • [promoted]
Remote Product Tester - $25-45 per hour

Remote Product Tester - $25-45 per hour

Online Consumer Panels America • Thornton, Colorado, US
[filters.remote]
[job_card.part_time] +1
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
[last_updated.last_updated_30] • [promoted]
Data Entry Product Support - No Experience

Data Entry Product Support - No Experience

GLOCPA • Castle Rock, Colorado
[job_card.full_time]
We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.[show_more]
[last_updated.last_updated_30] • [promoted]
AI Testing Specialist

AI Testing Specialist

VirtualVocations • Arvada, Colorado, United States
[job_card.full_time]
A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.Key Responsibilities Create structured test cases that simulate complex human workflows Define gold-standard ...[show_more]
[last_updated.last_updated_30] • [promoted]
Cardiovascular Lab Spec FT Days

Cardiovascular Lab Spec FT Days

AdventHealth Castle Rock • Castle Rock, CO, US
[job_card.full_time]
Joining AdventHealth is about being part of something bigger.It’s about belonging to a community that believes in the wholeness of each person, and serves to uplift others in body, mind and s...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Work from Home

Work from Home

HomeJobFinder • Castle Pines, CO
[filters.remote]
[job_card.full_time]
Remote Opportunity : Link Posting Marketing Rep (No Experience Needed!) Are you self-driven, reliable, and ready to earn from anywhere? We’re looking for motivated individuals to jo...[show_more]
[last_updated.last_updated_30] • [promoted]
Travel Cath Lab Technologist - $3,002 per week

Travel Cath Lab Technologist - $3,002 per week

Host Healthcare • Castle Rock, CO, United States
[job_card.full_time]
Host Healthcare is seeking a travel Cath Lab Technologist for a travel job in Castle Rock, Colorado.Job Description & Requirements. Host Healthcare Job ID #a1fVJ0000074If3YAE.Pay package is based on...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Solutions Engineer

AI Solutions Engineer

SHI GmbH • Denver, CO, United States
[job_card.full_time]
Since 1989, SHI International Corp.We've grown every year since, and today we're proud to be a $16 billion global provider of IT solutions and services. Over 17,000 organizations worldwide rely on S...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Travel Cath Lab Technologist

Travel Cath Lab Technologist

Host Healthcare • Castle Rock, CO, US
[job_card.full_time]
Host Healthcare is seeking a travel Cath Lab Technologist for a travel job in Castle Rock, Colorado.Job Description & Requirements. Pay package is based on 10 hour shifts and 40 hours per week (...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Solutions Engineer

AI Solutions Engineer

Stem • Broomfield, CO, United States
[job_card.full_time]
Driven by human and artificial intelligence - Stem is unlocking energy intelligence.Stem is a global leader reimagining technology to support the energy transition. Turning complexity into clarity, ...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer

AI Engineer

Oracle • Denver, CO, United States
[job_card.full_time]
The Customer Success Services team needs an AI Engineer that can design, develop, configure, evaluate, monitor and optimize generative AI and agent solutions for Oracle applications, as well as dev...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Mercor STEM Expert application via RippleMatch

Mercor STEM Expert application via RippleMatch

Promote Project • Denver, CO, United States
[job_card.full_time]
Mercor uses RippleMatch to find top talent.Mercor is seeking a highly skilled.AI evaluation and technical quality assurance team. In this role, you will analyze, evaluate, and fact-check AI-generate...[show_more]
[last_updated.last_updated_30] • [promoted]
Travel Cath Lab Tech Job in Castle Pines, CO - $11,365 per Month (2 Years Experience Needed)

Travel Cath Lab Tech Job in Castle Pines, CO - $11,365 per Month (2 Years Experience Needed)

Vetted Health • Castle Pines, CO, United States
[job_card.full_time]
Must have 2+ years of experience.This contract pays approximately $11,365 / month gross.Guaranteed Pay : Never worry about canceled shifts. Premium Overtime : 2x hourly rate for overtime on travel assig...[show_more]
[last_updated.last_updated_1_day] • [promoted]