AI Testing SpecialistVirtualVocations • Littleton, Colorado, United States
AI Testing Specialist
VirtualVocations • Littleton, Colorado, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.
Key Responsibilities
Create structured test cases that simulate complex human workflows
Define gold-standard behavior and scoring logic to evaluate agent actions
Analyze agent logs, failure modes, and decision paths
Required Qualifications
Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence
Background in QA, software testing, data analysis, or NLP annotation
Good understanding of test design principles
Comfortable with structured formats like JSON / YAML for scenario description
Basic experience with Python and JS
[job_alerts.create_a_job]
Testing Specialist • Littleton, Colorado, United States
[internal_linking.similar_jobs]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
Applications will be accepted on an ongoing basis until the requisition is closed.At Blue Origin, we envision millions of people living and working in space for the benefit of Earth.We're working t...[show_more]
Job Description : Radiology Technologists at Intermountain Health are committed to providing patient centered care while demonstrating our values of Integrity, Trust, Excellence, Accountability, and ...[show_more]
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.
You will help influence brand decisions on se...[show_more]
Administrative Assistant (Remote Position).Part-Time : $18–$24 per hour.Full-Time : $20–$28 per hour.We are seeking a dependable and well-organized Remote Administrative Assistant to supp...[show_more])
UCHealth (Colorado) is seeking a Radiology Technologist for a job in Castle Rock, Colorado.Job Description & Requirements.
Location : UCHealth UCHlth Castle Rock Medical Ctr, US : CO : Castle Rock.Depart...[show_more]
Joining AdventHealth is about being part of something bigger.It’s about belonging to a community that believes in the wholeness of each person, and serves to uplift others in body, mind and s...[show_more]
We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.[show_more]
Host Healthcare is seeking a travel Cath Lab Technologist for a travel job in Castle Rock, Colorado.Job Description & Requirements.
Host Healthcare Job ID #a1fVJ0000074If3YAE.Pay package is based on...[show_more]
Anomali is headquartered in Silicon Valley and is the Leading AI-Powered Security Operations Platform that is modernizing security operations.
At the center of it is an omnipresent, intelligent, and...[show_more]
Judi Health is an enterprise health technology company providing a comprehensive suite of solutions for employers and health plans, including : .
PBM) solutions to self-insured employers,.Enterprise H...[show_more]
Driven by human and artificial intelligence - Stem is unlocking energy intelligence.Stem is a global leader reimagining technology to support the energy transition.
Turning complexity into clarity, ...[show_more]
Mercor uses RippleMatch to find top talent.Mercor is seeking a highly skilled.AI evaluation and technical quality assurance team.
In this role, you will analyze, evaluate, and fact-check AI-generate...[show_more]
Remote Opportunity : Link Posting Marketing Rep (No Experience Needed!) Are you self-driven, reliable, and ready to earn from anywhere? We’re looking for motivated individuals to jo...[show_more])
We want you to help us shape the future of shopping experiences and deliver on our purpose of connecting people with the products and experiences that enrich their lives.
Joining Advantage Solutions...[show_more]
Recruitment Incentive : Applicants may be eligible for a $40,000 recruitment incentive in accordance with regulatory requirements.
Click apply for complete details on the recruitment incentive detail...[show_more]
Must have 2+ years of experience.This contract pays approximately $11,365 / month gross.Guaranteed Pay : Never worry about canceled shifts.
Premium Overtime : 2x hourly rate for overtime on travel assig...[show_more]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
Get Paid to Test Products at Home – Flexible Hours, Weekly Pay
OCPA • Castle Rock, Colorado, us
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
Lunar AI Engineer
Blue Origin • Denver, CO, United States
[job_card.permanent]
[last_updated.last_updated_30] • [promoted]
Radiology Technologist
Intermountain Health • Louviers, Colorado, us
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Survey Taker : Earn up to $25 per survey (Remote)
Earn Haus • Castle Pines, CO, US
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Administrative Assistant (Remote Position)
GOLD GATE • Castle Rock, Colorado
[filters.remote]
[job_card.full_time] +1
[filters_job_card.quick_apply]
[last_updated.last_updated_30] • [promoted]
Radiology Technologist - $28-41 per hour
UCHealth (Colorado) • Castle Rock, CO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Cardiovascular Lab Spec FT Days
AdventHealth Castle Rock • Castle Rock, CO, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Data Entry Product Support - No Experience
GLOCPA • Castle Pines, Colorado
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Travel Cath Lab Technologist - $3,002 per week
Host Healthcare • Castle Rock, CO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Threat Intelligence Solutions Engineer
Anomali • Denver, CO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior AI / ML Applied Scientist
Capital Rx • Denver, CO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Solutions Engineer
Stem • Broomfield, CO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Mercor STEM Expert application via RippleMatch
Promote Project • Denver, CO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Work from Home
HomeJobFinder • Castle Rock, CO
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Part Time Product Demonstrator in Costco
CDS (Club Demonstration Services) • Castle Rock, CO, US
[job_card.part_time]
[last_updated.last_updated_variable_days] • [promoted]
Special Agent, $40,000 Recruitment Incentive
The United States Secret Service • Castle Pines, CO, US
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Travel Cath Lab Tech Job in Castle Pines, CO - $11,365 per Month (2 Years Experience Needed)
Vetted Health • Castle Pines, CO, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Remote Product Tester - $25-45 per hour
Online Consumer Panels America • Westminster, Colorado, US
[filters.remote]
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]