AI Evaluation AnalystVirtualVocations • Ontario, California, United States
AI Evaluation Analyst
VirtualVocations • Ontario, California, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an AI Agent Evaluation Analyst (Freelance).
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking with the ability to reason about complex systems
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Exposure to LLMs, prompt engineering, or AI-generated content
[job_alerts.create_a_job]
Ai Analyst • Ontario, California, United States
[internal_linking.similar_jobs]
TransGrid Energy is a renewable energy company focused on investing, developing, owning and operating utility-scale battery energy storage systems and PV projects.
TransGrid has a robust pipeline of...[show_more]
Our client is a leading force in advancing safer, smarter AI technology.Their work has been featured in.They have built a global community of expert contributors and have paid more than.No contract...[show_more]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
Behavioral Health Clinician / Therapist - Per Diem - Hybrid in Rancho Cucamonga, CA at Optum summary : .The Behavioral Health Clinician / Therapist at Gunn Psychological provides critical mental health ...[show_more]
Receive a $5 welcome bonus when you complete your first offer!Make money in your spare time by completing online tasks : .
Take paid surveys (5-15 minutes each).Test new mobile games and apps.Share yo...[show_more]
Data Analyst to join our innovative team.As a Data Analyst, you will be responsible for collecting, processing, and analyzing data to help drive strategic decisions across our operations.Your role ...[show_more]
Your key responsibilities include : .Maintaining accurate patient records and adhering to .Australian dental regulations and best practices.
Flexibility : While we try hard not to change plans, sometim...[show_more]
Thursday, Jan 15, 2026 at 11 : 59pm (Pacific Time).Apply by this date to ensure full consideration by the committee.Tuesday, Jun 30, 2026 at 11 : 59pm (Pacific Time).
Applications will continue to be ac...[show_more]
University of California, Irvine, and the only academic health system based in Orange County.UCI Health is comprised of its main campus,.
UCI Health Community Network in Orange and Los Angeles count...[show_more] A company is looking for a Credit Authorizers, Checkers, and Clerks - AI Trainer (Contract).Key Responsibilities Evaluate AI model outputs based on professional experience in credit-related tasks...[show_more] 
Trace3 is a leading Transformative IT Authority, providing unique technology solutions and consulting services to our clients.
Equipped with elite engineering and dynamic innovation, we empower IT e...[show_more] Association of American Universities and is ranked among the nation's top 10 public universities by U.The campus has produced five Nobel laureates and is known for its academic achievement, premier...[show_more] 
Our client, a Medical Center facility under the aegis of a California Public Ivy university and one of largest health delivery systems in California, seeks an accomplished.EPIC Cadence Applications...[show_more]
We want you to feel comfortable doing great work and bringing your best, authentic self to everything you do.We value your talents, traditions, and uniqueness-and we're committed to fostering a str...[show_more] A company is looking for an AI Agent Evaluation Analyst (Freelance).Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, miss...[show_more] 
AlliedTravelCareers is working with CompHealth to find a qualified Speech Language Pathologist (SLP) in Phelan, California, 92329!.
When it comes to finding the perfect locums assignment, sometimes ...[show_more] A reasonable estimate for this position is $90,200-$141,700.See Table Professional Researchers Series - Represented Fiscal Year.
Friday, Oct 31, 2025 at 11 : 59pm (Pacific Time).Applications received ...[show_more] 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
Energy Data Engineer / Analyst
TRANSGRID ENERGY • Irvine, California, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Analyst
Quality Talent Group • Lake Forest, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Test Products from Home – $25-$45 / hr + Freebies
OCPA • Wrightwood, California, us
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
Behavioral Health Clinician / Therapist - Per Diem - Hybrid in Rancho Cucamonga, CA
Optum • Pinon Hills, CA, USA
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Flexible Online Job - Earn Up to $1,500 / Month Playing Mobile Games
Free Cash by Almedia • Phelan, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Analyst
Jiffy • Irvine, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Dentist - Job Location : Australia or New Zealand - Relocation Bonus
Abano USA • Phelan, CA, USA
[job_card.permanent]
[last_updated.last_updated_30] • [promoted]
Research Specialist - MIni CArbon DAting System (MICADAS)
University of California - Irvine • Irvine, CA, United States
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
Labor Productivity Analyst - Decision Support - FT Days
University of California - Irvine Health • Irvine, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Trainer for Credit Evaluation
VirtualVocations • Ontario, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Lead, Data Analyst- Healthcare
Trace3 • Irvine, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Research Pre-Award Analyst
University of California - Irvine • Irvine, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
EPIC Cadence Analyst (REMOTE / NO C2C)
Amerit Consulting • East Irvine, CA, United States
[filters.remote]
[job_card.permanent]
[last_updated.last_updated_variable_days] • [promoted]
Senior Machine Learning Engineer
Capital Group • Irvine, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
AI Agent Evaluation Analyst
VirtualVocations • Ontario, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Travel Speech Language Pathologist (SLP) - $1,749 to $3,557 per week in Phelan, CA
AlliedTravelCareers • Phelan, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Assistant / Associate Professional Researcher - The Center for Neural Circuit Mapping
University of California - Irvine • Irvine, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote Investment Analyst - AI Model Trainer
Data Annotation • Ontario, CA, United States
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]