AI Evaluation AnalystVirtualVocations • Saint Louis, Missouri, United States
AI Evaluation Analyst
VirtualVocations • Saint Louis, Missouri, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an AI Agent Evaluation Analyst (Freelance).
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors (gold standards) for AI agents
Required Qualifications
Excellent analytical thinking with the ability to reason about complex systems
Familiarity with structured data formats, such as JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Exposure to LLMs, prompt engineering, or AI-generated content
[job_alerts.create_a_job]
Ai Analyst • Saint Louis, Missouri, United States
[internal_linking.similar_jobs]
Machine Learning Engineer - Model Evaluations, Public Sector.The Public Sector ML team at Scale deploys advanced AI systems-including LLMs, agentic models, and multimodal pipelines-into mission-cri...[show_more]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
We are seeking a highly motivated and detail-oriented ESG Data Analyst.The ideal candidate will have experience in Environmental, Social, and Governance (ESG), or Environmental Safety and Health (E...[show_more]
A role where you’re not just analyzing data—you’ll reshape the way it’s used, by developing advanced tools, optimizing databases, and creating custom solutions.
This is your chance in developing cut...[show_more]
Data Analyst / Junior Analyst (Remote – Entry-Level).We are seeking a Remote Junior Data Analyst to assist with data review, reporting, and basic analysis to support business decisions.Collec...[show_more]
HHAeXchange is the leading technology platform for home and community-based care.Founded in 2008, HHAeXchange was born out of an idea to create a fully comprehensive end-to-end homecare solution to...[show_more] Advance GEOINT Through AI-Powered Data Science.Here is your chance to join XTS as a GEOINT Data Scientist in support of the National Geospatial-Intelligence Agency (NGA), where you will be essentia...[show_more] 
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
Our client is a leading force in advancing safer, smarter AI technology.Their work has been featured in.They have built a global community of expert contributors and have paid more than.No contract...[show_more]
We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.[show_more]
Functional Analyst - SAP Production Planning (PP).Hybrid (2-3 days per week onsite).Candidates outside this location may work remotely.
The Functional Analyst will play a key role in supporting and ...[show_more] A company is looking for an AI Agent Evaluation Analyst (Freelance).Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, miss...[show_more] 
Remote Opportunity : Link Posting Marketing Rep (No Experience Needed!) Are you self-driven, reliable, and ready to earn from anywhere? We’re looking for motivated individuals to jo...[show_more]
The Prospect Research Analyst is a key member of the Missouri Botanical Garden's Institutional Advancement team, using advanced research and analytical methods to identify, qualify, and rank high-p...[show_more]
What you'll love about this job.The Opportunity to Shape an AI Portfolio from the Ground Up.A Perfect Blend of Hands-On Innovation and Strategic Impact.
Cross-Functional Collaboration that Delivers ...[show_more]
ALL ROADS LEAD TO THIS OPPORTUNITY The journey to Valvoline Instant Oil Change (VIOC) is different for everyone.Our employees are students, recent grads, parents, veterans, career changers—who have...[show_more]
Stifel strives for a culture that puts its clients and associates first : a culture where everyone belongs, everyone is welcome, and everyone contributes to the success of our clients, their careers...[show_more]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
Machine Learning Engineer - Model Evaluations, Public Sector
Scale AI, Inc. • St. Louis, MO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote Investment Analyst - AI Model Trainer
Data Annotation • St Charles, MO, United States
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]
ESG Data Analyst
5 Star Recruitment • St. Louis, Missouri, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Spatial Data Scientist (TS / SCI)
Xcellent Technology Solutions • Arnold, MO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Data Analyst / Junior Analyst (Remote – Entry-Level)
GOLD GATE • St. Louis, Missouri
[filters.remote]
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_variable_days] • [promoted]
Sr. Business Intelligence Data Analyst
Hhaexchange • St. Louis, Missouri, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
GEOINT Data Scientist (TS / SCI)
Xcellent Technology Solutions • Arnold, MO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Test Products from Home – $25-$45 / hr + Freebies
OCPA • Festus, Missouri, us
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
Data Analyst
Quality Talent Group • Alton, Illinois, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Work from Home - Online Product Support (Entry Level)
GLOCPA • Oakville, Missouri
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Systems and Data Analyst
Veterans Sourcing Group LLC • Hazelwood, MO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Evaluation Analyst
VirtualVocations • Florissant, Missouri, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Work from Home
HomeJobFinder • Arnold, MO
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Prospect Research Analyst
Missouri Botanical Garden • St. Louis, MO, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Sr. Analyst, Artificial Intelligence
Energizer Holdings • St Louis, MO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Entry-level Lube Tech / Technician
Valvoline Inc • Columbia, Illinois, US
[job_card.part_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Stifel • St Louis, MO, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Investment Analyst – AI Trainer ($50-$60 / hour)
Data Annotation • Florissant, Missouri
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]