AI Testing SpecialistVirtualVocations • Oakland, California, United States
AI Testing Specialist
VirtualVocations • Oakland, California, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.
Key Responsibilities
Create structured test cases that simulate complex human workflows
Define gold-standard behavior and scoring logic to evaluate agent actions
Analyze agent logs, failure modes, and decision paths
Required Qualifications
Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence
Background in QA, software testing, data analysis, or NLP annotation
Good understanding of test design principles
Comfortable with structured formats like JSON / YAML for scenario description
Basic experience with Python and JS
[job_alerts.create_a_job]
Testing Specialist • Oakland, California, United States
[internal_linking.similar_jobs]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...[show_more]
We're on the hunt for curious, motivated individuals to test and review online money-making opportunities featured on FinanceBuzz.
If you enjoy discovering new platforms and sharing your experience,...[show_more]
Who is Recruiting from Scratch : .Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies.Our team is...[show_more]
Description & Requirements Electronic Arts creates next-level entertainment experiences that inspire players and fans around the world.
Here, everyone is part of the story.Part of a community that ...[show_more]
Logistics is one of the single largest industries in the world.Globally, logistics is an $8-$12 trillion dollar industry and in the US alone, ~$2 trillion, representing ~10% of GDP.A single percent...[show_more]
At Andromeda Robotics, we’re not just imagining the future of human-robot relationships; we’re building it.Abi is the first emotionally intelligent humanoid companion robot, designed to bring care,...[show_more]
We're looking for an AI Engineer to help build the core agent systems that power autonomous financial audits.This is a high-ownership role with responsibility from architecture through deployment.W...[show_more]
Meta's Product Counsel organization provides strategic legal advice and risk mitigation to product, engineering, and business teams across Meta's family of products and services.The organization pa...[show_more]
Elicit is an AI research assistant that uses language models to help researchers figure out what's true and make better decisions, starting with common research tasks like literature review.Elicit ...[show_more]
We’re hiring teammates at the intersection of AI / ML and chip design—people who love building, move fast, and care about doing excellent work.
You’ll work at the boundary between ou...[show_more]
Our client is redefining what it means to feel at home—whether you’re traveling for business, leisure, or something in between.
They’ve built a technology-powered hospitality platform that transform...[show_more]
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their comp...[show_more]
AI Engineer - Bay Area (Onsite).Contract-to-Hire | Immediate Start.AI / ML solutions-specifically with.This role involves end-to-end model development, API integrations, data pipeline design, and col...[show_more]
In this exciting role, you will serve as a Data Performance Engineer in NERSC's Application Performance Group, architecting HPC and AI data services that advance fundamental science.You'll optimize...[show_more]
Snowflake is about empowering enterprises to achieve their full potential - and people too.With a culture that's all in on impact, innovation, and collaboration, Snowflake is the sweet spot for bui...[show_more]
We're looking for an AI Engineer to join our Professional Services team.You'll work directly with enterprise customers to design, build, and optimize production-grade AI agent systems.This role com...[show_more]
Remote M&A Associate - AI Trainer ($50-$60 / hour)
Data Annotation • Berkeley, California
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Get Paid to Test Products at Home – Flexible Hours, Weekly Pay
OCPA • Vallejo, California, us
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
Remote Product Tester - $25-45 per hour
Online Consumer Panels America • Richmond, California, US
[filters.remote]
[job_card.part_time] +1
[last_updated.last_updated_30] • [promoted]
Work-from-Home Tester - Try Online Side Gigs and Give Feedback
Finance Buzz • Richmond, California, US
[filters.remote]
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
AI Product Engineer
Recruiting from Scratch • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Counsel
Electronic Arts Inc. • Redwood City, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Product Engineer
TruckSmarter • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Simulation and Test Engineer (Conversational AI) - US Based
Andromeda Robotics • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Wallman Unlimited Company LLC • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Lead Counsel - AI Product
Meta Platforms, Inc. • Menlo Park, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Elicit • Oakland, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Scientist | AI & Chip Design
Cognichip • Redwood City, CA, US
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
AI Automation Specialist
Jobot • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Solution Consultant - AI Specialist
Anaplan • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Apolis • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
HPC / AI Data Performance Engineer
Lawrence Berkeley National Laboratory • Berkeley, CA, United States
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Senior Product Designer, AI
Snowflake Computing • Menlo Park, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
LangChain, Inc • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]