AI Testing SpecialistVirtualVocations • Fort Lauderdale, Florida, United States
AI Testing Specialist
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.
Key Responsibilities
Create structured test cases that simulate complex human workflows
Define gold-standard behavior and scoring logic to evaluate agent actions
Analyze agent logs, failure modes, and decision paths
Required Qualifications
Bachelor's and / or Master's Degree in relevant fields such as Computer Science, Software Engineering, or Artificial Intelligence
Background in QA, software testing, data analysis, or NLP annotation
Good understanding of test design principles
Comfortable with structured formats like JSON / YAML for scenario description
Basic experience with Python and JS
[job_alerts.create_a_job]
Testing Specialist • Fort Lauderdale, Florida, United States
[internal_linking.similar_jobs] A company is looking for an AI Content Specialist responsible for producing high-volume, high-quality content across various media using advanced AI tools.
Key Responsibilities Generate content us...[show_more] A company is looking for a Senior AI Consultant Engineer to develop AI agents and solutions.Key Responsibilities Translate business needs into technical requirements and build implementation plan...[show_more] 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] A company is looking for a Senior Engineer, AI Developer Tools, to shape the vision, design, and rollout of next-generation AI-driven developer tools.
Key Responsibilities Drive AI-powered refacto...[show_more] A company is looking for an AI Agents Strategist to drive customer adoption and revenue growth in the retail and e-commerce sector.
Key Responsibilities Own onboarding and activation for AI Agent ...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] A company is looking for an AI Automations Engineer-LATAM.Key Responsibilities Design, develop, and deploy automation workflows to enhance operational efficiency Utilize AI and modern automation...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] 
In this hourly, remote contractor role, you will review AI-generated medical responses and / or generate expert healthcare content, evaluating reasoning quality and step-by-step clinical problem-solv...[show_more] A company is looking for an Evaluation Scenario Writer - AI Agent Testing Specialist.Key Responsibilities Create structured test cases that simulate complex human workflows Define gold-standard ...[show_more] In this hourly, remote contractor role, you will review AI-generated finance analyses and / or generate expert finance content, evaluating reasoning quality and step-by-step problem-solving while pro...[show_more] A company is looking for a Senior AI Search Specialist to redefine organic search strategies in an AI-first environment.Key Responsibilities Own and scale Answer Engine Optimization (AEO) strateg...[show_more] A company is looking for a Remote AI Data Integration Specialist.Key Responsibilities Evaluate existing data sources and perform gap analysis for AI / ML applications Implement data governance sta...[show_more] A company is looking for a Sr AI Solutions Analyst II to support the discovery, design, and adoption of AI solutions across the business.
Key Responsibilities Partner with business units to identi...[show_more] A company is looking for an AI Quality Lead to oversee the AI Quality program.Key Responsibilities Design and implement the AI Quality strategy and standard operating procedures Define success m...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] A company is looking for a Compensation, Benefits, and Job Analysis Specialist - AI Trainer (Contract).Key Responsibilities Evaluate AI model outputs related to your field and provide structured ...[show_more]
AI Content Specialist
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior AI Consultant Engineer
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Accounting Expert - AI Trainer ($50-$60 / hour)
Data Annotation • Fort Lauderdale, Florida
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]
Senior Engineer, AI Developer Tools
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
AI Agents Strategist
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote M&A Associate - AI Trainer ($50-$60 / hour)
Data Annotation • North Miami Beach, Florida
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Remote Financial Advising Expert - AI Trainer ($50-$60 / hour)
Data Annotation • North Miami Beach, Florida
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
AI Automation Engineer
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote FP&A Manager – AI Trainer ($50-$60 / hour)
Data Annotation • Hallandale Beach, Florida
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Remote Medical General Expert - AI Trainer
SuperAnnotate • North Miami Beach, Florida, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Agent Testing Specialist
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Senior Finance Specialist - AI Trainer
SuperAnnotate • Fort Lauderdale, Florida, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior AI Search Specialist
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Data Integration Specialist
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior AI Solutions Analyst
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Quality Lead
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Remote Investment Analyst – AI Trainer ($50-$60 / hour)
Data Annotation • Hallandale Beach, Florida
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
AI Trainer Specialist
VirtualVocations • Fort Lauderdale, Florida, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]