Remote Data Scientist - AI Trainer ($100-$120 per hour)Mercor • Shoreline, Washington, US
Remote Data Scientist - AI Trainer ($100-$120 per hour)
Mercor • Shoreline, Washington, US
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
- [filters.remote]
[job_card.job_description]
# Job Description : AI Task Evaluation & Statistical Analysis Specialist
## Role Overview We're seeking a data-driven analyst to conduct comprehensive failure analysis on AI agent performance across finance-sector tasks. You'll identify patterns, root causes, and systemic issues in our evaluation framework by analyzing task performance across multiple dimensions (task types, file types, criteria, etc.). ## Key Responsibilities -
- Statistical Failure Analysis
- : Identify patterns in AI agent failures across task components (prompts, rubrics, templates, file types, tags) -
- Root Cause Analysis
- : Determine whether failures stem from task design, rubric clarity, file complexity, or agent limitations -
- Dimension Analysis
- : Analyze performance variations across finance sub-domains, file types, and task categories -
- Reporting & Visualization
- : Create dashboards and reports highlighting failure clusters, edge cases, and improvement opportunities -
- Quality Framework
- : Recommend improvements to task design, rubric structure, and evaluation criteria based on statistical findings -
- Stakeholder Communication
- : Present insights to data labeling experts and technical teams ## Required Qualifications -
- Statistical Expertise
- : Strong foundation in statistical analysis, hypothesis testing, and pattern recognition -
- Programming
- : Proficiency in Python (pandas, scipy, matplotlib / seaborn) or R for data analysis -
- Data Analysis
- : Experience with exploratory data analysis and creating actionable insights from complex datasets -
- AI / ML Familiarity
- : Understanding of LLM evaluation methods and quality metrics -
- Tools
- : Comfortable working with Excel, data visualization tools (Tableau / Looker), and SQL ## Preferred Qualifications - Experience with AI / ML model evaluation or quality assurance - Background in finance or willingness to learn finance domain concepts - Experience with multi-dimensional failure analysis - Familiarity with benchmark datasets and evaluation frameworks - 2-4 years of relevant experience
[job_alerts.create_a_job]
Data Scientist Remote • Shoreline, Washington, US
[internal_linking.similar_jobs]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] 
A leading technology firm is seeking a Principal Data and AI Scientist to architect and deploy advanced models for personalized customer experiences.
This fully remote role involves building data pi...[show_more]
Primary Skills : Deep Learning (Expert); Machine Learning (Expert), LLM(Expert), AI (Advance), Data Manipulation(Proficient), Model Development-(Proficient).
Duration : 12 Months with possible extensi...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] 
Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime.
At Pinterest, we're on a mission to br...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] 
At Braze, we have found our people.We’re a genuinely approachable, exceptionally kind, and intensely passionate crew.We seek to ignite that passion by setting high standards, championing teamwork, ...[show_more] UK / Canada / Europe / Singapore / Dubai / Australia-based • •Investment Banking or Private Equity Experts • • for a research project with a leading foundational model AI lab.
You are a good fit if you : - Have •...[show_more] Primary Skills : Machine Learning (Expert), Generative AI( Proficient), Statistical Modeling, Python (Expert), SQL (Expert), (Intermediate), PyTorch ((Intermediate).
Duration : 9 months with possible ...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more] At Braze, we have found our people.We’re a genuinely approachable, exceptionally kind, and intensely passionate crew.We seek to ignite that passion by setting high standards, championing teamwork, ...[show_more] 
Our Technology Team partners with teams across Expedia Group to create innovative products, services, and tools to deliver high-quality experiences for travelers, partners, and our employees.A sing...[show_more]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
A leading AI research organization is seeking a skilled Data Scientist to enhance their data-driven culture and contribute to building safe AI systems.
This role requires experience in data analysis...[show_more]
Discovery, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly.Discovery… the stuff dreams are...[show_more] Primary Skills : Machine Learning (Expert), Generative AI( Proficient), Statistical Modeling, Python (Expert), SQL (Expert), (Intermediate), PyTorch ((Intermediate).
Duration : 9 months with possible ...[show_more] We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
Remote Financial Advising Expert - AI Trainer ($50-$60 / hour)
Data Annotation • Marysville, Washington
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Remote Sales & Trading Associate - AI Trainer ($50-$60 / hour)
Data Annotation • Everett, Washington
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Lead Data Scientist, AI & ML Architect (Remote)
LHH • Seattle, Washington, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Applied Scientist IV : 25-04131 (No C2C)
Akraya Inc • Bellevue, Washington, United States
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)
Data Annotation • Everett, Washington
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Staff Data Scientist, Marketing Science
Pinterest • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote FP&A Manager – AI Trainer ($50-$60 / hour)
Data Annotation • Kirkland, Washington
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Senior Forward-Deployed Data Scientist, AI Deployment
Braze • Seattle, Washington, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Financial Expert - AI Trainer ($150 per hour)
Mercor • Auburn, Washington, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Applied Scientist : 25-04992
Akraya Inc • Bellevue, Washington, United States
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Remote M&A Associate - AI Trainer ($50-$60 / hour)
Data Annotation • Shoreline, Washington
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Forward-Deployed Data Scientist, AI Deployment
Braze • Seattle, Washington, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Job Description Senior Machine Learning Scientist- Search, Recommendations, & AI Engineering (Seattle)
Expedia Group • Seattle, WA, US
[job_card.part_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Investment Analyst - AI Trainer ($50-$60 / hour)
Data Annotation • Federal Way, WA, United States
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]
Safeguards Data Scientist — AI Safety & Metrics (Remote)
Anthropic • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Director, Data Science & Applied AI
Warner Bros. Discovery • Bellevue, Washington, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Applied Scientist : 25-04992 (No C2C)
Akraya Inc • Bellevue, Washington, United States
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Remote Investment Analyst – AI Trainer ($50-$60 / hour)
Data Annotation • Federal Way, Washington
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]