Talent.com
Mercor
Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AIMercor • Oakland, California, US
Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI

Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI

Mercor • Oakland, California, US
13 hours ago
Salary
$60.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview Mercor is running a short, structured evaluation pilot to measure how frontier AI models perform on realistic professional work — and how experienced practitioners judge that work. We are hiring 25 experts across four business domains. Each expert completes one task, then evaluates five model attempts at that same task. This is a one-time study, not ongoing production work. What You'll Do - Sign an NDA before receiving any materials. - Solve one realistic, domain-specific task using the source files provided. - Review five model-generated outputs for that task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales that cite specific parts of the output. - Provide structured feedback on the task itself and on the study design. Time Commitment Up to 13 hours total : 3–10 hours to solve the task, approximately 2 hours to rank and score the five outputs, and approximately 1 hour to provide feedback. Study Conditions - No rubric and no golden answer are provided. Your professional judgment is the measurement. - Use of LLMs or other AI assistants is prohibited at every stage — solving, ranking, scoring, and writing rationales. Domains we are focused on - Admin / Business Operations - Marketing - Human Resources - Accounting Who We're Looking For - 5+ years of hands-on professional experience in one of the four domains above. - Currently or recently practicing, so you can judge the work the way a working professional would. - Able to write a clear, specific, evidence-grounded rationale for a judgment. - Reliable within a short turnaround window. Eligibility Restriction You are not eligible for this pilot if you have worked on Project Alchemy in any capacity — task author, reviewer, world expert, or anyone who has had access to its source world data. Prior exposure to that material would invalidate the study.
Create a job alert for this search

Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI Trainer ($60-$80 per hour) • Oakland, California, US

Similar jobs

Remote Physics Expert (PhD) - $100+ per hour

Turing Orinda, California
Remote
Full-time
Quick Apply

Remote contract for PhDs in Physics, Applied Physics, or related fields.Work on cutting-edge projects with top AI labs while earning $100+/hour, fully remote, with flexible weekly hours.Help fine-t... Show more

 • Promoted

Remote Legal Expert

Turing El Cerrito, California
Remote
Full-time
Quick Apply

Turing invites Legal Experts to join projects that fine-tune AI models like ChatGPT.If you enjoy applying legal reasoning, analyzing complex cases, and providing clear, structured feedback, this is... Show more

 • Promoted

Remote Chemistry Expert (PhD) - $100+ per hour

Turing North Fair Oaks, California
Remote
Full-time
Quick Apply

Remote contract for PhDs in Chemistry, Chemical Engineering, or related fields.Work on cutting-edge projects with top AI labs while earning up to $100+/hour, fully remote, with flexible weekly hour... Show more

 • Promoted

Senior Product Manager - Applied AI

StreamlitMenlo Park, CA, United States
Full-time

Product Manager For Ai Solutions And Services.At Snowflake, we are powering the era of the agentic enterprise.To usher in this new era, we seek AI-native thinkers across every function who are ener... Show more

 • Promoted

Tailored Management is hiring: Remote- Software Engineer - AI Multimedia Generat

Tailored ManagementMenlo Park, CA, United States
Remote
Full-time

Job Title :Software Engineer - AI Multimedia Generation Product EvaluatorLocation :RemoteDuration :4Months (Possibility of Extension)Pay Rate :$70-$74 / hr on W2About the Team :The Multimedia Gener... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersRedwood City, CA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Senior Product Manager - Applied AI

SnowflakeMenlo Park, CA, United States
Full-time

Senior Applied Ai Product Manager At Snowflake.At Snowflake, we are powering the era of the agentic enterprise.To usher in this new era, we seek AI-native thinkers across every function who are ene... Show more

 • Promoted

Engagement Manager - AI Agents

Observe.AIRedwood City, CA, United States
Full-time

Engagement Manager - AI Agents.AI is the AI Agents platform for customer experience, designed to help organizations deliver faster, smarter, and more efficient customer service at scale.The platfor... Show more

 • Promoted

Remote Consumer Insights Participant

GL IncHalf Moon Bay, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Data Science Practitioner - Remote

EXPERISAtherton, CA, United States
Remote
Full-time

Job Title :Data Science PractitionerLocation :Remote - PSTDuration :03MonthsJob DescriptionWe are seeking an experienced Data Science Practitioner to join our team.In this role, you will design, de... Show more

 • Promoted

Remote Consumer Research Participant

GL IncMenlo Park, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Consumer Insights Analyst

Earn HausAtherton, California, United States
Part-time

We're currently seeking motivated individuals to participate in online surveys and paid gaming opportunities for well-known national brands.If you're looking for a flexible way to earn extra cash f... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncRedwood City, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaHalf Moon Bay, California, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Conversational AI Designer (Associate)

The Rundown AI, Inc.Redwood City, CA, United States
Remote
Full-time

A leading AI solutions firm in Redwood City, CA is seeking a Conversation Designer to assist in creating high-quality AI conversation models for contact center agents.This collaborative role involv... Show more

 • Promoted

Manager / Senior Manager, Strategic Alliances Data & AI Platforms

C3 AIRedwood City, CA, United States
Full-time

C3 AI provides excellent benefits, a competitive compensation package and generous equity plan. Show more

 • Promoted

Senior Product Manager - Applied AI

Snowflake ComputingMenlo Park, CA, United States
Full-time

Snowflake is about empowering enterprises to achieve their full potential - and people too.With a culture that's all in on impact, innovation, and collaboration, Snowflake is the sweet spot for bui... Show more

 • Promoted

Remote AI Engineer & Machine Learning Researcher (Inference) - Speechify Inc. Speechify Inc #1 [...]

WorkinvirtualRedwood City, CA, United States
Remote
Full-time

About SpeechifySpeechify is one of the world's leadingAI-powered text-to-speech platforms , helping over50 million userstransform reading into listening.From PDFs, eBooks, Google Docs, and news art... Show more

 • Promoted

Remote Mathematics Expert (PhD) - $100+ per hour

Turing North Fair Oaks, California
Remote
Full-time
Quick Apply

Remote contract for PhDs in Mathematics, Statistics, or related fields.Work on cutting-edge projects with top AI labs while earning $100+/hour, fully remote, with flexible weekly hours.Help fine-tu... Show more

 • Promoted

Director of Brand Strategy and AI Innovation

SnowflakeMenlo Park, CA, United States
Full-time

Director of Brand Strategy and AI Innovation.At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done.We seek AI-native thinkers across every ... Show more