Talent.com
Mercor
Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AIMercor • Oak Park, Illinois, US
Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI

Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI

Mercor • Oak Park, Illinois, US
5 hours ago
Salary
$60.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview Mercor is running a short, structured evaluation pilot to measure how frontier AI models perform on realistic professional work — and how experienced practitioners judge that work. We are hiring 25 experts across four business domains. Each expert completes one task, then evaluates five model attempts at that same task. This is a one-time study, not ongoing production work. What You'll Do - Sign an NDA before receiving any materials. - Solve one realistic, domain-specific task using the source files provided. - Review five model-generated outputs for that task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales that cite specific parts of the output. - Provide structured feedback on the task itself and on the study design. Time Commitment Up to 13 hours total : 3–10 hours to solve the task, approximately 2 hours to rank and score the five outputs, and approximately 1 hour to provide feedback. Study Conditions - No rubric and no golden answer are provided. Your professional judgment is the measurement. - Use of LLMs or other AI assistants is prohibited at every stage — solving, ranking, scoring, and writing rationales. Domains we are focused on - Admin / Business Operations - Marketing - Human Resources - Accounting Who We're Looking For - 5+ years of hands-on professional experience in one of the four domains above. - Currently or recently practicing, so you can judge the work the way a working professional would. - Able to write a clear, specific, evidence-grounded rationale for a judgment. - Reliable within a short turnaround window. Eligibility Restriction You are not eligible for this pilot if you have worked on Project Alchemy in any capacity — task author, reviewer, world expert, or anyone who has had access to its source world data. Prior exposure to that material would invalidate the study.
Create a job alert for this search

Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI Trainer ($60-$80 per hour) • Oak Park, Illinois, US

Similar jobs

Remote Financial Analyst

Micro1Zion, Illinois, US
Remote
Full-time +1

Investment Strategy & Advisory.Predictive Analytics & Visualization.AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowled... Show more

 • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPAZion, Illinois, us
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Consumer Insights Participant

GL IncZion, Illinois
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Management Consultant

Micro1Highland Park, Illinois, US
$50.00 hourly
Remote
Full-time

Management Consultant / Business Strategy Specialist.AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such ... Show more

 • Promoted

Remote Physics Expert (PhD) - $100+ per hour

Turing Highland Park, Illinois
Remote
Full-time
Quick Apply

Remote contract for PhDs in Physics, Applied Physics, or related fields.Work on cutting-edge projects with top AI labs while earning $100+/hour, fully remote, with flexible weekly hours.Help fine-t... Show more

 • Promoted

IP Law Evaluator - Expert - AI Trainer

MercorChicago, Illinois, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.IP / trademark / copyright law Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, a... Show more

Remote Legal Expert

Turing Highland Park, Illinois
Remote
Full-time
Quick Apply

Turing invites Legal Experts to join projects that fine-tune AI models like ChatGPT.If you enjoy applying legal reasoning, analyzing complex cases, and providing clear, structured feedback, this is... Show more

 • Promoted

Remote Data Scientist

Micro1Zion, Illinois, US
$65.00 hourly
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

Remote Physics Expert

Micro1Zion, Illinois, US
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

Business Strategy Specialist

Micro1Highland Park, Illinois, US
$50.00 hourly
Full-time

Management Consultant / Business Strategy Specialist.AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such ... Show more

 • Promoted

Cloud Infrastructure Expert - AI Trainer

MercorChicago, Illinois, United States
Remote
Full-time +1
Quick Apply

Headquartered in San Francisco, our investors include.Build a realistic digital workspace using.Reflect real-world architecture docs, runbooks, and incident post-mortems.Design multi-step tasks tha... Show more

Remote Macroeconomic Modeling Specialist (EViews)

Micro1Zion, Illinois, US
$35.00 hourly
Remote
Full-time

Macroeconomic Modeling Specialist (EViews).AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncZion, Illinois
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Consumer Research Participant

GL IncHighland Park, Illinois
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaHighland Park, Illinois, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Chemistry Expert (PhD) - $100+ per hour

Turing Highland Park, Illinois
Remote
Full-time
Quick Apply

Remote contract for PhDs in Chemistry, Chemical Engineering, or related fields.Work on cutting-edge projects with top AI labs while earning up to $100+/hour, fully remote, with flexible weekly hour... Show more

 • Promoted

Marketing SME - AI Evaluation (US-Remote)

BraintrustChicago, IL, United States
Remote
Full-time

Job DescriptionWe are seeking multiple Marketing Subject Matter Experts (SME) to train, evaluate, and fine-tune AI models for marketing.You'll bridge marketing strategy and AI systems so models und... Show more

 • Promoted

Remote Mathematics Expert (PhD) - $100+ per hour

Turing Highland Park, Illinois
Remote
Full-time
Quick Apply

Remote contract for PhDs in Mathematics, Statistics, or related fields.Work on cutting-edge projects with top AI labs while earning $100+/hour, fully remote, with flexible weekly hours.Help fine-tu... Show more

 • Promoted

Remote Biology Expert

Micro1Zion, Illinois, US
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersZion, IL
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more