Talent.com
Mercor
Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AIMercor • Gresham, Oregon, US
No longer accepting applications
Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI

Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI

Mercor • Gresham, Oregon, US
9 days ago
Salary
$60.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview Mercor is running a short, structured evaluation pilot to measure how frontier AI models perform on realistic professional work — and how experienced practitioners judge that work. We are hiring 25 experts across four business domains. Each expert completes one task, then evaluates five model attempts at that same task. This is a one-time study, not ongoing production work. What You'll Do - Sign an NDA before receiving any materials. - Solve one realistic, domain-specific task using the source files provided. - Review five model-generated outputs for that task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales that cite specific parts of the output. - Provide structured feedback on the task itself and on the study design. Time Commitment Up to 13 hours total : 3–10 hours to solve the task, approximately 2 hours to rank and score the five outputs, and approximately 1 hour to provide feedback. Study Conditions - No rubric and no golden answer are provided. Your professional judgment is the measurement. - Use of LLMs or other AI assistants is prohibited at every stage — solving, ranking, scoring, and writing rationales. Domains we are focused on - Admin / Business Operations - Marketing - Human Resources - Accounting Who We're Looking For - 5+ years of hands-on professional experience in one of the four domains above. - Currently or recently practicing, so you can judge the work the way a working professional would. - Able to write a clear, specific, evidence-grounded rationale for a judgment. - Reliable within a short turnaround window. Eligibility Restriction You are not eligible for this pilot if you have worked on Project Alchemy in any capacity — task author, reviewer, world expert, or anyone who has had access to its source world data. Prior exposure to that material would invalidate the study.
Create a job alert for this search

Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI Trainer ($60-$80 per hour) • Gresham, Oregon, US

Similar jobs

Remote Manager in Training- CS/Sales

Global EliteGresham, OR, United States
Remote
Full-time

Remote Manager In Training - CS/Sales.Join Our Team as a Sales Manager - Work from Anywhere!.Are you an experienced and motivated individual looking to elevate your career in customer service and s... Show more

 • Promoted

flex driver

AmazonAmboy, WA
Full-time +1

Amazon needs you as a flex driver Representative (Work From Home) to help their mission of making customers lives easier.If you are looking for outstanding pay, flexible part-time, full-time and se... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersGresham, OR
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Consumer Insights Analyst

Earn HausEagle Creek, Oregon, United States
Part-time

We're currently seeking motivated individuals to participate in online surveys and paid gaming opportunities for well-known national brands.If you're looking for a flexible way to earn extra cash f... Show more

 • Promoted

Private Client Advisor

KeyCorpEstacada, OR, United States
Full-time

Location: 271 SW Broadway, Estacada Oregon.Job Summary: The Private Client Advisor's focus will be on our Mass Affluent client base with planning and financial wellness as the basis of their method... Show more

 • Promoted

Work from home - Market Research Study

Earn HausWashougal, Washington, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Web Designer Mexico - Remote

MotiveBoring, OR, United States
Remote
Full-time

OverviewMotive empowers the people who run physical operations with tools to make their work safer, more productive, and more profitable.For the first time ever, safety, operations and finance team... Show more

 • Promoted

Physical Therapist Assistant - $5,000 Sign On

Select Medical HoldingsSandy, OR, United States
Full-time

Our outpatient orthopedic clinic in Sandy, OR is looking for a highly motivated Licensed Physical Therapy Assistant to join our dynamic team.Our clinic sees a variety of patients including acute, c... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USSandy, Oregon
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Remote Benefits Advisor (50k-90k per year)

Professional CareersSandy, Oregon
$50,000.00 yearly
Remote
Full-time +1

We're looking for candidates with great customer service skills to fill our Remote Customer Service role!.This role is entirely remote and offers full-time/Part time hours with flexibility.We are r... Show more

Managers in Training (Virtual/ Work from home)

Global EliteGresham, OR, United States
Remote
Full-time

Managers In Training (Virtual/ Work From Home).With our company growing faster than ever, we are looking for individuals with amazing people skills to join our 100% remote team.We want everyone who... Show more

 • Promoted

Crypto Quantitative Analyst (Hanoi-Remote)

Token MetricsBoring, OR, United States
Remote
Full-time

Token Metrics provides AI-based cryptocurrency ratings and price predictions.Our customers leverage our professional analysts, analytics, and artificial intelligence to make profitable crypto inves... Show more

 • Promoted

Performance Marketing Specialist [REMOTE - US]

THEOYacolt, WA, United States
Remote
Full-time

Performance Marketing Specialist REMOTE - US Join to apply for thePerformance Marketing Specialist REMOTE - US role atTheoPlease note :We are unable to hire in California and New York at this time.... Show more

 • Promoted

Work From Home

Remote JobsBoring, OR
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more

 • Promoted

County Meter Reader

Meter ReaderSandy, OR
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Work From Home

AmazonAmboy, WA
Remote
Full-time

Job Title: Work From Home Customer Service Representative.As a Work From Home Customer Service Representative at Amazon, you will be the first point of contact for customers seeking assistance.You ... Show more

 • Promoted

Clinical Research Associate ll Oncology (Remote Oregon)

AbbVieSandy, OR, United States
Remote
Full-time

The CRA II advances AbbVies pipeline by striving for excellence in clinical research turning science into medicine for patients and leveraging advanced capabilities to drive industry-leading perfor... Show more

 • Promoted

Data Entry Clerk Administrative Assistant / Customer Service Representative / Remote Work From Home

Entry Level - Quick Start - RemoteYacolt, WA, United States
Remote
Part-time

REMOTE WORK AT HOME - DATA ENTRY / CUSTOMER SERVICE PART TIME / ENTRY LEVEL / PART TIME / REMOTEHello - we appreciate your interest! You're here because you want to get paid - dive into the pool of... Show more

 • Promoted

Blockchain Engineer (Ho Chi Minh-Remote)

Token MetricsWashougal, WA, United States
Remote
Full-time

Token Metrics is seeking a multi-talented Smart Contract Engineer to facilitate the operations of our Engineering team.As a Smart Contract Engineer, you will closely collaborate with fellow enginee... Show more

 • Promoted

HR Generalist

Dc Building GroupDamascus, OR, United States
Full-time

DC is seeking a highly organized and experienced HR Generalist to support and execute core people and culture functions across multiple affiliated companies.This role plays a critical part in manag... Show more