Talent.com
Mercor
Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)Mercor • Brookfield, Wisconsin, US
Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)

Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)

Mercor • Brookfield, Wisconsin, US
8 days ago
Salary
$50.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of psychology expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Psychology Domains Covered Neuromorphic Engineering, Human Factors and Engineering Psychology, Consumer and Market Psychology, Psychometrics, Digital Health, Psychedelic-assisted Therapy. Key Responsibilities - Author original psychology questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD, PsyD, or doctoral candidate in Psychology or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level psychological theory, research methodology, and empirical literature - Clinical licensure or research publications in psychology is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour) • Brookfield, Wisconsin, US

Similar jobs

Senior Personalization Analytics Analyst (Remote)

Kohl'sMenomonee Falls, WI, United States
Remote
Full-time

Role Specific InformationJob DescriptionThis position can be remote; however, if you reside near our offices in Menomonee Falls, WI, or New York City, NY, we request that you work onsite from Monda... Show more

 • Promoted

Remote Work – Product Assessments - $25-$45 per hour (No Experience)

Online Consumer Panels AmericaSalem Lakes, Wisconsin, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaMount Pleasant, Wisconsin, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Machine Learning/ AI Bioinformatics Analyst III REMOTE

The Fountain GroupPleasant Prairie, WI, United States
Remote
Full-time

REMOTE ROLEPay :$60-$65 / hrTitle :Bioinformatics Machine Learning ScientistREQUIRED :PhD in Computational Science, Computer Science, Data Science, Bioinformatics, Computational Genetics, Biostatis... Show more

 • Promoted

Remote Research Panel Participant

GL IncMount Pleasant, Wisconsin
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Group Audit Specialist (Hybrid or Remote opportunity)

ALG Vacations and Trisept United States OfficesPleasant Prairie, WI, United States
Remote
Full-time

ALG Vacations (ALGV), part of Hyatt, is widely recognized for providing the industry's leading leisure travel experience to destinations worldwide.As North America's leading vertically integrated t... Show more

 • Promoted

Personal Lines Producer (FULLY REMOTE)

The Jonus GroupPleasant Prairie, WI, United States
Remote
Full-time +1

Job DescriptionInbound Personal Lines ProducerJob SummarySeeking a motivated and coachable Inbound Personal Lines Producer to join a dynamic and growth-oriented team.This role can be either part-ti... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersGrafton, WI
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USCedarburg, Wisconsin
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPARaymond, Wisconsin, us
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Work from home - Market Research Study

Earn HausSturtevant, Wisconsin, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Work From Home - Product Specialist - $45 per hour

GL1Port Washington, Wisconsin
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Sales & Video Brand Ambassador (Freelance | Remote | EN) Job at Created Agency B

CREATED AGENCY BRUSSELSBelgium, WI, United States
Remote
Full-time

Sales & Video Brand Ambassador (Freelance Remote EN)3 weeks ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.CREATED is an integrated communicat... Show more

 • Promoted

Remote Data Science Expert - AI Trainer ($50-$90 per hour)

MercorMilwaukee, WI, United States
Remote
Full-time

Role OverviewMercor is partnering with a leading AI lab to engage independent Data Science Experts for diverse research and development initiatives.These contractors will support data-driven model ... Show more