Talent.com
Mercor
Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)Mercor • Pittsburg, California, US
Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)

Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)

Mercor • Pittsburg, California, US
19 days ago
Salary
$50.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of psychology expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Psychology Domains Covered Neuromorphic Engineering, Human Factors and Engineering Psychology, Consumer and Market Psychology, Psychometrics, Digital Health, Psychedelic-assisted Therapy. Key Responsibilities - Author original psychology questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD, PsyD, or doctoral candidate in Psychology or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level psychological theory, research methodology, and empirical literature - Clinical licensure or research publications in psychology is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour) • Pittsburg, California, US

Similar jobs

Psychological Services Specialist

Choice in AgingPleasant Hill, CA, United States
Full-time

About the JobUnder the direction of the Program Director, the Psychological Services Specialist (PSS) provides consultation services to Bedford Center & Mt.Diablo Center staff for at least 6 ho... Show more

 • Promoted

Remote Consumer Research Participant

GL IncVacaville, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Benefits Specialist | Remote

Third Party CSVacaville, CA, United States
Remote
Full-time

Fully Remote Benefits Administration Position.If you're tired of feeling stuck, overlooked, or limited in your current role, this could be the opportunity you've been searching for.We're expanding ... Show more

 • Promoted

Remote Study Participants (Hiring Immediately)

Maxion ResearchVacaville, CA, United States
Remote
Part-time

Join Our Part-Time Research Studies Today!Are you eager to earn extra income from the comfort of your home? We are looking for motivated individuals to participate in paid research studies includin... Show more

 • Promoted

Associate Behavior Specialist/Behavior Technician

MCGREW BEHAVIOR INTERVENTION SERVICES INCVacaville, CA, United States
Full-time +1

McGrew Behavior Services - Join us to Make a Difference! Position Type:Part Time Associate Behavior Specialist/ ABS/ Behavioral Tutor/ ABA Therapist/ Tutor/ Registered Behavior Technician/ RBT Job ... Show more

 • Promoted

Consumer Opinion Research Participant

GL IncSuisun City, California
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncFairfield, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Work – Product Assessments - $25-$45 per hour (No Experience)

Online Consumer Panels AmericaVacaville, California, US
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersSuisun City, CA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Remote Research Panel Participant

GL IncFairfield, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPAFairfield, California, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Psychologist Independent

ConcentraWalnut Creek, CA, United States
Full-time

Psychologist Independent 1099LocationUS-CA-Walnut CreekJob ID361918Pos.CategoryMedical - Concentra Advanced SpecialistPos.TypeContractRecruiter :Full Name:First LastJennifer AndersonOverviewConcent... Show more

 • Promoted

Market Research Participant

GL IncVacaville, California
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaSuisun City, California, US
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Clinical Psychologist

Military Treatment Facilities under DHATravis Afb, CA, United States
Permanent

SummaryAbout the Position: This position is located at Travis Air Force Base, California.Salary negotiation may be available for those candidates who are new to Federal service.A recruitment or rel... Show more

 • Promoted

Online Market Research Participant

GL IncSuisun City, California
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Psychological Assistant - Trauma Track

Kaiser PermanenteFairfield, CA, United States
Part-time

Description:Job Summary:Under the supervision of a licensed Psychologist or board certified Psychiatrist, provides mental health assessment, diagnosis, treatment and crisis intervention services fo... Show more

 • Promoted

Remote Consumer Insights Participant

GL IncFairfield, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Online Consumer Research Participant

GL IncFairfield, California
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Consumer Feedback Participant

GL IncSuisun City, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more