Talent.com
Mercor
Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)Mercor • Pittsfield, Massachusetts, US
Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)

Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)

Mercor • Pittsfield, Massachusetts, US
13 days ago
Salary
$50.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of psychology expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Psychology Domains Covered Neuromorphic Engineering, Human Factors and Engineering Psychology, Consumer and Market Psychology, Psychometrics, Digital Health, Psychedelic-assisted Therapy. Key Responsibilities - Author original psychology questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD, PsyD, or doctoral candidate in Psychology or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level psychological theory, research methodology, and empirical literature - Clinical licensure or research publications in psychology is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour) • Pittsfield, Massachusetts, US

Similar jobs

Recreational Therapist Aide - PT - 24hr - Day - $10K SIGN ON BONUS

Northwell HealthSharon, CT, US
$17.60 hourly
Full-time

Northwell is the largest not-for-profit health system in the Northeast, serving residents of New York and Connecticut with 28 hospitals, more than 1,000 outpatient facilities, 22,000 nurses and ove... Show more

Travel Nurse RN - Labor and Delivery - $3,118 per week

LancesoftSharon, CT, United States
Permanent

LanceSoft is seeking a travel nurse RN Labor and Delivery for a travel nursing job in Sharon, Connecticut.Job Description & Requirements Specialty:Labor and Delivery Discipline:RN Start Date:04... Show more

 • Promoted

Work from home - Market Research Study

Earn HausWilliamstown, Massachusetts, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Travel PT (Physical Therapy) PT (Physical Therapist) in Lee, MA

Medical SolutionsLee, MA, United States
Full-time

A facility in Lee, MA is seeking its next amazing PT (Physical Therapist).Read on if this sounds like your perfect fit!Nurses and allied healthcare professionals are in high demand nationwide, and ... Show more

 • Promoted

School Psych | Williamstown, Massachusetts

Sunbelt StaffingWilliamstown, MA, United States
Full-time

Bachelor's or Master's degree in School Psychology, active School Psychologist license and minimum 1years School Psychologist experience required.Applicants who do not meet these qualifications wil... Show more

 • Promoted

Remote Pre-Authorization Specialist -- Benefits & Appeals

Boston ScientificMill River, MA, United States
Remote
Full-time

A leading medical device company is looking for a Pre-Authorization Specialist II to work remotely, handling insurance approval for endobariatric procedures.The ideal candidate has at least a high ... Show more

 • Promoted

Work From Home

Remote JobsWilliamstown, MA
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more

 • Promoted

Paid Online Survey Participant - No Experience

Clubshop | USWilliamstown, Kansas
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

VP, Business Development (Commercial Auto)Remote Atlanta, Georgia, United States

ReservWilliamstown, MA, United States
Remote
Full-time

VP, Business Development (Commercial Auto)Reserv is an insurtech creating and incubating cutting-edge AI and automation technology to bring efficiency and simplicity to claims.Founded by insurtech ... Show more

 • Promoted

Physical Therapist FT - Day - Sign On Bonus - 20K

Northwell HealthSharon, CT, US
$41.00 hourly
Full-time

Northwell is the largest not-for-profit health system in the Northeast, serving residents of New York and Connecticut with 28 hospitals, more than 1,000 outpatient facilities, 22,000 nurses and ove... Show more

Work From Home

AmazonPownal, VT
Remote
Full-time

Job Title: Work From Home Customer Service Representative.As a Work From Home Customer Service Representative at Amazon, you will be the first point of contact for customers seeking assistance.You ... Show more

 • Promoted

BD Excellence Manager

StrivectorFalls Village, CT, United States
Full-time +1

Strivector Corp is a National Staffing and Recruiting agency established in 2012 and headquartered in Austin, Texas.We are a preferred partner for several Fortune 500 companies nationwide.Strivecto... Show more

 • Promoted

L&D RN

Hexaquest HealthSharon, CT, United States
Full-time

L&D RN - Sharon, CT 06069! Weekly Gross:$3,154.Week Pay Breakdown:W2 Rate:$53.Contract Duration:13 weeks Hours:36/Hrs.Requirements:Min 2 years of experience required within the specialty.Active... Show more

 • Promoted

Remote Music Producer & Sound Architect (Equity) Job at Melotech in Town of Berl

MelotechBerlin, NY, United States
Remote
Full-time

A cutting-edge media company in New York is seeking a Music Creative to own the sound production pipeline and create original songs across genres.The ideal candidate has expert proficiency in DAWs,... Show more

 • Promoted

Customer Success Manager (Americas - Remote)

Hospitable.comLanesboro, MA, United States
Remote
Full-time

Job TitleTLDR; We build software for Airbnbs to rent themselves, with a state-of-the-art product and user experience.We have crafted an Applicant Handbook, which we highly recommend you check out, ... Show more

 • Promoted

Psychiatrist - 30 hours - Hybrid / Remote

Community Health Program IncGreat Barrington, MA, United States
Remote
Full-time +1

ABOUT THE ORGANIZATIONCommunity Health Programs is a network of health centers and caring professionals that provide outstanding primary and preventive care for patients of all ages.What's truly un... Show more

 • Promoted

County Meter Reader

Meter ReaderPownal, VT
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Alumni Engagement Coordinator

Staff & Summer FellowLakeville, CT, United States
Full-time

Responsible for supporting events and programs designed to engage and inform Hotchkiss alumni and constituents about the School today.The Alumni Engagement Coordinator is expected to work collabora... Show more

 • Promoted

Director of Rehab

Powerback RehabWilliamstown, MA, United States
Full-time +1

At Powerback, we're on a mission to improve lives.As the leader in physical, occupational, speech, and respiratory therapies, we help older adults stay active and thrive.With over four decades of t... Show more

 • Promoted

ESPN Social Content Intern, Remote, Spring 2026

ESPNSharon, CT, United States
Remote
Full-time

R sum du poste :About the Role & ProgramWe're looking for interns who thrive in a fast-paced, collaborative environment and have a genuine curiosity for learning.This internship is a 16-week re... Show more