Talent.com
Mercor
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)Mercor • Holyoke, Massachusetts, US
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Mercor • Holyoke, Massachusetts, US
3 days ago
Salary
$66.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core computer science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of computer science expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Computer Science Domains Covered Accelerator / GPU Kernel Engineering, Formal Methods & Automated Reasoning, Computer Architecture & Accelerators, Distributed Systems, DevOps & Site Reliability, Data Engineering & Databases, Cloud & Infrastructure, OS & Systems Kernel, Machine Learning Engineering, Web & API Development, Embedded Systems Engineering, Computer Graphics & Game Development, Mobile Engineering. Key Responsibilities - Author original computer science questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level CS theory, algorithms, systems design, and / or machine learning - Research publications, industry experience at top tech companies, or competitive programming background is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour) • Holyoke, Massachusetts, US

Similar jobs

Senior Therapeutic Area Specialist (TAS), Neuroscience, COBENFY, Springfield, MA

Bristol Myers SquibbSpringfield, MA, United States
Full-time

Job Opportunity: Senior Therapeutic Area Specialist (TAS).Those aren't words that are usually associated with a job.But working at Bristol Myers Squibb is anything but usual.Here, uniquely interest... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncNorthampton, Massachusetts
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersGreenfield, MA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Travel Nurse - RN - MS/TELE - Medical Surgical/Telemetry - $2451 / Week

MedPro Healthcare StaffingGreenfield, MA, US
Full-time

MedPro Healthcare Staffing is seeking an experienced Medical Surgical/Telemetry Registered Nurse for an exciting Travel Nursing job in Greenfield, MA.Shift: 3x12 hr nights Start Date: ASAP Duration... Show more

 • Promoted

Travel Physical Therapy Assistant - $1319.32 / Week

Preferred Healthcare StaffingGreenfield, MA, US
Full-time

Preferred Healthcare Staffing is seeking an experienced Physical Therapy Assistant for an exciting Travel Allied job in Greenfield, MA.Shift: 8 hr days Start Date: ASAP Duration: 13 weeks Pay: $131... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Northampton, Massachusetts
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Biology Expert

Micro1Northampton, Massachusetts, US
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

Earn Side Money at Home Testing Products

Product Review JobsGREENFIELD, MA, United States
Full-time

Compensation: Varies per assignment.Location: Remote (USA) Company: ProductReviewJobs Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market res... Show more

 • Promoted

Travel Physical Therapy Assistant - $1352 / Week

Ventura MedStaffGreenfield, MA, US
Full-time

Ventura MedStaff is seeking an experienced Physical Therapy Assistant for an exciting Travel Allied job in Greenfield, MA.Shift: 5x8 hr days Start Date: ASAP Duration: 13 weeks Pay: $1352 / Week.Fo... Show more

 • Promoted

Remote Work – Product Assessments - $25-$45 per hour (No Experience)

Online Consumer Panels AmericaNorthampton, Massachusetts, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Usage Tester - Work From Home - $45 per hour

GL1Northampton, Massachusetts
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Physics Expert (PhD) - $100+ per hour

Turing Northampton, Massachusetts
Remote
Full-time
Quick Apply

Remote contract for PhDs in Physics, Applied Physics, or related fields.Work on cutting-edge projects with top AI labs while earning $100+/hour, fully remote, with flexible weekly hours.Help fine-t... Show more

 • Promoted

Remote Product Tester – $45/hr + Free Products – Start Now!

OCPADeerfield, Massachusetts, us
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Travel Nurse - RN - MS - Medical Surgical - $1990.19 / Week

Medical SolutionsGreenfield, MA, US
Full-time

Medical Solutions is seeking an experienced Medical Surgical Registered Nurse for an exciting Travel Nursing job in Greenfield, MA.Shift: 12 hr nights Start Date: ASAP Duration: 13 weeks Pay: $1990... Show more

 • Promoted

Remote Chemistry Expert (PhD) - $100+ per hour

Turing Northampton, Massachusetts
Remote
Full-time
Quick Apply

Remote contract for PhDs in Chemistry, Chemical Engineering, or related fields.Work on cutting-edge projects with top AI labs while earning up to $100+/hour, fully remote, with flexible weekly hour... Show more

 • Promoted

Work From Home - Product Specialist - $45 per hour

GL1Holyoke, Massachusetts
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Travel Nurse - RN - MS - Medical Surgical - $1990.19 / Week - Hiring Now

Medical SolutionsGreenfield, MA, US
Full-time

Medical Solutions is seeking an experienced Medical Surgical Registered Nurse for an exciting Travel Nursing job in Greenfield, MA.Shift: 12 hr nights Start Date: ASAP Duration: 13 weeks Pay: $1990... Show more

 • Promoted

Remote Consumer Research Participant

GL IncNorthampton, Massachusetts
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaNorthampton, Massachusetts, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Travel Nurse RN - Obstetrics/Gynecology - $2,373 to $2,631 per week in Greenfield, MA

TravelNurseSourceGreenfield, MA, US
Full-time

Registered Nurse (RN) | Obstetrics/Gynecology.Ready to start your next travel adventure? LRS Healthcare offers a full benefits package, 24/7 support, and a responsive, traveler-first culture.What a... Show more