Talent.com
Mercor
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)Mercor • Paramount, California, US
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Mercor • Paramount, California, US
4 days ago
Salary
$66.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core computer science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of computer science expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Computer Science Domains Covered Accelerator / GPU Kernel Engineering, Formal Methods & Automated Reasoning, Computer Architecture & Accelerators, Distributed Systems, DevOps & Site Reliability, Data Engineering & Databases, Cloud & Infrastructure, OS & Systems Kernel, Machine Learning Engineering, Web & API Development, Embedded Systems Engineering, Computer Graphics & Game Development, Mobile Engineering. Key Responsibilities - Author original computer science questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level CS theory, algorithms, systems design, and / or machine learning - Research publications, industry experience at top tech companies, or competitive programming background is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour) • Paramount, California, US

Similar jobs

Part Time Remote Work From Home Administrative Assistant

Remote Work From Home Jobs Near MeMount Wilson, CA, United States
Remote
Part-time

Work From Home Remote Data Entry Part Time - Great Gigs For All, Administrative Assistants, Customer Service Reps, Entry Level, Retail Workers, Amazon Workers, Part Time Workers & MoreLooking f... Show more

 • Promoted

Clinical Supervisor- Board Certified Behavior Analyst (BCBA)- Remote

360 Behavioral HealthAltadena, CA, United States
Remote
Full-time

Who are we?360 Behavioral Health provides exceptional care for individuals with autism and developmental delays.With over 30 years of expertise, we are a leading authority in ABA-based behavioral h... Show more

 • Promoted

Consumer Insights Analyst

Earn HausValyermo, California, United States
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Senior Data Analyst | HR & Compensation Team (Remote Southern California)

Veritas Search GroupAltadena, CA, United States
Remote
Full-time

This role requires candidates who are currently authorized to work in the U.C2C arrangements are not accepted.While this role is primarily remote, you must live in Southern California due to occasi... Show more

 • Promoted

Retail Tax Expert

IntuitAltadena, CA, United States
Full-time

Intuit is seeking highly motivated individuals to join our dynamic team as dedicated year-round TurboTax Retail Experts in one of our TurboTax Retail or Flagship locations across the United States.... Show more

 • Promoted

Tax Professional - TurboTax Store

IntuitAltadena, CA, United States
Full-time

Intuit is seeking highly motivated individuals to join our dynamic team as dedicated year-round TurboTax Retail Experts in one of our TurboTax Retail or Flagship locations across the United States.... Show more

 • Promoted

Experienced Tax Expert In-Store

IntuitMount Wilson, CA, United States
Full-time

Intuit is seeking highly motivated individuals to join our dynamic team as dedicated year-round TurboTax Retail Experts in one of our TurboTax Retail or Flagship locations across the United States.... Show more

 • Promoted

Tax Preparer In-Store

IntuitMount Wilson, CA, United States
Full-time

Intuit is seeking highly motivated individuals to join our dynamic team as dedicated year-round TurboTax Retail Experts in one of our TurboTax Retail or Flagship locations across the United States.... Show more

 • Promoted

Senior Tax Professional In-Store

IntuitMount Wilson, CA, United States
Full-time

Intuit is seeking highly motivated individuals to join our dynamic team as dedicated year-round TurboTax Retail Experts in one of our TurboTax Retail or Flagship locations across the United States.... Show more

 • Promoted

Fraud Analyst

First City Credit UnionAltadena, CA, United States
Full-time

The Fraud Analyst will assume, but not be limited to, the following responsibilities:.Review and investigate fraud alerts in various platforms (Verafin, BioCatch) and escalate issues appropriately.... Show more

 • Promoted

Work From Home Fast & Serious 100% Free - No experience

Clubshop | USAltadena, California
Remote
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Remote Product Tester - Flexible Studies

BuzzTestersAltadena, CA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Senior Tax Expert Retail

IntuitAltadena, CA, United States
Full-time

Intuit is seeking highly motivated individuals to join our dynamic team as dedicated year-round TurboTax Retail Experts in one of our TurboTax Retail or Flagship locations across the United States.... Show more

 • Promoted

Tax Accountant - In-Store

IntuitAltadena, CA, United States
Full-time

Intuit is seeking highly motivated individuals to join our dynamic team as dedicated year-round TurboTax Retail Experts in one of our TurboTax Retail or Flagship locations across the United States.... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USAltadena, California
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Work From Home

Remote JobsAltadena, CA
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more

 • Promoted

Tax Professional Retail

IntuitMount Wilson, CA, United States
Full-time

Intuit is seeking highly motivated individuals to join our dynamic team as dedicated year-round TurboTax Retail Experts in one of our TurboTax Retail or Flagship locations across the United States.... Show more

 • Promoted

Work from home - Market Research Study

Earn HausMount Wilson, California, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

County Meter Reader

Meter ReaderAltadena, CA
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Coding Audit Director (Full-Time, Remote)

GeBBS Healthcare SolutionsAltadena, CA, United States
Remote
Full-time

Coding Audit Director (Full-Time, Remote)2 days ago Be among the first 25 applicantsDescriptionDirector - Internal & External Coding Audits GeBBS Healthcare Solutions (Remote, Full-Time)GeBBS H... Show more