Talent.com
Mercor
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)Mercor • Whittier, California, US
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Mercor • Whittier, California, US
9 days ago
Salary
$66.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core computer science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of computer science expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Computer Science Domains Covered Accelerator / GPU Kernel Engineering, Formal Methods & Automated Reasoning, Computer Architecture & Accelerators, Distributed Systems, DevOps & Site Reliability, Data Engineering & Databases, Cloud & Infrastructure, OS & Systems Kernel, Machine Learning Engineering, Web & API Development, Embedded Systems Engineering, Computer Graphics & Game Development, Mobile Engineering. Key Responsibilities - Author original computer science questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level CS theory, algorithms, systems design, and / or machine learning - Research publications, industry experience at top tech companies, or competitive programming background is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour) • Whittier, California, US

Similar jobs

Remote Product Tester - Flexible Studies

BuzzTestersAltadena, CA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Part Time Remote Work From Home Administrative Assistant

Remote Work From Home Jobs Near MeMount Wilson, CA, United States
Remote
Part-time

Work From Home Remote Data Entry Part Time - Great Gigs For All, Administrative Assistants, Customer Service Reps, Entry Level, Retail Workers, Amazon Workers, Part Time Workers & MoreLooking f... Show more

 • Promoted

Paid Online Survey Participant - No Experience

Clubshop | USAltadena, California
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Clinical Supervisor- Board Certified Behavior Analyst (BCBA)- Remote

360 Behavioral HealthAltadena, CA, United States
Remote
Full-time

Who are we?360 Behavioral Health provides exceptional care for individuals with autism and developmental delays.With over 30 years of expertise, we are a leading authority in ABA-based behavioral h... Show more

 • Promoted

Visionary Leadership Consultant (High Autonomy | Remote)

FlexUpAltadena, CA, United States
Remote
Full-time

Are you an accomplished leader ready to transition your strategic expertise into a high-impact autonomous consulting roleFlexUp is seeking Visionary Leadership Consultants who are driven by purpose... Show more

 • Promoted

Consumer Insights Analyst

Earn HausValyermo, California, United States
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Senior Data Analyst | HR & Compensation Team (Remote Southern California)

Veritas Search GroupAltadena, CA, United States
Remote
Full-time

This role requires candidates who are currently authorized to work in the U.C2C arrangements are not accepted.While this role is primarily remote, you must live in Southern California due to occasi... Show more

 • Promoted

BSA / AML Investigator, Associate II - Remote

Bank of the WestAltadena, CA, United States
Remote
Full-time

BSA / AML Investigator, Associate II - RemoteDescriptionAt Bank of the West, our people are having a positive impact on the world.We're investing where we feel we can make the most impact, like adv... Show more

 • Promoted

Fraud Analyst

First City Credit UnionAltadena, CA, United States
Full-time

The Fraud Analyst will assume, but not be limited to, the following responsibilities:.Review and investigate fraud alerts in various platforms (Verafin, BioCatch) and escalate issues appropriately.... Show more

 • Promoted

Work From Home Fast & Serious 100% Free - No experience

Clubshop | USAltadena, California
Remote
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

PeopleSoft Technical / Developer, Sr (Remote in CA)

Irvine Tech CorpAltadena, CA, United States
Remote
Full-time

Location :Remote in CaliforniaCompensation :This job is expected to pay about $154,783 - $188,142 per yearNo Visa Sponsorship Available for this roleWhat You'll Do :Provide hands-on technical exper... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USAltadena, California
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Backend Engineer (Multiple Roles, Remote & On-Site)

MLabsAltadena, CA, United States
Remote
Full-time

We're hiring Backend Engineers to join some of the most ambitious startups, including Basis, Conduit AI, Dashly, and Rilla.These teams are building distributed systems, data-heavy products, and rel... Show more

 • Promoted

WORK FROM HOME DATA ENTRY CLERK - ENTRY LEVEL - DAILY / WEEKLY PAY (REMOTE DATA ENTRY)

Direct Apply - Work from HomeAltadena, CA, United States
Remote
Part-time

Part Time Jobs Near Me - Customer Service Care CCR Rep - Part Time - Work from Home Data Entry Clerk - Data Entry Clerk - Remote Work From Home - Entry-Level PositionPlease ensure you read the belo... Show more

 • Promoted

Audit Senior Remote Home Based & Hybrid Work Schedule

HR Talent AllianceAltadena, CA, United States
Remote
Full-time

Audit Senior - Assurance and Advisory Services -Remote - Home Based / Hybrid Schedule AvaialbleWell established highly profitable regional CPA firm seeks an Audit Senior to specialize in exciting d... Show more

 • Promoted

Work from home - Market Research Study

Earn HausMount Wilson, California, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Work From Home

Remote JobsAltadena, CA
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more

 • Promoted

County Meter Reader

Meter ReaderAltadena, CA
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Coding Audit Director (Full-Time, Remote)

GeBBS Healthcare SolutionsAltadena, CA, United States
Remote
Full-time

Coding Audit Director (Full-Time, Remote)2 days ago Be among the first 25 applicantsDescriptionDirector - Internal & External Coding Audits GeBBS Healthcare Solutions (Remote, Full-Time)GeBBS H... Show more

 • Promoted

Audit Senior - Remote - Home Based & Hybrid Work Schedule

Toni GroupAltadena, CA, United States
Remote
Full-time

Audit Senior - Assurance and Advisory Services -Remote - Home Based / Hybrid Schedule AvaialbleWell established, highly profitable regional CPA firm seeks an Audit Senior to specialize in exciting,... Show more