Talent.com
Mercor
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)Mercor • Newport News, Virginia, US
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Mercor • Newport News, Virginia, US
7 days ago
Salary
$66.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core computer science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of computer science expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Computer Science Domains Covered Accelerator / GPU Kernel Engineering, Formal Methods & Automated Reasoning, Computer Architecture & Accelerators, Distributed Systems, DevOps & Site Reliability, Data Engineering & Databases, Cloud & Infrastructure, OS & Systems Kernel, Machine Learning Engineering, Web & API Development, Embedded Systems Engineering, Computer Graphics & Game Development, Mobile Engineering. Key Responsibilities - Author original computer science questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level CS theory, algorithms, systems design, and / or machine learning - Research publications, industry experience at top tech companies, or competitive programming background is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour) • Newport News, Virginia, US

Similar jobs

Future Opening: Sales - Nationwide Remote

Container OneGloucester Point, VA, United States
Remote
Full-time

Sales RepresentativeContainer One is a leading provider of shipping containers, shipping container accessories, and portable storage containers.We specialize in offering a comprehensive range of co... Show more

 • Promoted

Family Medicine Physician

CompHealthNorth, Virginia, US
Full-time

Family Medicine physician job in Virginia : Though your CompHealth recruiter will be your single point of contact, they are backed by dozens of specialized teams, giving them the ability to focus o... Show more

Remote Product Tester - Flexible Studies

BuzzTestersPort Haywood, VA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaGloucester Point, Virginia, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Gloucester Point, Virginia
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Board Certified Behavior Analyst (BCBA) - Remote

Kinfolk ABAJames Store, VA, United States
Remote
Full-time +1

Opportunity for Board Certified Behavior Analyst (BCBA)!Kinfolk ABA is looking for an experienced Board Certified Behavior Analyst (BCBA) to join our team! We are a passionate ABA company dedicated... Show more

 • Promoted

Private Soccer Coach

Dribbler LLCSeaford, Virginia, United States
Full-time
Quick Apply

Join Dribbler Soccer: Transform Your Passion for Soccer Into a Rewarding Career!.Dribbler Soccer is a leading name in private soccer training across the United States.We’re expanding our team and l... Show more

Work-From-Home Product Beta Tester - $45 per hour

Great LionGloucester Point, Virginia
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USGloucester Point, Virginia
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

DATA ENTRY CLERK - WORK AT HOME REMOTE - CUSTOMER SERVICE REPRESENTATIVE

Data Entry TapMathews, VA, United States
Remote
Full-time +1

Remote Data Entry Clerk Role / Part Time Full Time Work From Home - Remote Work From Home Jobs - Part Time Data Entry / Customer Service WFHEarn $30 to $300 daily.Read job posting below for full de... Show more

 • Promoted

Remote Online Product Support - No Experience

GLOCPAGloucester Point, Virginia
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

County Meter Reader

Meter ReaderPort Haywood, VA
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Accounts Receivable Specialist I - Remote

SentaraMathews, VA, United States
Remote
Full-time

City / StateNorfolk, VAWork ShiftMultiple shifts availableOverview :Accounts Receivable Spec IManaging accounts receivable accounts (Reference Lab) , ensuring accurate billing and timely collection... Show more

 • Promoted

Drive with Lyft - Signing up is Easy

LyftBohannon, VA, United States
Full-time +1

Get a maximum of $400 in bonuses in Virginia Beach.Earn $100 for every 10 rides in 7 days (limit 4).Lyft is a flexible earning opportunity and a platform that connects drivers with individuals that... Show more

 • Promoted

Manager in Training (MIT)(06045) - George Washington Memorial Hwy

Domino's Pizza LLCGloucester Point, VA, United States
Full-time

Company DescriptionJob DescriptionOur MIT (Manager in Training) program is for all of our team leaders in the store.This can range from anyone finishing up school and ready to start in management, ... Show more

 • Promoted

Work From Home

Remote JobsPort Haywood, VA
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more