Talent.com
Mercor
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)Mercor • Sioux Falls, South Dakota, US
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Mercor • Sioux Falls, South Dakota, US
15 days ago
Salary
$66.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core computer science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of computer science expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Computer Science Domains Covered Accelerator / GPU Kernel Engineering, Formal Methods & Automated Reasoning, Computer Architecture & Accelerators, Distributed Systems, DevOps & Site Reliability, Data Engineering & Databases, Cloud & Infrastructure, OS & Systems Kernel, Machine Learning Engineering, Web & API Development, Embedded Systems Engineering, Computer Graphics & Game Development, Mobile Engineering. Key Responsibilities - Author original computer science questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level CS theory, algorithms, systems design, and / or machine learning - Research publications, industry experience at top tech companies, or competitive programming background is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour) • Sioux Falls, South Dakota, US

Similar jobs

Behavioral Health Assoc | Men's

Acadia HealthcareCanton, SD, United States
Full-time

Behavioral Health Associate (BHA).As a Behavioral Health Associate, you play a vital role in keeping our patients safe while supporting their recovery every day.You will provide hands on care and c... Show more

 • Promoted

Retail Service Specialist

O'Reilly AutomotiveHarrisburg, SD, United States
Full-time

The Retail Service Specialist will support the Store Manager and Assistant Managers in areas of sales, customer service, store appearance, and store operations.This position will also assume shift ... Show more

 • Promoted

Interventional Radiology Technologist New Grad

Avera HealthCanton, SD, United States
Full-time +1

Location:Avera McKennan HospitalWorker Type:RegularWork Shift:Primarily days with possible weekends/evenings/holidays (United States of America)Pay Range:The pay range for this position is listed b... Show more

 • Promoted

Work From Home

Remote JobsHarrisburg, SD
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more

 • Promoted

Agronomy Operations

360 HeadhunterCanton, SD, United States
Full-time

Strong retail agronomy location south of Sioux Falls is looking for a reliable and dependable team member to join their team! Applicants should have prior agronomy or farm equipment operation exper... Show more

 • Promoted

Paid Online Survey Participant - No Experience

Clubshop | USColman, South Dakota
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Remote Expert Contributor - Mechanical Engineering

Arise Virtual SolutionsSioux Falls, South Dakota
Remote
Full-time

Expert Contributor - Mechanical Engineering.Task-Based Independent Contractor Opportunity.We're looking for Mechanical Engineering experts who can design and solve challenging, real-world reasoning... Show more

 • Promoted

County Meter Reader

Meter ReaderHarrisburg, SD
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Manager - Patient Access CAH

AveraFlandreau, SD, United States
Full-time +1

Location:Avera Dells Area Health HospitalWorker Type:RegularWork Shift:Day Shift (United States of America)Position HighlightsThis position will work between the Dell Rapids and Flandreau facilitie... Show more

 • Promoted

Remote Data Entry Research Participant

FocusGroupPanelSioux Falls, SD, United States
Remote
Full-time

About the Remote Data Entry Research Participant PositionWe are seeking reliable and trustworthy individuals from diverse backgrounds, including customer service, administrative support, healthcare... Show more

 • Promoted

New Graduate RN - Luverne Medical Center

Sanford HealthFlandreau, SD, United States
Full-time +1

As one of the largest not-for-profit health systems in the United States, Sanford Health is always looking to innovate and grow.Grow with us by joining our team of over 18,000 nurses.Our workplace ... Show more

 • Promoted • New!

SALES ASSOCIATE in CANTON, SD S10228

Dollar GeneralCanton, SD, United States
Full-time

At Dollar General, our mission is Serving Others! We value each and every one of our employees.Whether you are looking to launch a new career in one of our many convenient store locations, distribu... Show more

 • Promoted

Work from home - Market Research Study

Earn HausColman, South Dakota, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersRenner, SD
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Remote Expert Contributor - Software Engineer

Arise Virtual SolutionsSioux Falls, South Dakota
Remote
Full-time

Expert Contributor - Software Engineer.Task-Based Independent Contractor Opportunity.We're looking for engineers who can operate at an expert level across real-world, end-to-end tasks in terminal e... Show more

 • Promoted

Graduate Student Intern Data Science & Remote Sensing

KBRSioux Falls, SD, United States
Remote
Full-time

Graduate Student Intern Data Science & Remote Sensing At KBR, we deliver science, technology, and engineering solutions that help our customers accomplish their most critical missions.Join us a... Show more

 • Promoted

Skilled Nursing CNA

Generis Tek IncCanton, SD, United States
Full-time

This position helps residents by supporting personal hygiene and daily living needs; providing comfort, transportation and vital sign monitoring.Essential functions and responsibilities includes th... Show more

 • Promoted

Merchandising Sales Associate

Tractor SupplyFlandreau, SD, United States
Full-time

Overall Job Summary This position is responsible for working as part of the Field Activity Support Team (FAST), primarily in a single store, to own and execute "start to finish" variable tasks such... Show more

 • Promoted

Assistant Food Manager

Kwik TripHarrisburg, SD, United States
Full-time

Kwik Trip is seeking energetic, outgoing, and positive people to make a difference in the communities we serve.Our Assistant Food Managers are responsible for our food program.They prepare foods, d... Show more

 • Promoted

Remote Sales/Remote Recruiter

GPACFlandreau, SD, United States
Remote
Full-time

Job OpportunityGpac (growing people and companies) is a family-owned executive search firm for over 35 years.We are seeking career-driven individuals to train as Search Consultants nationwide.We pr... Show more