Talent.com
Mercor
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)Mercor • San Antonio, Texas, US
Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour)

Mercor • San Antonio, Texas, US
13 days ago
Salary
$66.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert computer scientists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core computer science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of computer science expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Computer Science Domains Covered Accelerator / GPU Kernel Engineering, Formal Methods & Automated Reasoning, Computer Architecture & Accelerators, Distributed Systems, DevOps & Site Reliability, Data Engineering & Databases, Cloud & Infrastructure, OS & Systems Kernel, Machine Learning Engineering, Web & API Development, Embedded Systems Engineering, Computer Graphics & Game Development, Mobile Engineering. Key Responsibilities - Author original computer science questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level CS theory, algorithms, systems design, and / or machine learning - Research publications, industry experience at top tech companies, or competitive programming background is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Computer Science Benchmark Specialist - AI Trainer ($66-$84 per hour) • San Antonio, Texas, US

Similar jobs

Director, Transformation (AI) - Remote

San Antonio StaffingSan Antonio, TX, United States
Remote
Full-time

Transformation DirectorLeads and directs enterprise initiatives that drive strategic, operational, and technology-enabled transformation across the organization.Partners with senior leadership to e... Show more

 • Promoted

Applied AI Engineer

Career LaunchSan Antonio, TX, USA
Full-time
Quick Apply

Career Launch is hiring for this role and related opportunities across software, product, operations, go-to-market, finance, and strategy.This opening is for candidates who want to be considered fo... Show more

Remote Physics Expert

Micro1San Antonio, Texas, US
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

Improvement Sciences Specialist - San Antonio TX

ASP Web SolutionsSan Antonio, TX, United States
Full-time

Navy Performance Improvement Analyst.We're a nationwide staffing company and we have a prospective position in San Antonio TX as a Navy Performance Improvement Analyst.If you're interested, please ... Show more

 • Promoted

Software GTM Research Analyst

Initio CapitalSan Antonio, TX, USA
Remote
Full-time
Quick Apply

Initio Capital is hiring for this role and related opportunities across consulting, finance, product, software, AI, operations, market research, and growth-focused workstreams.As a Software GTM Res... Show more

Remote Product Tester - Flexible Studies

BuzzTestersAdkins, TX
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Coding Specialist (Remote Opportunity, Texas residents only) (San Antonio)

University HealthSan Antonio, TX, United States
Remote
Full-time

University Health is one of the largest employers in San Antonio.We are a nationally recognized teaching hospital and consistently recognized as a leader in advanced treatment options, new technolo... Show more

 • Promoted

Remote Biology Expert

Micro1Kirby, Texas, US
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

Founding Engineer - Applied AI

Career LaunchSan Antonio, TX, USA
Full-time
Quick Apply

Career Launch is hiring for this role and related opportunities across software, product, operations, go-to-market, finance, and strategy.This opening is for candidates who want to be considered fo... Show more

AI Engagement Manager

Career LaunchSan Antonio, TX, USA
Full-time
Quick Apply

Career Launch is hiring for this role and related opportunities across software, product, operations, go-to-market, finance, and strategy.This opening is for candidates who want to be considered fo... Show more

Work from home - Market Research Study

Earn HausSaint Hedwig, Texas, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Software Engineer - Platform / Applied AI (Full-Stack)

Career LaunchSan Antonio, TX, USA
Full-time
Quick Apply

Career Launch is hiring for this role and related opportunities across software, product, operations, go-to-market, finance, and strategy.This opening is for candidates who want to be considered fo... Show more