Talent.com
Mercor
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)Mercor • West Valley City, Utah, US
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Mercor • West Valley City, Utah, US
16 hours ago
Job type
  • Full-time
  • Remote
Job description

## **1\. Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases. Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system. This track works on widely deployed Python codebases including **Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson**. Contract, task-based work paid at **$130 per approved task**, performed remotely in Mercor Studio. ## **2\. Key Responsibilities** - Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution - Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history - Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable - Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers - Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes - Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks ## **3\. Ideal Qualifications** - 3+ years of professional software engineering experience, with substantial production Python - Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime — not just what the source says - Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries - Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant — the task mix is weighted toward architecture and system design (41%) and code onboarding (31%) - Precise written English: the questions and rubrics you write are the product - Comfortable with git at commit level, containerized environments, and command-line tooling ## **4\. Working Details** - Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones - Work is performed in Mercor Studio; time is tracked with Insightful, and platform access is provisioned through Okta - Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted - Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance ## **5\. Application Process** - Submit your resume or relevant technical background to get started - Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Create a job alert for this search

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour) • West Valley City, Utah, US

Similar jobs

Consumer Research Associate (Remote)

GL IncLehi, Utah
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaLehi, Utah, US
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Consumer Research Participant

GL IncLehi, Utah
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Survey Taker: Earn up to $25 per survey (Remote)

Earn HausSaratoga Springs, UT, US
Remote
Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more

 • Promoted

Sofware Engineer

TradeJobsWorkForce84045 Saratoga Springs, UT, US
Full-time

Analyze, design and develop tests and test-automation suites.Design, create and develop a processing platform using various configuration management technologies.Test software development methodolo... Show more

 • Promoted

AI Onboarding Specialist

PodiumLehi, UT, United States
Full-time

At Podium, we bring AI Employees to local businesses that turn every conversation into revenue.Trusted by 60,000+ businesses across Auto, Home Services, and Aesthetics, Podium captures and converts... Show more

 • Promoted

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiClearfield, UT, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Remote Senior Go Engineer - Remote - Nav

WorksHubClearfield, UT, United States
Remote
Full-time

OverviewNav is democratizing small business financing.In other words, we give small business owners access and control.Yes, this challenges the norm, but it means working with curious, purpose driv... Show more

 • Promoted

AI Field Trainer Lehi, Utah, Open to Remote

PodiumLehi, UT, United States
Remote
Full-time

AI Field TrainerAt Podium, our mission is to arm every local business with a complete platform and outcome-driven AI employees that convert leads into real, paying customers.Every day, millions of ... Show more

 • Promoted

Software Engineer - Salt Lake City, UT (Remote) W2 only

RICEFW Technologies IncSalt Lake City, UT, United States
Remote
Full-time

SCOPE OF WORK SOFTWARE ENGINEER FORUSBE SEATS DASHBOARD SOLICITATION #USBE-MHNA5NA-DO3The Utah State Board of Education (USBE) is seeking two (2) highly motivated Software Engineer to develop and m... Show more

 • Promoted

Full Stack Staff-Level Software Engineer - Remote

BankTalent HQSalt Lake City, UT, United States
Remote
Full-time

Zions Bancorporation's Enterprise Technology and Operations (ETO) team is transforming what it means to work for a financial institution.With a commitment to technology and innovation, we have been... Show more

 • Promoted

Remote Consumer Insights Participant

GL IncSaratoga Springs, Utah
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Senior Software Engineer Remote Lead & Mentor

HealthEquityDraper, UT, United States
Remote
Full-time

A leading health solutions company seeks a Sr Software Engineer to develop and implement innovative software solutions.This fully remote position requires over 8 years of experience in software dev... Show more

 • Promoted

Software Engineer

TradeJobsWorkForce84043 Lehi, UT, US
Full-time

Software Engineer Job Duties: Develops information systems by designing, developing, and installin... Show more

 • Promoted

Tutor - Remote

TradeJobsWorkForce84043 Lehi, UT, US
Remote
Full-time

Tutor Job Duties: Contributes to student learning, growth, and advancement... Show more

 • Promoted

Lead SW Engineer - UI for Hyperscale Infrastructure | REMOTE | Startup Job at Li

Living TalentSalt Lake City, UT, United States
Remote
Full-time

OverviewUI and Dashboards for Hyperscale Infrastructure platformCloud resource optimization for Kubernetes, HPC, AI workloads.Full-Stack SW Engineer with UI expertise (Go, React, TS, UI State Manag... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Eagle Mountain, Utah
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

AI Onboarding Specialist - Automotive

PodiumLehi, UT, United States
Full-time

AI Onboarding Specialist - Automotive.At Podium, we bring AI Employees to local businesses that turn every conversation into revenue.Trusted by 60,000+ businesses across Auto, Home Services, and Ae... Show more

 • Promoted

Online Survey Participant: Work Remote and Earn Up To $25 Per Survey

Earn HausBluffdale, UT, US
Remote
Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more

 • Promoted

Math Writing Editor - Remote

TradeJobsWorkForce84045 Saratoga Springs, UT, US
Remote
Full-time

Math Writing Editor Remote Job Duties: The Math Writing Editor ensures that all Eureka Math content—including print a... Show more