Talent.com
Mercor
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)Mercor • Thousand Oaks, California, US
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Mercor • Thousand Oaks, California, US
3 days ago
Job type
  • Full-time
  • Remote
Job description

## **1\. Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases. Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system. This track works on widely deployed Python codebases including **Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson**. Contract, task-based work paid at **$130 per approved task**, performed remotely in Mercor Studio. ## **2\. Key Responsibilities** - Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution - Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history - Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable - Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers - Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes - Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks ## **3\. Ideal Qualifications** - 3+ years of professional software engineering experience, with substantial production Python - Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime — not just what the source says - Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries - Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant — the task mix is weighted toward architecture and system design (41%) and code onboarding (31%) - Precise written English: the questions and rubrics you write are the product - Comfortable with git at commit level, containerized environments, and command-line tooling ## **4\. Working Details** - Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones - Work is performed in Mercor Studio; time is tracked with Insightful, and platform access is provisioned through Okta - Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted - Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance ## **5\. Application Process** - Submit your resume or relevant technical background to get started - Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Create a job alert for this search

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour) • Thousand Oaks, California, US

Similar jobs

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiSanta Paula, CA, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaSanta Paula, California, US
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncCamarillo, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Consumer Insights Participant

GL IncFillmore, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Manager, AI Solutions Partner - Operations (US - Remote)

AmgenCamarillo, CA, United States
Remote
Full-time

AccountabilitiesThe Manager, AI Solutions Partner plays a critical role within the AI&D Innovation Lab & Partnership team, contributing to the application of AI capabilities to address high... Show more

 • Promoted

Survey Taker: Earn up to $25 per survey (Remote)

Earn HausCamarillo, CA, US
Remote
Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more

 • Promoted

Data Engineer with Pharma Domain Exp

Syntricate TechnologiesNewbury Park, CA, United States
Full-time

Experience architecting and building ETL pipelines; hands-on experience with SQL.Experience with Semantic Layer technologies.Experience with data modeling, performance tuning, and experience on rel... Show more

 • Promoted

Remote Consumer Research Participant

GL IncCamarillo, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Stay-at-Home Moms 21–39: Become a Paid Gestational Carrier (Prior Birth Required Paid $50K-$85K)

Surrogacy4AllLake of the Woods, CA, US
Full-time

Help Create Families — Become a Surrogate mother (Earn $50,000–$85,000+) .Perfect for Stay-at-Home Moms · Ages 21–39 · Remote Opportunity.Are you a caring mom who wants to make a meaningful differe... Show more

 • Promoted

Test Products from Home – $25-$45/hr + Freebies

OCPALake Sherwood, California, us
$25.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester – $45/hr + Free Products – Start Now!

OCPAFrazier Park, California, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Software Engineer

ClearanceJobsCamarillo, CA, United States
Full-time

Software Developer - System SoftwareThe company, a defense contractor, is seeking a Software Developer - System Software with 3years of experience for our expanding workforce supporting current and... Show more

 • Promoted

Senior Engineer - Biotech Environment & Sustainability - Remote

3 Key ConsultingNewbury Park, CA, United States
Remote
Full-time

Engineer - Biotech Environment & Sustainability - Remote (JP13584)Location :Thousand Oaks, Ca.Remote work)Business Unit :Environment & SustainabilityEmployment Type :ContractDuration :6 mon... Show more

 • Promoted

Stay-at-Home Moms 21–39: Become a Paid Surrogate (Prior Birth Required Paid $50K-$85K)

Surrogacy4AllLake of the Woods, CA, US
Full-time

Help Create Families — Become a Surrogate mother (Earn $50,000–$85,000+) .Perfect for Stay-at-Home Moms · Ages 21–39 · Remote Opportunity.Are you a caring mom who wants to make a meaningful differe... Show more

 • Promoted

Online Survey Participant: Work Remote and Earn Up To $25 Per Survey

Earn HausCamarillo, CA, US
Remote
Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Santa Paula, California
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Senior Manager, Agentic AI Business Solutions

AmgenNewbury Park, CA, United States
Full-time

Senior Manager, Agentic Ai Business Solutions.At Amgen, if you feel like you're part of something bigger, it's because you are.Our shared missionto serve patients living with serious illnessesdrive... Show more

 • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPAFrazier Park, California, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Medical Billing and Coding - Entry Level Training Program

Dreambound Inc.Santa Paula, California, US
Full-time

Note : This is an educational program, not a job.Successful completion of the program does not guarantee employment but will equip you with valuable skills for the healthcare job market.Looking to ... Show more

 • Promoted

Stay-at-Home Moms 21–39: Help bless a family - Prior Birth Required Paid $50K-$85K

Surrogacy4AllLake of the Woods, CA, US
Full-time

Help Create Families — Become a Surrogate mother (Earn $50,000–$85,000+) .Perfect for Stay-at-Home Moms · Ages 21–39 · Remote Opportunity.Are you a caring mom who wants to make a meaningful differe... Show more