Talent.com
Mercor
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)Mercor • Rochester, Minnesota, US
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Mercor • Rochester, Minnesota, US
5 days ago
Job type
  • Full-time
  • Remote
Job description

## **1\. Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases. Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system. This track works on widely deployed Python codebases including **Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson**. Contract, task-based work paid at **$130 per approved task**, performed remotely in Mercor Studio. ## **2\. Key Responsibilities** - Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution - Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history - Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable - Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers - Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes - Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks ## **3\. Ideal Qualifications** - 3+ years of professional software engineering experience, with substantial production Python - Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime — not just what the source says - Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries - Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant — the task mix is weighted toward architecture and system design (41%) and code onboarding (31%) - Precise written English: the questions and rubrics you write are the product - Comfortable with git at commit level, containerized environments, and command-line tooling ## **4\. Working Details** - Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones - Work is performed in Mercor Studio; time is tracked with Insightful, and platform access is provisioned through Okta - Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted - Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance ## **5\. Application Process** - Submit your resume or relevant technical background to get started - Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Create a job alert for this search

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour) • Rochester, Minnesota, US

Similar jobs

W2 - (7) - Technical Product Owner (Mobile/web app, Scrum, Agile, Architecture, Healthcare) - Remote

TANSON CORPRochester, MN, United States
Remote
Full-time

Duties:Responsibilities:Understands and considers both the business and the technical engineering/IT needs to ensure quality digital products and related operational workflows to meet/exceed the de... Show more

 • Promoted

Information Technology Professional

US NavySpring Valley, MN, US
Full-time

Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more

 • Promoted

Travel Physical Therapy Assistant - $1564.59 / Week

Medical SolutionsSpring Valley, MN, US
Full-time

Medical Solutions is seeking an experienced Physical Therapy Assistant for an exciting Travel Allied job in Spring Valley, MN.Shift: 8 hr days Start Date: ASAP Duration: 13 weeks Pay: $1564.A facil... Show more

 • Promoted

Remote Consumer Insights Participant

GL IncRochester, Minnesota
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Financial Planner - AI Trainer ($150 per hour)

Mercor IncRochester, MN, United States
Remote
Full-time

UK / Canada / Europe / Singapore / Dubai / Australia-basedInvestment Banking or Private Equity Expertsfor a research project with a leading foundational model AI lab.You are a good fit if you :- Ha... Show more

 • Promoted

Mayo Foundation for Medical Education and Research is hiring: Remote Senior SEO

Mayo Foundation for Medical Education and ResearchRochester, MN, United States
Remote
Full-time

A leading medical institution in Rochester, Minnesota is seeking a Senior Manager, SEO & Owned Channel Execution to lead SEO strategies and grow owned engagement across multiple platforms, incl... Show more

 • Promoted

Travel Physical Therapy Assistant (PTA) - $1,564 per week in Spring Valley, MN

AlliedTravelCareersSpring Valley, MN, US
$1,564.00 weekly
Full-time

AlliedTravelCareers is working with Medical Solutions to find a qualified Physical Therapy Assistant (PTA) in Spring Valley, Minnesota, 55975!.A facility in Spring Valley, MN is seeking its next am... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncRochester, Minnesota
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Professional Coder - Remote

Mayo ClinicRochester, MN, United States
Remote
Full-time

The Professional Coder reviews, analyzes, and codes professional/physician medical record documentation to include, but not limited to, medical diagnostic and E/M coding information for various pra... Show more

 • Promoted

Remote Consumer Research Participant

GL IncRochester, Minnesota
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaRochester, Minnesota, US
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

W2 - Software Engineer (.NET/C#, SQL Server, APIs, ADO, Power Automate, Cleo Harmony, Agile) -

TANSON CORPRochester, MN, United States
Remote
Full-time

Duties:Job Summary:Client Clinic is seeking a Software Engineer to design and build back-end services that support our portfolio of data-centric clinical and analytic applications.These application... Show more

 • Promoted

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiRochester, MN, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Medical Billing and Coding - Entry Level Training Program

Dreambound Inc.Rochester, Minnesota, US
Full-time

Note : This is an educational program, not a job.Successful completion of the program does not guarantee employment but will equip you with valuable skills for the healthcare job market.Looking to ... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Rochester, Minnesota
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Aviation Electronics, Electrical & Computer Systems Technician

US NavySpring Valley, MN, US
Full-time

Advanced Electronics / Computer Field (ET/FC).The Advanced Electronics and Computer Field trains Sailors to maintain, operate, and repair some of the Navy’s most sophisticated electronics and compu... Show more

 • Promoted

Data Engineer (Remote)

Da Vinci SoftwareRochester, MN, United States
Remote
Full-time

Overview:Our client is seeking an experienced Data Engineer who will be responsible for the Design and maintain data pipelines and services using best practice for ETL/ELT, data management and data... Show more

 • Promoted

W2 - (3) - Sr Data Engineer (1 opening: 1k Agents, 2 openings: Infrastructure Engineer) - Remote

TANSON CORPRochester, MN, United States
Remote
Full-time

Duties:Implement data pipelines using best practices for ETL / ELT, data management, and data governance.Analyze and process complex data sources in a fast-paced environment.Perform data modeling a... Show more

 • Promoted

Software Tester I - 100% Remote

Genesis10Rochester, MN, United States
Remote
Temporary

Genesis10 is seeking a Software Tester I for a 6-month contract position with our healthcare services client.The position will be fully remote.Job Description :This role delivers software quality a... Show more

 • Promoted

Online Consumer Research Participant

GL IncRochester, Minnesota
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more