Talent.com
Mercor
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)Mercor • Madison, Wisconsin, US
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Mercor • Madison, Wisconsin, US
4 days ago
Job type
  • Full-time
  • Remote
Job description

## **1\. Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases. Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system. This track works on widely deployed Python codebases including **Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson**. Contract, task-based work paid at **$130 per approved task**, performed remotely in Mercor Studio. ## **2\. Key Responsibilities** - Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution - Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history - Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable - Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers - Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes - Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks ## **3\. Ideal Qualifications** - 3+ years of professional software engineering experience, with substantial production Python - Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime — not just what the source says - Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries - Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant — the task mix is weighted toward architecture and system design (41%) and code onboarding (31%) - Precise written English: the questions and rubrics you write are the product - Comfortable with git at commit level, containerized environments, and command-line tooling ## **4\. Working Details** - Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones - Work is performed in Mercor Studio; time is tracked with Insightful, and platform access is provisioned through Okta - Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted - Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance ## **5\. Application Process** - Submit your resume or relevant technical background to get started - Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Create a job alert for this search

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour) • Madison, Wisconsin, US

Similar jobs

Work From Home - Product Specialist - $45 per hour

GL1DeForest, Wisconsin
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Supervisor - Production

Stoughton TrailersEvansville, WI, United States
Full-time

Manage all aspects of the production process, in a manufacturing area, to ensure proper coordination between all company departments to the manufacturing line.Understand the organization's support ... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncDeForest, Wisconsin
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Medical Billing and Coding - Entry Level Training Program

Dreambound Inc.Sun Prairie, Wisconsin, US
Full-time

Note : This is an educational program, not a job.Successful completion of the program does not guarantee employment but will equip you with valuable skills for the healthcare job market.Looking to ... Show more

 • Promoted

Information Technology Professional

US NavyEvansville, WI, US
Full-time

Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more

 • Promoted

Work-From-Home Product Beta Tester - $45 per hour

Great LionDeForest, Wisconsin
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Retail Project Supervisor

DrivelineEvansville, WI, US
Full-time

Are you looking for a new, challenging and rewarding management career with the ability to travel across the US?  Do you like managing and interacting with people and customers?  Then continue read... Show more

 • Promoted

Amazon Robotics Technician

TradeJobsWorkforceAlbany, WI, United States
Full-time

We have an opening for a talented Amazon Robotics Technician to perform daily responsibilities with dedication.Work with your team to maintain efficiency and service quality.Stay adaptable in a dyn... Show more

 • Promoted

Sr Training and Learning Specialist

Scientific Protein MasterWaunakee, WI, United States
Full-time

Sr Training and Learning Specialist.Join our team at Scientific Protein Laboratories (SPL), a world leader in biosourced pharmaceuticals, located just outside of Madison, Wisconsin in Waunakee! SPL... Show more

 • Promoted

Talent Partner - Business Consulting (Remote)

Veeva SystemsSun Prairie, WI, United States
Remote
Full-time

The RoleAt Veeva, we build cloud solutions that accelerate how critical medicine and therapies get to market.Our customers range from small biotechs to some of the largest pharmaceutical companies ... Show more

 • Promoted

Business Systems Analyst - GW Systems (xEngage)nsfer

Compu-Vision Consulting Inc.Sun Prairie, WI, United States
Full-time

Business Systems Analyst GW Systems (xEngage).Collaborate with business stakeholders to gather, analyze, and document requirements for Guidewire systems (xEngage, ClaimCenter).Design, configure, a... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaDeForest, Wisconsin, US
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Work from Home - Online Product Support (Entry Level)

GLOCPADeForest, Wisconsin
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiWaunakee, WI, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Java Server Engineer

TradeJobsWorkForceAlbany, WI, United States
Full-time

Java Server Engineer Job Duties: Evaluates Web applications by studying systems flow, data usage, and ... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.DeForest, Wisconsin
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

QA Validation Manager

MRA Recruiting ServicesWaunakee, WI, United States
Full-time

QA Validation ManagerScientific Protein Laboratories (SPL)Waunakee, WI On-site Biopharmaceutical ManufacturingLead validation.Make an impact in life-saving biologics.Scientific Protein Laboratories... Show more

 • Promoted

Physical Therapist

Van Matre Encompass Health Rehabilitation InstituteBrodhead, WI, US
Full-time +1

Physical Therapist Career Opportunity -- $7,500 sign on bonus for full time.Competitive PRN rates and tiers!.Are you seeking a fulfilling career that feels like home and lets you make a meaningful ... Show more

 • Promoted

Online Survey Taker. Earn up to $25 per survey. - Remote

Earn HausEvansville, WI, United States
Remote
Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more

 • Promoted

W2 - Application Architect III (implement OIDC,.Net web apps, MVC, C#, Full stack) - Remote in WI

TANSON CORPWaunakee, WI, United States
Remote
Full-time

Description :WISCONSIN ONLY POSTING :POSTING IS FOR WISCONSIN BASED CANDIDATES ONLY (OR THOSE WILLING TO RELOCATE TO WISCONSIN WITHIN 30 DAYS OF THE START DATE).Candidates that are NOT located IN W... Show more