Talent.com
Mercor
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)Mercor • Springfield, Illinois, US
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Mercor • Springfield, Illinois, US
19 hours ago
Job type
  • Full-time
  • Remote
Job description

## **1\. Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases. Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system. This track works on widely deployed Python codebases including **Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson**. Contract, task-based work paid at **$130 per approved task**, performed remotely in Mercor Studio. ## **2\. Key Responsibilities** - Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution - Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history - Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable - Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers - Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes - Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks ## **3\. Ideal Qualifications** - 3+ years of professional software engineering experience, with substantial production Python - Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime — not just what the source says - Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries - Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant — the task mix is weighted toward architecture and system design (41%) and code onboarding (31%) - Precise written English: the questions and rubrics you write are the product - Comfortable with git at commit level, containerized environments, and command-line tooling ## **4\. Working Details** - Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones - Work is performed in Mercor Studio; time is tracked with Insightful, and platform access is provisioned through Okta - Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted - Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance ## **5\. Application Process** - Submit your resume or relevant technical background to get started - Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Create a job alert for this search

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour) • Springfield, Illinois, US

Similar jobs

Remote Legal Expert - AI Trainer

SuperAnnotateSpringfield, IL, United States
Remote
Full-time

In this hourly, remote contractor role, you will review AI-generated legal analyses and / or generate expert legal content, evaluating reasoning quality and step-by-step issue-spotting while provid... Show more

 • Promoted

Embedded Software Engineer - Remote Control & Vision Systems

L&T Technology ServicesSpringfield, IL, United States
Remote
Full-time

Overview :Join a dynamic engineering team to design and develop advanced solutions for remote machine operation.This role focuses on embedded software development for vision systems and real-time c... Show more

 • Promoted

Work From Home

AmazonRiverton, IL
Remote
Full-time

Job Title: Work From Home Customer Service Representative.As a Work From Home Customer Service Representative at Amazon, you will be the first point of contact for customers seeking assistance.You ... Show more

 • Promoted

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiSpringfield, IL, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Senior AI Engineer - Contract - Remote - 6 months+

Resource 1, Inc.Springfield, IL, United States
Remote
Full-time

Resource 1 is seeking a Senior AI Engineer for a long-term, remote contract with our client in the Healthcare industry.Initial contract duration is 6 months, with expected extensions.This can be do... Show more

 • Promoted

Remote Product Tester – $45/hr + Free Products – Start Now!

OCPALitchfield, Illinois, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

QA Analyst - Remote

TradeJobsWorkForce62563 Rochester, IL, US
Remote
Full-time

QA Analyst Remote Job Duties: • Partner with the product and engineering team to understand project o... Show more

 • Promoted

Remote Keynote Writer: Transform Technical Talks

Eliassen GroupSpringfield, IL, United States
Remote
Full-time

A leading strategic consulting company seeks a skilled Keynote Technical Writer to create visually compelling presentations.You will collaborate with technical teams to translate complex ideas into... Show more

 • Promoted

Search Quality Rater - English (Illinois)

RWSSpringfield, IL, United States
Part-time

Search Quality Rater - English (Illinois)Springfield, IllinoisRWS TrainAI / Part-time / RemoteOverview:Are you a web-savvy, search expert with a talent for finding things online by using just a few... Show more

 • Promoted

Work From Home

Remote JobsRiverton, IL
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncSpringfield, Illinois
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Travel Physical Therapist (PT) - $2,048 per week in Litchfield, IL

AlliedTravelCareersLitchfield, IL, US
$2,048.00 weekly
Full-time

AlliedTravelCareers is working with Medical Solutions to find a qualified Physical Therapist (PT) in Litchfield, Illinois, 62056!.A facility in Litchfield, IL is looking for an exceptional PT (Phys... Show more

 • Promoted

Home Care Aide

Arcadia Home Care and StaffingLitchfield, IL, United States
Full-time +1

Addus HomeCare is hiring immediately for Home Care Aides.This rewarding, entry-level position provides consistent, flexible full time/part time hours to accommodate your personal needs, while provi... Show more

 • Promoted

Senior Product Designer (Remote)

Lennar USAAthens, IL, United States
Remote
Full-time

OverviewLennar is one of the nation's leading homebuilders, dedicated to making an impact and creating an extraordinary experience for their Homeowners, Communities, and Associates by building qual... Show more

 • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPALitchfield, Illinois, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Retail Project Supervisor

DrivelineSherman, IL, United States
Full-time

Are you looking for a new, challenging and rewarding management career with the ability to travel across the US?  Do you like managing and interacting with people and customers?  Then continue read... Show more

 • Promoted

(EHR) Trainer (74888)

Centurion Group LLCSpringfield, IL, United States
Full-time

Centurion is proud to be a leading provider of comprehensive healthcare services to correctional facilities, state hospitals, and community mental health centers nationwide.We are currently seeking... Show more

 • Promoted

Healthcare Data Analyst - Springfield, IL - Remote

Vista Applied Solutions Group IncSpringfield, IL, United States
Remote
Full-time

Job Title Data AnalystLocation :Springfield, IL - RemoteDuration :Long TermTelecommute (with occasional travel 4 times in a year to Springfield, IL)Note :12Years of experience who are local or near... Show more

 • Promoted

Senior Teradata Database Administrator / Remote

DATAMAXIS, IncLitchfield, IL, United States
Remote
Full-time

System Administration & MaintenanceManage and maintain OnPrem Teradata systems including patches, upgrades, and hardware replacements.Monitor system health using Viewpoint and other tools; perf... Show more

 • Promoted

Information Systems Technician

U.S. NavyWilliamsville, IL, United States
Full-time

Job Title :Information Technology Professional (IT/CTN/IS) Category / Component :Enlisted Both Overview Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialist... Show more