Talent.com
Mercor
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)Mercor • Lubbock, Texas, US
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Mercor • Lubbock, Texas, US
6 days ago
Job type
  • Full-time
  • Remote
Job description

## **1\. Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases. Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system. This track works on widely deployed Python codebases including **Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson**. Contract, task-based work paid at **$130 per approved task**, performed remotely in Mercor Studio. ## **2\. Key Responsibilities** - Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution - Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history - Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable - Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers - Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes - Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks ## **3\. Ideal Qualifications** - 3+ years of professional software engineering experience, with substantial production Python - Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime — not just what the source says - Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries - Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant — the task mix is weighted toward architecture and system design (41%) and code onboarding (31%) - Precise written English: the questions and rubrics you write are the product - Comfortable with git at commit level, containerized environments, and command-line tooling ## **4\. Working Details** - Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones - Work is performed in Mercor Studio; time is tracked with Insightful, and platform access is provisioned through Okta - Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted - Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance ## **5\. Application Process** - Submit your resume or relevant technical background to get started - Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Create a job alert for this search

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour) • Lubbock, Texas, US

Similar jobs

Advanced Electronics / Computer Field Technician

US NavyRopesville, TX, US
Full-time

Advanced Electronics / Computer Field (ET/FC).The Advanced Electronics and Computer Field trains Sailors to maintain, operate, and repair some of the Navy’s most sophisticated electronics and compu... Show more

 • Promoted

Houseparents - Relocation to Hershey, PA Required

Milton Hershey SchoolNew Home, Texas, United States
Full-time

Located in Hershey, PA, Milton Hershey School (MHS) is a top-notch home and school where over 2,200 pre-K through 12th grade students from disadvantaged backgrounds are provided an extraordinary, c... Show more

 • Promoted

Qualified Moms Wanted: Healthy Prior Delivery & age 21-43 ($70k+)

Inclusive SurrogacyHale Center, Texas, United States
Permanent

Become a Surrogate and Help Create a Family While Supporting Your Own.Surrogacy gives you the opportunity to make an extraordinary impact in someone’s life while strengthening your own family’s fut... Show more

 • Promoted

Had a Healthy Pregnancy? Help Create a Family While Supporting Your Own

Inclusive SurrogacyHale Center, Texas, United States
Permanent

Become a Surrogate and Help Create a Family While Supporting Your Own.Surrogacy gives you the opportunity to make an extraordinary impact in someone’s life while strengthening your own family’s fut... Show more

 • Promoted

Remote Product Tester – $45/hr + Free Products – Start Now!

OCPAHale Center, Texas, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

House Parents - Relocation to Hershey, PA Required

Milton Hershey SchoolHale Center, Texas, United States
Full-time

Located in Hershey, PA, Milton Hershey School (MHS) is a top-notch home and school where over 2,200 pre-K through 12th grade students from disadvantaged backgrounds are provided an extraordinary, c... Show more

 • Promoted

Houseparents, Full-Time - Relocation to Hershey, PA Required

Milton Hershey SchoolHale Center, Texas, United States
Full-time

Located in Hershey, PA, Milton Hershey School (MHS) is a top-notch home and school where over 2,200 pre-K through 12th grade students from disadvantaged backgrounds are provided an extraordinary, c... Show more

 • Promoted

Test Products from Home – $25-$45/hr + Freebies

OCPANew Home, Texas, us
$25.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Get Paid to Test Products at Home – Flexible Hours, Weekly Pay

OCPARopesville, Texas, us
$25.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Online Survey Taker. Earn up to $25 per survey. - Remote

Earn HausNew Home, TX, United States
Remote
Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more

 • Promoted

Information Technology Professional

US NavyRopesville, TX, US
Full-time

Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more

 • Promoted

Aviation Electronics, Electrical & Computer Systems Technician

US NavyRopesville, TX, US
Full-time

Advanced Electronics / Computer Field (ET/FC).The Advanced Electronics and Computer Field trains Sailors to maintain, operate, and repair some of the Navy’s most sophisticated electronics and compu... Show more

 • Promoted

Fixed Wing Pilot

Global Medical ResponseRopesville, TX, United States
Full-time

If your passion is flying and you want to work in an environment where every second counts, contact us today!.Sign-On Bonus (Must Complete Training and Check-Ride).Retention Bonus (There is a 6 Mon... Show more

 • Promoted

Hiring Now - Work from Home - No Experience

OCPARopesville, Texas, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Youth Development Specialist - Relocation to Hershey, PA Required

Milton Hershey SchoolHale Center, Texas, United States
Full-time

Located in Hershey, PA, Milton Hershey School (MHS) is a top-notch home and school where over 2,200 pre-K through 12th grade students from disadvantaged backgrounds are provided an extraordinary, c... Show more

 • Promoted

Store Manager in Training

YeswayHale Center, TX, United States
Full-time

Assist the Store Manager with management responsibilities including training and development of employees and store responsibilities;.Scheduling employees for shifts;.Resolving store issues includi... Show more

 • Promoted

Residential Youth Caregiver - Relocation to Hershey, PA Required

Milton Hershey SchoolHale Center, Texas, United States
Full-time

Located in Hershey, PA, Milton Hershey School (MHS) is a top-notch home and school where over 2,200 pre-K through 12th grade students from disadvantaged backgrounds are provided an extraordinary, c... Show more

 • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPASpade, Texas, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Product Tester (Work From Home) – Keep Free Products + Weekly Pay

OCPAHale Center, Texas, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

In-Home Product Tester – No Fees, No Experience, $25-$45/hr

OCPANew Home, Texas, us
$25.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more