Talent.com
Mercor
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)Mercor • Berkeley, California, US
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Mercor • Berkeley, California, US
5 days ago
Job type
  • Full-time
  • Remote
Job description

## **1\. Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases. Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system. This track works on widely deployed Python codebases including **Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson**. Contract, task-based work paid at **$130 per approved task**, performed remotely in Mercor Studio. ## **2\. Key Responsibilities** - Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution - Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history - Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable - Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers - Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes - Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks ## **3\. Ideal Qualifications** - 3+ years of professional software engineering experience, with substantial production Python - Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime — not just what the source says - Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries - Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant — the task mix is weighted toward architecture and system design (41%) and code onboarding (31%) - Precise written English: the questions and rubrics you write are the product - Comfortable with git at commit level, containerized environments, and command-line tooling ## **4\. Working Details** - Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones - Work is performed in Mercor Studio; time is tracked with Insightful, and platform access is provisioned through Okta - Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted - Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance ## **5\. Application Process** - Submit your resume or relevant technical background to get started - Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Create a job alert for this search

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour) • Berkeley, California, US

Similar jobs

Entry Level Python Developer (Remote)

SynergisticITSan Francisco, CA, United States
Remote
Full-time

Entry Level Python Developer (Remote).SYNERGISTICIT is aware that the job market is challenging because of tech layoffs.The job market is flooded with hundreds and thousands of laid-off jobseekers ... Show more

 • Promoted

Software Engineer, Python - AI Training (Freelance, Remote)

AlignerrSan Francisco, CA, United States
Remote
Full-time

Software Engineer, Python - AI Training (Freelance, Remote)is a community of subject matter experts from several disciplines who align AI models by creating high-quality data in their field of expe... Show more

 • Promoted

Senior Software Engineer, Applied AI (Remote-First in Bay Area)

CadreSan Francisco, CA, United States
Remote
Full-time

About Codex HealthCodex is a mission-driven health technology company building modern intuitive products to enable healthcare providers to deliver the best outcomes to patients.The company values a... Show more

 • Promoted

[Remote] Software Engineer, AI Platforms

Figma JobSan Francisco, CA, United States
Remote
Full-time

Note :The job is a remote job and is open to candidates in USA.Figma is a company on a mission to make design accessible to all, and they are seeking a Software Engineer to join their AI Platforms ... Show more

 • Promoted

Remote Senior Backend Engineer - Geospatial Cloud & AI

WherobotsSan Francisco, CA, United States
Remote
Full-time

Wherobots is seeking a backend software engineer to join their innovative team focused on building the future of geospatial cloud databases.The role involves designing scalable backend systems usin... Show more

 • Promoted

Senior Software Engineer, Planner Reasoning -- Remote

WaymoSan Francisco, CA, United States
Remote
Full-time

A leading autonomous driving technology company is seeking a Senior Software Engineer, Planner Reasoning to develop and improve the driver performance of their technology.The ideal candidate will h... Show more

 • Promoted

Remote Senior AI Product Engineer -- Equity & Code Security

SemgrepSan Francisco, CA, United States
Remote
Full-time

A software security company in San Francisco is looking for a Senior AI Product Engineer to develop user-facing security tools enhancing software quality through AI / ML.This role requires over 5 y... Show more

 • Promoted

Senior Python Data Platform Engineer - Remote

Doximity, Inc.San Francisco, CA, United States
Remote
Full-time

A leading healthcare technology company seeks a Senior Software Engineer to enhance its data platform in San Francisco or remotely.This role involves designing systems, collaborating with data team... Show more

 • Promoted

Software Engineer - Global Remote

MixRankSan Francisco, CA, United States
Remote
Full-time

Who we are MixRank processes petabytes of data every month from web crawling.We have hundreds of customers using our data products including Google, Amazon, Facebook, Intel, and Adobe, across indus... Show more

 • Promoted

Senior Python Engineer - Backend, Hybrid / Remote

CheckrSan Francisco, CA, United States
Remote
Full-time

A fast-growing technology firm in San Francisco is seeking a Senior Software Engineer for its Truework team.The role emphasizes backend development and involves working closely with cross-functiona... Show more

 • Promoted

Robotics Software Engineer (C++ & Python)

Simbe RoboticsSan Francisco, CA, United States
Full-time

Simbe Robotics is a leading retail robotics company providing in-store intelligence solutions that help retailers optimize operations, improve shelf execution, and deliver valuable data insights.Ou... Show more

 • Promoted

Software Engineer, Swift - AI Training (Freelance, Remote)

AlignerrSan Francisco, CA, United States
Remote
Full-time

Software Engineer, Swift - AI Training (Freelance, Remote)Join to apply for the Software Engineer, Swift - AI Training (Freelance, Remote) role at Alignerr.Alignerr is a community of subject matter... Show more

 • Promoted

Senior AI Platform Engineer -- Remote-First

Poggio Labs, Inc.San Francisco, CA, United States
Remote
Full-time

A tech innovation firm in San Francisco seeks engineers to build scalable platforms and integrate systems for deeper AI-powered intelligence.The role emphasizes collaboration with design and engine... Show more

 • Promoted

Senior AI Software Engineer - LLMs, Remote, Equity

Liberate Inc.San Francisco, CA, United States
Remote
Full-time

A forward-thinking AI company is seeking a Senior Software Engineer to join their team in San Francisco.This role focuses on designing and developing high-performance software applications while co... Show more

 • Promoted

Senior Software Engineer - Bioprocess AI (Remote NA)

InvertSan Francisco, CA, United States
Remote
Full-time

A leading biotech software company is seeking a Senior Software Engineer to deliver impactful features while ensuring sound technical decisions for growth.The role requires hands-on delivery, proje... Show more

 • Promoted

AI Software Engineer - Remote Climate-Ag FinTech

MonographSan Francisco, CA, United States
Remote
Full-time

A forward-thinking financial tech startup is seeking a motivated Engineer to help drive the company towards creating sustainable solutions in agriculture.The role involves delivering high-performan... Show more

 • Promoted

Software Engineer, AI & Developer Acceleration

Cartesia, Inc.San Francisco, CA, United States
Full-time

Cartesia AI-Native Software Engineer, AI & Developer AccelerationCartesia is hiring an AI-native Software Engineer, AI & Developer Acceleration to optimize developer experience and maximize... Show more

 • Promoted

AI Programmer-Remote, must live in CA

AppleoneSan Francisco, CA, United States
Remote
Full-time

We are looking for a talented AI Programmer to join our dynamic team and help create innovative, AI-powered applications that push the boundaries of what's possible.In this role, you'll design, dev... Show more

 • Promoted

Senior Software Engineer, Conversational AI Remote AI Leadership

TrellisconnectSan Francisco, CA, United States
Remote
Full-time

A leading insurance tech company in New York is seeking a Senior Software Engineer for their Conversational AI team.This position is crucial for developing systems that enhance customer interaction... Show more

 • Promoted

[Remote] Senior Software Engineer (Applied AI)

My ExpertifySan Francisco, CA, United States
Remote
Full-time

Software Engineer (Applied AI)## RevicFull-time Remote San Francisco, CA### Job DescriptionNote :The job is a remote job and is open to candidates in USA.Revic is an AI-native sales acceleration en... Show more