Talent.com
Mercor
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)Mercor • Clifton, New Jersey, US
Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour)

Mercor • Clifton, New Jersey, US
1 day ago
Job type
  • Full-time
  • Remote
Job description

## **1\. Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases. Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system. This track works on widely deployed Python codebases including **Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson**. Contract, task-based work paid at **$130 per approved task**, performed remotely in Mercor Studio. ## **2\. Key Responsibilities** - Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution - Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history - Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable - Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers - Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes - Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks ## **3\. Ideal Qualifications** - 3+ years of professional software engineering experience, with substantial production Python - Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime — not just what the source says - Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries - Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant — the task mix is weighted toward architecture and system design (41%) and code onboarding (31%) - Precise written English: the questions and rubrics you write are the product - Comfortable with git at commit level, containerized environments, and command-line tooling ## **4\. Working Details** - Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones - Work is performed in Mercor Studio; time is tracked with Insightful, and platform access is provisioned through Okta - Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted - Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance ## **5\. Application Process** - Submit your resume or relevant technical background to get started - Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Create a job alert for this search

Remote Software Engineer, Python — Codebase Q&A - AI Trainer ($130-$130 per hour) • Clifton, New Jersey, US

Similar jobs

Clojure AI / LLM Engineer - REMOTE

StyliticsNew York City, NY, United States
Remote
Full-time

We are looking for a versatile and experienced AI / LLM Data Engineer to join our team and help shape the future of how Stylitics leverages large language models.In this role, you'll combine your e... Show more

 • Promoted

AI Workflow Developer (Remote) - Media & Entertainment

Tandym GroupEnglewood Cliffs, NJ, United States
Remote
Full-time

AI Workflow Developer (Remote) - Media & EntertainmentGet AI-powered advice on this job and more exclusive features.A recognized media organization offers a remote opportunity for an innovative... Show more

 • Promoted

Staff Software Engineer - Remote

TradeJobsWorkForce10034 New York, NY, US
Remote
Full-time

Staff Software Engineer Remote Job Duties: • Implement and evolve a Data Lake storage system with low latency and high thr... Show more

 • Promoted

Senior Software Engineer AI-Driven Hiring Platform (Remote)

RippleMatchNew York City, NY, United States
Remote
Full-time

A leading recruitment platform is seeking a Senior Software Engineer to join their innovative team focused on building an AI-driven hiring platform.This position involves writing high-quality code,... Show more

 • Promoted

AI Trainer - Advanced JavaScript Developers (US & Canada)Remote

ProlificNew York City, NY, United States
Remote
Full-time

AI Research EngineerHelp drive breakthroughs in science, technology, and society.Grow, lead, and make an impact in a fast-scaling business.Join a dynamic team with ownership and creativity at its c... Show more

 • Promoted

Cloud & AI Applications Engineer (100% remote)

DBI StaffingNew York City, NY, United States
Remote
Full-time

We are seeking a motivated, technically savvy, and business-oriented professional to serve as the initial point of technical contact for the firm's cloud-based and AI-powered business applications.... Show more

 • Promoted

Senior Software Engineer - AI-Enabled Platform (Remote)

Franklin FitchNew York City, NY, United States
Remote
Full-time

A leading technology solutions provider is seeking a Senior Software Engineer to enhance an AI-enabled platform.The role involves converting discussions into actionable solutions and collaborating ... Show more

 • Promoted

AI Engineer (Remote)

Conch Technologies IncNew York City, NY, United States
Remote
Full-time

W2 Role only, No visa sponsorship at this time Role:AI Engineer Remote New York, NY, 10017 Bachelor s degree in Engineering, Statistics, Mathematics, Computer Science, Data Science, Economics, or a... Show more

 • Promoted

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiPeekskill, NY, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Data Engineer / Python Developer / Remote

Apetan Consulting llcNew Milford, NJ, United States
Remote
Full-time

Key ResponsibilitiesDesign, build, and maintain ETL / ELT data pipelinesDevelop Python-based data processing applicationsWork with structured and unstructured data at scaleIntegrate data from multi... Show more

 • Promoted

Remote AI Full-Stack Engineer: From ML to UI

BjakNew York City, NY, United States
Remote
Full-time

A fast-growing AI-driven financial services company is seeking an AI Developer to work remotely from anywhere in the US.This role involves full-stack development to bridge machine learning and soft... Show more

 • Promoted

Remote Investment Analyst - AI Trainer ($50-$60 / hour)

Data AnnotationClifton, NJ, United States
Remote
Full-time +1

We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ... Show more

 • Promoted

AI Engineer - Remote

Info Resume EdgeNew York City, NY, United States
Remote
Full-time

Freelancer Prox is the first platform that is completely free for both recruiters and job seekers.By creating a profile, your visibility increases globally, enabling faster hiring for both remote a... Show more

 • Promoted

AI Solutions Engineer - Remote

Finn PartnersMontvale, NJ, United States
Remote
Full-time

The AI Solutions Engineer is the primary builder, architect, and technical steward of the organization's internal AI capabilities.This role is responsible for the design, development, and operation... Show more

 • Promoted

Senior Backend Engineer - AI-Driven Risk (Remote)

BitSightNew York City, NY, United States
Remote
Full-time

A technology leader in cyber risk management is seeking a Senior Software Engineer to join their team.This role focuses on backend development, requiring expertise in Python and experience with RES... Show more

 • Promoted

Remote | AI Platform & Integrations Software Engineer — $95–$140/hour

24-MAGNew York, New York, United States
$95.00 hourly
Remote
Full-time
Quick Apply

We are sharing a specialised full-time consulting opportunity for software engineers experienced in SaaS platform development, backend and frontend engineering, API integrations, real-time dashboar... Show more

Senior AI Engineer

Glint Tech Solutions LLCNew York, NY, USA
Remote
Full-time
Quick Apply

Glint Tech Solutions is a women-owned global staffing and IT recruiting firm connecting top technical talent with leading enterprise clients across the United States and Canada.Our client, a leadin... Show more

Python Software Engineer - Remote

S&P GlobalNew York City, NY, United States
Remote
Full-time

About the RoleGrade Level (for internal use) :S&P Global Automotive InsightsJob title :Software EngineerLocation :Mexico - Remote (Only candidates based out within Mexico will be considered)The... Show more

 • Promoted

Online Survey Participant: Work Remote and Earn Up To $25 Per Survey

Earn HausPeekskill, NY, US
Remote
Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more

 • Promoted

Survey Taker: Earn up to $25 per survey (Remote)

Earn HausWest Haverstraw, NY, US
Remote
Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more