Web developer • santa rosa ca
Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases.Codebase Q&A is a reinforcement-learning environment fo... Show more
We're looking for highly accomplished **Cybersecurity Research Experts** to help evaluate cutting-edge AI systems in advanced security reasoning, vulnerability analysis, exploit development, and se... Show more
Overview** We're looking for professionals with hands-on, real-world experience in specialized applications.Application Expertise and Access You must already have **VMware Fusion** installed/availa... Show more
We're looking for highly accomplished **Cybersecurity Research Experts** to help evaluate cutting-edge AI systems in advanced security reasoning, vulnerability analysis, exploit development, and se... Show more
Technical Business Process Analyst.We are seeking a Technical Business Process Analyst with experience in software engineering and security-focused processes.This role partners closely with softwar... Show more
Mercor’s Talent Success team is hiring! Our Talent Success team is responsible for ensuring everyone using our platform has a delightful experience end to end, from applying to job listings, taking... Show more
Overview** We're looking for professionals with hands-on, real-world experience in specialized applications.Application Expertise and Access You must already have **Visual Studio Code** installed/a... Show more
Overview** We're looking for professionals with hands-on, real-world experience in specialized applications.Application Expertise and Access You must already have **Visual Studio Code** installed/a... Show more
Overview** We're looking for professionals with hands-on, real-world experience in specialized applications.Application Expertise and Access You must already have **VMware Fusion** installed/availa... Show more
We're seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications.You'll validate wheth... Show more
Mercor’s Talent Success team is hiring! Our Talent Success team is responsible for ensuring everyone using our platform has a delightful experience end to end, from applying to job listings, taking... Show more
Mercor’s Talent Success team is hiring! Our Talent Success team is responsible for ensuring everyone using our platform has a delightful experience end to end, from applying to job listings, taking... Show more
Mercor’s Talent Success team is hiring! Our Talent Success team is responsible for ensuring everyone using our platform has a delightful experience end to end, from applying to job listings, taking... Show more
Overview** We're looking for professionals with hands-on, real-world experience in specialized applications.Application Expertise and Access You must already have **Android Studio** installed/avail... Show more
Overview** We're looking for professionals with hands-on, real-world experience in specialized applications.Application Expertise and Access You must already have **PyCharm** installed/available on... Show more
Overview** We're looking for professionals with hands-on, real-world experience in specialized applications.Application Expertise and Access You must already have **Android Studio** installed/avail... Show more
Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases.Codebase Q&A is a reinforcement-learning environment fo... Show more
We're seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications.You'll validate wheth... Show more
Keysight is at the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization.Our ~16, em... Show more
Gallaher Companies is a nationally recognized leader in real estate development, design, construction, and operations.Specializing in multifamily residences, commercial projects, senior living comm... Show more
The average salary range is between $ 100,000 and $ 173,730 year , with the average salary hovering around $ 123,362 year .
The average salary range is between $ 68,376 and $ 130,700 year , with the average salary hovering around $ 92,622 year .
## **1\. Role Overview** Mercor is seeking experienced **Python engineers** to build the dataset that teaches AI agents to reason about real codebases. Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system. This track works on widely deployed Python codebases including **Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson**. Contract, task-based work paid at **$130 per approved task**, performed remotely in Mercor Studio. ## **2\. Key Responsibilities** - Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution - Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history - Rewrite the task's question so it defeats frontier coding agents while remaining well-defined and fairly answerable - Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers - Run the full validation loop in Studio — Check, Golden, Run, Analyze — and iterate until every stage passes - Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks ## **3\. Ideal Qualifications** - 3+ years of professional software engineering experience, with substantial production Python - Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime — not just what the source says - Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries - Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant — the task mix is weighted toward architecture and system design (41%) and code onboarding (31%) - Precise written English: the questions and rubrics you write are the product - Comfortable with git at commit level, containerized environments, and command-line tooling ## **4\. Working Details** - Fully remote and asynchronous, with expert team leads across US, India, and Nigeria time zones - Work is performed in Mercor Studio; time is tracked with Insightful, and platform access is provisioned through Okta - Onboarding requires identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and passing a short calibration quiz before task access is granted - Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance ## **5\. Application Process** - Submit your resume or relevant technical background to get started - Qualified applicants may be asked to complete a brief technical assessment or provide additional information
