This is a unique opportunity to apply your systems engineering expertise toward producing rigorous comparative analyses that directly inform product decisions at frontier AI companies. ### About the Project You'll solve TerminalBench tasks : real-world broken infrastructure scenarios running inside Docker containers. You'll use AI CLI agents to help you. Each task presents a failing system (databases, networking, security, pipelines) that you must diagnose and fix by writing a bash script, guided by AI agents in turn. ### Key Responsibilities - Solve the same infrastructure debugging task with CLI-based AI coding agent - Diagnose broken systems inside Docker containers (databases, TLS, pipelines, replication, access control) - Write bash scripts that fix the root cause and survive service restarts - Compare agents' approaches and rank their performance after each task ### Ideal Qualifications - 3+ years of experience in software engineering, with hands-on debugging of systems and infrastructure - Strong bash / shell scripting proficiency : you'll be writing non-trivial fix scripts from scratch - Docker and containerization experience : every task runs inside a Docker container you'll need to explore via `docker exec` - Infrastructure and systems debugging skills : experience with PostgreSQL, MySQL, Redis, nginx, TLS, systemd, log analysis, or similar - Familiarity with version control workflows (Git, PRs, issue tracking) - Experience with AI coding tools (Copilot, Cursor, Claude, or similar) is a plus : you need to effectively prompt and evaluate AI output, not just code yourself ### Project Timeline - Start Date : Immediate - Duration : 1-2 weeks - Commitment : Part-time (15-25 hours / week, with flexibility up to 40 hours / week) ### Application & Onboarding Process 1. Upload your resume 2. AI interview : A short, 15-minute conversational session to understand your background, experience, and interest in the role 3. Follow-up communication within a few days with next steps and onboarding details Apply today and leverage your systems engineering expertise to help evaluate the next generation of AI coding agents! This is a pay-per-task opportunity for writers. Eligible promotion to reviewers on a need basis.
Remote SWE (Terminal and CLI Dev Tools Focused) - AI Trainer ($75-$80 per hour) • Laredo, Texas, US
We’re seeking Statisticians with strong English writing skills to join our Deep Research for Forecasting project.In this role, you will review time-series plots (a quantity of interest over time) a...[internal_linking.show_more]
As a remote, hourly paid R Engineer, you will review AI-generated responses and generate high-quality R and data-analysis-focused content, evaluating the reasoning quality and step-by-step problem-...[internal_linking.show_more]
As a Senior SQL Engineer, you will work remotely on an hourly paid basis to review AI-generated SQL queries, database designs, and data-processing logic, as well as generate high-quality reference ...[internal_linking.show_more]
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....[internal_linking.show_more]
As a remote, hourly paid Swift Engineer, you will review AI-generated responses and generate high-quality Swift and iOS-focused content, evaluating the reasoning quality and step-by-step problem-so...[internal_linking.show_more]
As a Senior C Engineer, you will work remotely on an hourly paid basis to review AI-generated C code, low-level systems designs, and technical explanations, as well as generate high-quality referen...[internal_linking.show_more]
As an hourly paid, fully remote JavaScript Engineer for AI Data Training, you will review complex AI-generated code and explanations or generate new ones, evaluate the reasoning quality and step-by...[internal_linking.show_more]
As a Senior Python Engineer, you will work remotely on an hourly paid basis to review AI-generated Python solutions and technical explanations, as well as generate high-quality reference content th...[internal_linking.show_more]
As a Senior C++ Engineer, you will work remotely on an hourly paid basis to review AI-generated C++ code, systems designs, and technical explanations, as well as generate high-quality reference imp...[internal_linking.show_more]
As a Senior Java Engineer, you will work remotely on an hourly paid basis to review AI-generated Java code, architectural solutions, and technical explanations, as well as generate high-quality ref...[internal_linking.show_more]
As an hourly paid, fully remote Rust Engineer for AI Data Training, you will review AI-generated Rust code and explanations or generate your own, evaluate the reasoning quality and step-by-step pro...[internal_linking.show_more]
As a TypeScript Engineer, you will work remotely on an hourly paid basis reviewing AI-generated TypeScript code snippets, design proposals, and technical explanations, as well as generating your ow...[internal_linking.show_more]
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....[internal_linking.show_more]
As a remote, hourly paid Kotlin Engineer, you will review AI-generated responses and generate high-quality Kotlin-focused content, evaluating the reasoning quality and step-by-step problem-solving ...[internal_linking.show_more]
In this hourly, remote contractor role, you will review AI-generated engineering solutions and/or generate expert Mechanical Engineering content, evaluating reasoning quality and step-by-step probl...[internal_linking.show_more]
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....[internal_linking.show_more]
As an hourly paid, fully remote Go Engineer for AI Data Training, you will review AI-generated Go code and explanations or generate your own, evaluate the reasoning quality and step-by-step problem...[internal_linking.show_more]
As a Senior Data Scientist, you will work remotely on an hourly paid basis to review AI-generated analytical reasoning, code, and model outputs, as well as generate high-quality reference solutions...[internal_linking.show_more]
