Remote Software Engineering & Systems Design Expert - AI Trainer ($45-$80 per hour)Mercor • Everett, Washington, US
Remote Software Engineering & Systems Design Expert - AI Trainer ($45-$80 per hour)
Mercor • Everett, Washington, US
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
- [job_card.part_time]
- [filters.remote]
[job_card.job_description]Location : N / A Type : Full-time or Part-time Contract Work Fluent Language Skills Required : English Why This Role Exists Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. In coding and software engineering contexts, conversational AI systems must demonstrate correct reasoning, strong problem-solving ability, and adherence to real-world engineering best practices. This project focuses on evaluating and improving how models reason about code, generate solutions, and explain technical concepts across a variety of programming tasks and complexity levels. What You’ll Do Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness - Conduct fact-checking using trusted public sources and authoritative references - Conduct accuracy testing by executing code and validating outputs using appropriate tools Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies - Assess code quality, readability, algorithmic soundness, and explanation quality - Ensure model responses align with expected conversational behavior and system guidelines - Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines Who You Are You hold a BS, MS, or PhD in Computer Science or a closely related field You have significant real-world experience in software engineering or related technical roles - You are an expert in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust) You are able to solve HackerRank or LeetCode Medium and Hard–level problems independently You have experience contributing to well-known open-source projects, including merged pull requests - You have significant experience using LLMs while coding and understand their strengths and failure modes - You have strong attention to detail and are comfortable evaluating complex technical reasoning , identifying subtle bugs or logical flaws Nice-to-Have Specialties Prior experience with RLHF, model evaluation, or data annotation work - Track record in competitive programming - Experience reviewing code in production environments - Familiarity with multiple programming paradigms or ecosystems - Experience explaining complex technical concepts to non-expert audiences What Success Looks Like You identify incorrect logic, inefficiencies, edge cases, or misleading explanations in model-generated code, technical concepts, and system design discussions - Your feedback improves the correctness, robustness, and clarity of AI coding outputs - You deliver reproducible evaluation artifacts that strengthen model performance - Mercor customers trust AI systems to assist reliably with real-world coding tasks Why Join Mercor At Mercor, experienced software engineers play a direct role in shaping how AI systems reason about and generate code. This flexible, remote role allows you to apply your technical expertise to high-impact AI development work, improving systems used by developers around the world.
[job_alerts.create_a_job]
Software Engineering • Everett, Washington, US
[internal_linking.similar_jobs]
Software Engineering Manager, Quantum Product, Quantum AI.Join to apply for the Software Engineering Manager, Quantum Product, Quantum AI role at Google.
Note : By applying to this position you will ...[show_more]
Seattle, Washington, United States Software and Services.The HomeKit team provides the foundation that enables an entire ecosystem of secure and intelligent home connectivity.We are developing tech...[show_more]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
A leading technology firm is seeking a Senior Design Engineer to enhance user experience in their innovative team.This role involves designing exceptional interfaces, building components collaborat...[show_more]
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.
Job CategorySoftware EngineeringJob Details • • • •Abo...[show_more]
PLEASE NOTE : At this time, we are only able to consider candidates who are authorized to work in the United States without the need for current or future visa sponsorship.Evertune is building the f...[show_more]
A leading design and engineering firm is seeking a Design Engineer in San Francisco to build scalable design systems and high-quality components for consumer-grade product experiences.The ideal can...[show_more]
Manager, Software Engineering - AI / ML.Join to apply for the Manager, Software Engineering - AI / ML role at Supio.We’re building AI that transforms personal injury law—helping attorneys uncover evide...[show_more]
A leading AI solutions provider seeks a Mathematics Expert to develop and solve complex mathematical problems for AI model enhancement.
This remote role requires a Master’s or PhD in Mathematics and...[show_more]
A leading financial services company located in Seattle seeks a Senior AI Software Engineer for Risk Engineering.This key position involves building and optimizing scalable applications that levera...[show_more]
A leading software company in Seattle is looking for an expert to innovate core intelligence solutions within its DevAI products.
This pivotal role involves LLM integration and developing AI feature...[show_more]
Robots & Pencils is seeking an outcome oriented Forward Deployed Senior Software Engineer to partner with strategic clients on high-impact agentic AI applications.
You'll embed directly with custome...[show_more]
This is an hourly-paid, fully remote contractor role where you will review AI-generated responses and / or generate C# / .
NET engineering content, evaluating reasoning quality and step-by-step problem-...[show_more]
A leading SaaS company is seeking a Principal Engineering Manager for its Core Platform & AI Systems in Seattle.This role involves driving the technical roadmap, leading a skilled engineering team,...[show_more]
A pioneering AI company in Seattle is seeking a Staff Machine Learning Engineer to enhance the capabilities of their AI systems.
The ideal candidate will have extensive experience in machine learnin...[show_more]
A leading AI research accelerator is looking for an experienced software engineer to evaluate and refine AI-generated code and collaborate with teams to enhance AI-driven coding solutions.Candidate...[show_more]
Applications will be accepted on an ongoing basis until the requisition is closed.At Blue Origin, we envision millions of people living and working in space for the benefit of Earth.We're working t...[show_more]
Senior Software Engineer, Agentic AI.Pacific Northwest National Laboratory.At PNNL, our core capabilities are divided among majorDirectorates within the Lab, focused on specific areas of scientific...[show_more]
Software Engineering Manager, Quantum Product, Quantum AI
Google • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Software Engineering Manager, HomeKit
Apple Inc. • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote M&A Associate - AI Trainer ($50-$60 / hour)
Data Annotation • Marysville, Washington
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Senior Design Engineer : AI UI & Design Systems Lead
Snowflake • Bellevue, WA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Sr. Director - AI Engineering
Salesforce, Inc. • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Senior Software Engineer, Applied AI (Seattle)
Evertune • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Design Systems Engineer : Scale Consistent UI
Grow Therapy • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Manager, Software Engineering - AI / ML
Supio • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote Mathematics Expert for AI Research & Training
Labelbox • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior AI Engineer, Risk Systems & AI Orchestration
SoFi • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Software Engineer, DevAI & AI Features (Remote)
Atlassian • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer
Robots and Pencils • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote C# Software Engineer - AI Trainer
SuperAnnotate • Everett, Washington, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [new]
Senior Platform & AI Systems Leader
Highspot • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_1_hour] • [promoted] • [new]
Staff ML Engineer, Agentic Systems (Remote‑Friendly)
anthropic • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote Senior AI Software Engineer (Contractor)
Turing • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Engines AI Program Execution & Design Implementation Lead
Blue Origin • Seattle, WA, United States
[job_card.permanent]
[last_updated.last_updated_30] • [promoted]
Senior Software Engineer, Agentic AI
Pacific Northwest National Laboratory • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]