Remote Software Engineering & Systems Design Expert - AI Trainer ($45-$80 per hour)Mercor • Marysville, Washington, US
Remote Software Engineering & Systems Design Expert - AI Trainer ($45-$80 per hour)
Mercor • Marysville, Washington, US
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
- [job_card.part_time]
- [filters.remote]
[job_card.job_description]Location : N / A Type : Full-time or Part-time Contract Work Fluent Language Skills Required : English Why This Role Exists Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. In coding and software engineering contexts, conversational AI systems must demonstrate correct reasoning, strong problem-solving ability, and adherence to real-world engineering best practices. This project focuses on evaluating and improving how models reason about code, generate solutions, and explain technical concepts across a variety of programming tasks and complexity levels. What You’ll Do Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness - Conduct fact-checking using trusted public sources and authoritative references - Conduct accuracy testing by executing code and validating outputs using appropriate tools Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies - Assess code quality, readability, algorithmic soundness, and explanation quality - Ensure model responses align with expected conversational behavior and system guidelines - Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines Who You Are You hold a BS, MS, or PhD in Computer Science or a closely related field You have significant real-world experience in software engineering or related technical roles - You are an expert in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust) You are able to solve HackerRank or LeetCode Medium and Hard–level problems independently You have experience contributing to well-known open-source projects, including merged pull requests - You have significant experience using LLMs while coding and understand their strengths and failure modes - You have strong attention to detail and are comfortable evaluating complex technical reasoning , identifying subtle bugs or logical flaws Nice-to-Have Specialties Prior experience with RLHF, model evaluation, or data annotation work - Track record in competitive programming - Experience reviewing code in production environments - Familiarity with multiple programming paradigms or ecosystems - Experience explaining complex technical concepts to non-expert audiences What Success Looks Like You identify incorrect logic, inefficiencies, edge cases, or misleading explanations in model-generated code, technical concepts, and system design discussions - Your feedback improves the correctness, robustness, and clarity of AI coding outputs - You deliver reproducible evaluation artifacts that strengthen model performance - Mercor customers trust AI systems to assist reliably with real-world coding tasks Why Join Mercor At Mercor, experienced software engineers play a direct role in shaping how AI systems reason about and generate code. This flexible, remote role allows you to apply your technical expertise to high-impact AI development work, improving systems used by developers around the world.
[job_alerts.create_a_job]
Remote Software Engineering Systems Design Expert AI Trainer 4580 per hour • Marysville, Washington, US
[internal_linking.similar_jobs]
A leading video conference company is seeking a Principal AI Architect to design and oversee the development of Agentic AI systems.
You will shape user experience through robust frameworks and estab...[show_more]
Software Engineering Manager, Quantum Product, Quantum AI.Join to apply for the Software Engineering Manager, Quantum Product, Quantum AI role at Google.
Note : By applying to this position you will ...[show_more]
A company is looking for a Manager, AI Enablement & Internal Systems.Key Responsibilities Design, build, and manage internal AI tools and agents for team support Own and improve internal AI syst...[show_more] A company is looking for a Curriculum Developer : AWS Certified AI Practitioner.Key Responsibilities Review and advise on the proposed curriculum outline for AIF-C01 exam domains Develop instruct...[show_more] 
A leading technology firm is seeking a Senior Design Engineer to enhance user experience in their innovative team.This role involves designing exceptional interfaces, building components collaborat...[show_more]
PLEASE NOTE : At this time, we are only able to consider candidates who are authorized to work in the United States without the need for current or future visa sponsorship.Evertune is building the f...[show_more]
Build software for UUVs that navigate in the dark, think independently, and must complete the mission.Leidos is looking for an Autonomous Systems Software Engineer to help build the brains behind n...[show_more]
A leading design and engineering firm is seeking a Design Engineer in San Francisco to build scalable design systems and high-quality components for consumer-grade product experiences.The ideal can...[show_more]
A leading AI solutions provider seeks a Mathematics Expert to develop and solve complex mathematical problems for AI model enhancement.
This remote role requires a Master’s or PhD in Mathematics and...[show_more]
A leading research accelerator in AI is seeking experienced software engineers to evaluate AI-generated code and enhance coding solutions.
Candidates should have over 5 years of software engineering...[show_more]
A leading financial services company located in Seattle seeks a Senior AI Software Engineer for Risk Engineering.This key position involves building and optimizing scalable applications that levera...[show_more]
A leading software company in Seattle is looking for an expert to innovate core intelligence solutions within its DevAI products.
This pivotal role involves LLM integration and developing AI feature...[show_more]
As a Senior C Engineer, you will work remotely on an hourly paid basis to review AI-generated C code, low-level systems designs, and technical explanations, as well as generate high-quality referen...[show_more] A leading AI research accelerator is looking for an experienced software engineer to evaluate and refine AI-generated code and collaborate with teams to enhance AI-driven coding solutions.Candidate...[show_more] 
A leading AI research partner is seeking specialists to draft organized logical logs and generate training datasets for advanced AI models.
This remote role emphasizes collaboration with top AI team...[show_more] Senior AI Software Engineer Manager, Risk Engineering.Be among the first 25 applicants.This range is provided by SoFi.Your actual pay will be based on your skills and experience — talk with your re...[show_more] 
Applications will be accepted on an ongoing basis until the requisition is closed.At Blue Origin, we envision millions of people living and working in space for the benefit of Earth.We're working t...[show_more]
Meta Superintelligence Labs - Infra : Optimizations Team.Meta is seeking hands-on engineering managers to join the Meta SuperIntelligence Lab (MSL), making direct contributions to the next generatio...[show_more]
Lead AI Architect : Agentic Systems (Remote / Hybrid)
Zoom Video Communications • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Software Engineering Manager, Quantum Product, Quantum AI
Google • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Manager of AI Systems
VirtualVocations • Everett, Washington, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
AWS Certified AI Practitioner Developer
VirtualVocations • Everett, Washington, United States
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
Senior Design Engineer : AI UI & Design Systems Lead
Snowflake • Bellevue, WA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Software Engineer, Applied AI (Seattle)
Evertune • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Autonomous Systems Software Engineer
Leidos Inc • Lynnwood, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Design Systems Engineer : Scale Consistent UI
Grow Therapy • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote Mathematics Expert for AI Research & Training
Labelbox • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote Senior AI Software Engineer (Contract)
Turing • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior AI Engineer, Risk Systems & AI Orchestration
SoFi • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Software Engineer, DevAI & AI Features (Remote)
Atlassian • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Senior C Engineer - AI Trainer
SuperAnnotate • Marysville, Washington, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30]
Remote Senior AI Software Engineer (Contractor)
Turing • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote ML Engineer & AI Reasoning Trainer
Alignerr • Seattle, WA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior AI Software Engineer Manager, Risk Engineering
SoFi • Seattle, WA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Engines AI Program Execution & Design Implementation Lead
Blue Origin • Seattle, WA, United States
[job_card.permanent]
[last_updated.last_updated_30] • [promoted]
Software Engineering Manager - Meta Superintelligence Labs - Infra : Optimizations Team
Veterans Staffing • Bellevue, WA, US
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]