Remote Software Engineering & Systems Design Expert - AI Trainer ($45-$80 per hour)Mercor • Marysville, Washington, US

Remote Software Engineering & Systems Design Expert - AI Trainer ($45-$80 per hour)

Mercor • Marysville, Washington, US

[job_card.variable_days_ago]

[job_preview.job_type]

[job_card.full_time]

[job_card.part_time]

[filters.remote]

[job_card.job_description]

Location :

N / A

Type

: Full-time or Part-time Contract Work

Fluent Language Skills Required :

English

Why This Role Exists

Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. In coding and software engineering contexts, conversational AI systems must demonstrate correct reasoning, strong problem-solving ability, and adherence to real-world engineering best practices. This project focuses on evaluating and improving how models reason about code, generate solutions, and explain technical concepts across a variety of programming tasks and complexity levels.

What You’ll Do

Evaluate LLM-generated responses

to coding and software engineering queries for accuracy, reasoning, clarity, and completeness -

Conduct fact-checking

using trusted public sources and authoritative references - Conduct accuracy testing by

executing code and validating outputs using appropriate tools

Annotate model responses

by identifying strengths, areas of improvement, and factual or conceptual inaccuracies - Assess code quality, readability, algorithmic soundness, and explanation quality - Ensure

model responses align with expected conversational behavior

and system guidelines -

Apply consistent evaluation standards

by following clear taxonomies, benchmarks, and detailed evaluation guidelines

Who You Are

You hold a

BS, MS, or PhD in Computer Science or a closely related field

You have

significant real-world experience in software engineering

or related technical roles - You are an expert in at

least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust)

You are able to solve

HackerRank or LeetCode Medium and Hard–level problems independently

You have experience contributing to well-known open-source projects, including merged pull requests - You have

significant experience using LLMs while coding

and understand their strengths and failure modes -

You have strong attention to detail

and are

comfortable evaluating complex technical reasoning

, identifying subtle bugs or logical flaws

Nice-to-Have Specialties

Prior experience with RLHF, model evaluation, or data annotation work - Track record in competitive programming - Experience reviewing code in production environments - Familiarity with multiple programming paradigms or ecosystems - Experience explaining complex technical concepts to non-expert audiences

What Success Looks Like

You identify incorrect logic, inefficiencies, edge cases, or misleading explanations in model-generated code, technical concepts, and system design discussions - Your feedback improves the correctness, robustness, and clarity of AI coding outputs - You deliver reproducible evaluation artifacts that strengthen model performance - Mercor customers trust AI systems to assist reliably with real-world coding tasks

Why Join Mercor

At Mercor, experienced software engineers play a direct role in shaping how AI systems reason about and generate code. This flexible, remote role allows you to apply your technical expertise to high-impact AI development work, improving systems used by developers around the world.

[job_alerts.create_a_job]

Remote Software Engineering Systems Design Expert AI Trainer 4580 per hour • Marysville, Washington, US

[internal_linking.similar_jobs]

Lead AI Architect : Agentic Systems (Remote / Hybrid)

Zoom Video Communications • Seattle, WA, United States

[filters.remote]

[job_card.full_time]

A leading video conference company is seeking a Principal AI Architect to design and oversee the development of Agentic AI systems. You will shape user experience through robust frameworks and estab...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Senior Design Engineer : AI UI & Design Systems Lead

Snowflake • Bellevue, WA, United States

[job_card.full_time]

A leading technology firm is seeking a Senior Design Engineer to enhance user experience in their innovative team.This role involves designing exceptional interfaces, building components collaborat...[show_more]

[last_updated.last_updated_30] • [promoted]

Software Engineering Manager, Generative AI

Google Inc. • Seattle, WA, United States

[job_card.full_time]

Software Engineering Manager, Generative AI.Google Seattle, WA, USA; Kirkland, WA, USA.In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is avai...[show_more]

[last_updated.last_updated_variable_hours] • [promoted]

Senior Software Engineer, Applied AI (Seattle)

Evertune • Seattle, WA, United States

[job_card.full_time]

PLEASE NOTE : At this time, we are only able to consider candidates who are authorized to work in the United States without the need for current or future visa sponsorship.Evertune is building the f...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Sr. Director - AI Engineering

Salesforce • Seattle, WA, United States

[job_card.full_time]

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category : Software Engineering.About Salesforc...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Senior Director, AI-Driven Software Engineering

Salesforce • Seattle, WA, United States

[job_card.full_time]

A leading tech company in Seattle is seeking a Director of Engineering to lead large-scale software engineering efforts.The ideal candidate will have over 12 years of software engineering experienc...[show_more]

[last_updated.last_updated_1_day] • [promoted]

Remote M&A Associate - AI Trainer ($50-$60 / hour)

Data Annotation • Everett, Washington

[filters.remote]

[job_card.full_time] +1

We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]

[last_updated.last_updated_30] • [promoted]

Autonomous Systems Software Engineer

Leidos Inc • Lynnwood, WA, United States

[job_card.full_time]

Build software for UUVs that navigate in the dark, think independently, and must complete the mission.Leidos is looking for an Autonomous Systems Software Engineer to help build the brains behind n...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Remote Principal Software Architect for AI-Driven Retail

Toshiba Global Commerce Solutions - External • Seattle, WA, United States

[filters.remote]

[job_card.full_time]

A leading retail solutions provider is looking for a Principal Software Architect to lead solution delivery for major retail platforms. The role primarily involves AI-assisted development, architect...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Remote Mathematics Expert for AI Research & Training

Labelbox • Seattle, WA, United States

[filters.remote]

[job_card.full_time]

A leading AI solutions provider seeks a Mathematics Expert to develop and solve complex mathematical problems for AI model enhancement. This remote role requires a Master’s or PhD in Mathematics and...[show_more]

[last_updated.last_updated_30] • [promoted]

Senior AI Engineer, Risk Systems & AI Orchestration

SoFi • Seattle, WA, United States

[job_card.full_time]

A leading financial services company located in Seattle seeks a Senior AI Software Engineer for Risk Engineering.This key position involves building and optimizing scalable applications that levera...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Senior Software Engineer, DevAI & AI Features (Remote)

Atlassian • Seattle, WA, United States

[filters.remote]

[job_card.full_time]

A leading software company in Seattle is looking for an expert to innovate core intelligence solutions within its DevAI products. This pivotal role involves LLM integration and developing AI feature...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Remote Senior AI Software Engineer (Contractor)

Turing • Seattle, WA, United States

[filters.remote]

[job_card.full_time]

A leading AI research accelerator is looking for an experienced software engineer to evaluate and refine AI-generated code and collaborate with teams to enhance AI-driven coding solutions.Candidate...[show_more]

[last_updated.last_updated_30] • [promoted]

Remote ML Engineer & AI Reasoning Trainer

Alignerr • Seattle, WA, United States

[filters.remote]

[job_card.full_time]

A leading AI research partner is seeking specialists to draft organized logical logs and generate training datasets for advanced AI models. This remote role emphasizes collaboration with top AI team...[show_more]

[last_updated.last_updated_30] • [promoted]

Software Engineering Manager, Computer Vision

Seattle Staffing • Seattle, WA, US

[job_card.full_time]

Engineering Manager Opportunity At Meta Reality Labs.Meta Reality Labs seeks an experienced Engineering Manager to build the future. Our team values innovation, collaboration, and proven technical e...[show_more]

[last_updated.last_updated_variable_hours] • [promoted] • [new]

Design-Focused Software Engineer

Firstmate • Seattle, Washington, United States

[job_card.full_time]

Design-Focused Software Engineer.We need an AI-first developer to help us revolutionize the service economy in the US.You should be an outlier who has fully bought into AI-first development.You sho...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Electronic Systems Design and Analysis Engineer (Entry-Level or Associate)

Boeing • Everett, WA, US

[job_card.full_time] +1

At Boeing, we innovate and collaborate to make the world a better place.We’re committed to fostering an environment for every teammate that’s welcoming, respectful and inclusive, with great opportu...[show_more]

[last_updated.last_updated_variable_hours] • [promoted] • [new]

Remote AI-Driven Senior Software Engineer (Contractor)

Turing • Seattle, WA, United States

[filters.remote]

[job_card.full_time]

A leading AI research accelerator is seeking a Contractor to evaluate and refine AI-generated code, collaborate with teams, and design verification mechanisms. The ideal candidate has at least 5 yea...[show_more]

[last_updated.last_updated_30] • [promoted]