Talent.com
Problem-Solving Rater
Problem-Solving RaterScale AI • Washington, District of Columbia, United States
Problem-Solving Rater

Problem-Solving Rater

Scale AI • Washington, District of Columbia, United States
[job_card.variable_hours_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Join a global community of talented professionals to shape the future of AI. Earn up to $15 USD / hr and additional rewards based on quality of submission.

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI , we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world , who help improve AI models by providing expert human feedback . This data has led to AI advancements for the world's leading AI labs and large language model builders.

We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.

What you will be doing

We are looking for someone who speaks fluent English to contribute their expertise toward training and refining cutting-edge AI systems.

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for.
  • Use the tool of rubrics to address user needs in a structured way.
  • Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What we’re looking for

  • Education : Bachelor’s degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.

    • Nice to Haves :

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.

    • Compensation and benefits

    Earn up to $15 USD / hr, paid out weekly

    Rates vary based on quality, accuracy, and time spent. Paid via PayPal & AirTM

    Free access to

    Model Playground

    Interact, experiment and engage with leading large language models free of cost

    Flexible schedule and

    time commitment

    No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours / week, up to 40 hours working from home

    Join a global community of

    Coding experts

    Join a global network of experts contributing to advanced AI tools

    Disclaimer : For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project.

    Equal Opportunity Employer : Outlier is committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.

    [job_alerts.create_a_job]

    Rater • Washington, District of Columbia, United States

    [internal_linking.related_jobs]
    Travel Nurse RN - Case Manager - $2,200 to $2,326 per week in Baltimore, MD

    Travel Nurse RN - Case Manager - $2,200 to $2,326 per week in Baltimore, MD

    TravelNurseSource • Columbia, Maryland, US
    [job_card.full_time] +1
    TravelNurseSource is working with Lancesoft Inc to find a qualified Case Manager RN in Baltimore, Maryland, 21215!.Established in 2000, LanceSoft is a Certified MBE and Woman-Owned organization.We ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Echo Tech - $2,178 per week in La Plata, MD

    Travel Echo Tech - $2,178 per week in La Plata, MD

    Triage Staffing LLC • Columbia, Maryland, US
    [job_card.full_time]
    Travel Radiology : Echo Ultrasound La Plata.Shift Details : 9H Days (7 : 30 AM-5 : 00 PM).Length : 16 WEEKS 16 weeks.Apply for specific facility details.[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Trainer Systems Build Supervisor

    Trainer Systems Build Supervisor

    Leidos • Washington, DC, US
    [job_card.temporary]
    Join Our Innovative Team at Leidos!.Leidos is at the forefront of revolutionizing simulation, training, and analysis for the U. As part of our High Fidelity Simulation (HFS) Portfolio, we develop, i...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Home-Based Clinical Trial Contributor (Hiring Immediately)

    Home-Based Clinical Trial Contributor (Hiring Immediately)

    Maxion Research • Eldersburg, Maryland, US
    [filters.remote]
    [job_card.part_time]
    Join Our Part-Time Research Studies Today!.Are you eager to earn extra income from the comfort of your home? We are looking for motivated individuals to participate in paid research studies includi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Oracle ERP Applications Support Manager

    Oracle ERP Applications Support Manager

    Office of The Chief Financial Officer • Northern Virginia, VA, United States
    [job_card.full_time]
    Government of the District of Columbia.Office of the Chief Financial Officer (OCFO).ERP Applications Support Manager.This position is located in the Office of the Chief Financial Officer (OCFO), Of...[show_more]
    [last_updated.last_updated_30] • [promoted]
    TSCM Practitioner Support

    TSCM Practitioner Support

    Cintel Inc • Fort Belvoir, VA, US
    [job_card.full_time]
    Job Title : TSCM Practitioner Support.Conduct TSCM, Foreign Visit, Gift Inspection, Digital.Technical Evaluation activities and other technical operations supporting the NGA TSCM program, TSSC moder...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Case Manager (Supports Planner)

    Case Manager (Supports Planner)

    Service Coordination Inc • Columbia, Maryland, United States
    [job_card.full_time]
    Looking for a job working in your community and advocating for those underserved individuals? See Below!! • • Service Coordination, Inc. Supports Planners with a passion to serve and work within your ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Speech Language Pathologist (SLP) - $1,820 to $3,413 per week in Elkton, MD

    Travel Speech Language Pathologist (SLP) - $1,820 to $3,413 per week in Elkton, MD

    CompHealth • Columbia, Maryland, US
    [job_card.full_time]
    When it comes to finding the perfect locums assignment, sometimes it is all about who you know.CompHealth has been around for a long time and have a vast network of connections to facilities across...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Speech Language Pathologist (SLP) - $2,070 per week in Salisbury, MD

    Travel Speech Language Pathologist (SLP) - $2,070 per week in Salisbury, MD

    Core Medical Group • Columbia, Maryland, US
    [job_card.full_time]
    Experience Required / New Grad Friendly : .Maryland & Delaware Licensure needed.Can start with one of the two pending.Just 30 minutes from Ocean City's beaches and about 2 hours from Baltimore, D...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Speech Language Pathologist (SLP) in Rockville, MD

    Travel Speech Language Pathologist (SLP) in Rockville, MD

    Titan Medical Group • Columbia, Maryland, US
    [job_card.full_time]
    Travel - Speech Language Pathologist.Titan Medical is looking for travelers to fill a Travel Speech Language Pathologist position for a 13 week assignment in Hunt Valley, MD! Call Titan for additio...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Speech Language Pathologist (SLP) - $2,603 to $2,853 per week in Elkton, MD

    Travel Speech Language Pathologist (SLP) - $2,603 to $2,853 per week in Elkton, MD

    AMN Healthcare Allied • Columbia, Maryland, US
    [job_card.full_time]
    Job Description & Requirements.School Psychologist (PSY) - School - (PSY - School) .StartDate : ASAP Available Shifts : 7. AMN Healthcare is partnering with a top school district in Elkton, MD to...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Appliance Repair Technician

    Senior Appliance Repair Technician

    Landers Appliance • Sykesville, MD, US
    [job_card.full_time]
    For skilled techs who want strong pay, high standards, and a company that actually cares.Landers Appliance has delivered award-winning service in Maryland for 43 years, including Baltimores Best Pl...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Cardiology PA - Outpatient Focused - No Call / No Weekends

    Cardiology PA - Outpatient Focused - No Call / No Weekends

    SSM Health • Mount Vernon, US
    [job_card.full_time]
    SSM Health is an Equal Opportunity Employer : .SSM-Southern Illinois is seeking an experienced Cardiology Advanced Practitioner (PA) at Good Samaritan Hospital in Mt. Practice at a brand-new stat...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Senior / Staff Code Review Experts - AI Trainer ($40-$125 per hour)

    Remote Senior / Staff Code Review Experts - AI Trainer ($40-$125 per hour)

    Mercor • Rockville, Maryland, US
    [filters.remote]
    [job_card.full_time]
    Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp expe...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Speech Language Pathologist (SLP) in Rockville, MD

    Travel Speech Language Pathologist (SLP) in Rockville, MD

    AlliedTravelNetwork • Columbia, Maryland, US
    [job_card.full_time]
    AlliedTravelNetwork is working with Titan Medical Group to find a qualified Speech Language Pathologist (SLP) in Rockville, Maryland, 20855!. Travel - Speech Language Pathologist.Titan Medical is lo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Utility Monitoring Services Supervisor

    Utility Monitoring Services Supervisor

    RJY Group, LLC • Washington, DC, United States
    [job_card.temporary]
    The Supervisor oversees all stationary engineers assigned to the 24 / 7 monitoring and inspection program.This role ensures compliance with. The Supervisor is responsible for scheduling, training, tec...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel CT Tech - $2,901 per week in La Plata, MD

    Travel CT Tech - $2,901 per week in La Plata, MD

    AlliedTravelCareers • Columbia, Maryland, US
    [job_card.full_time]
    AlliedTravelCareers is working with Windsor Healthcare Recruitment Group, Inc.CT Tech in La Plata, Maryland, 20646!.CT Tech - 3x12 Nights, block weekend only scheduling 1YR experience required; fir...[show_more]
    [last_updated.last_updated_30] • [promoted]
    IRS Technical Lead

    IRS Technical Lead

    Nationwide IT Services • Lanham, MD, United States
    [job_card.full_time]
    IRS New Carrollton Federal Building (NCFB).DevOps and Cloud Certifications preferred.Nationwide IT Services (NIS) is seeking a qualified Technical Lead for a potential opportunity with the Internal...[show_more]
    [last_updated.last_updated_30] • [promoted]