Talent.com
Problem-Solving Rater
Problem-Solving RaterScale AI • Dallas, Texas, United States
[error_messages.no_longer_accepting]
Problem-Solving Rater

Problem-Solving Rater

Scale AI • Dallas, Texas, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Join a global community of talented professionals to shape the future of AI. Earn up to $15 USD / hr and additional rewards based on quality of submission.

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI , we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world , who help improve AI models by providing expert human feedback . This data has led to AI advancements for the world's leading AI labs and large language model builders.

We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.

What you will be doing

We are looking for someone who speaks fluent English to contribute their expertise toward training and refining cutting-edge AI systems.

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for.
  • Use the tool of rubrics to address user needs in a structured way.
  • Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What we’re looking for

  • Education : Bachelor’s degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.
  • Nice to Haves :

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.
  • Compensation and benefits

    Earn up to $15 USD / hr, paid out weekly

    Rates vary based on quality, accuracy, and time spent. Paid via PayPal & AirTM

    Free access to

    Model Playground

    Interact, experiment and engage with leading large language models free of cost

    Flexible schedule and

    time commitment

    No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours / week, up to 40 hours working from home

    Join a global community of

    Coding experts

    Join a global network of experts contributing to advanced AI tools

    Disclaimer : For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project.

    Equal Opportunity Employer : Outlier is committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.

    [job_alerts.create_a_job]

    Rater • Dallas, Texas, United States

    [internal_linking.similar_jobs]
    Interventional Rad Tech

    Interventional Rad Tech

    Parkland Health and Hospital System • Plano, Texas, United States
    [job_card.full_time]
    Interested in a career with both meaning and growth? Whether your abilities are in direct patient care or one of the many other areas of healthcare administration and support, everyone at Parkland ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    ECR Dispute Reviewer

    ECR Dispute Reviewer

    Zelis Healthcare, LLC • Plano, TX, United States
    [job_card.full_time]
    Zelis is modernizing the healthcare financial experience across payers, providers, and healthcare consumers.We serve more than 750 payers, including the top five national health plans, regional hea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Facilities Setup and Custodial Tech

    Facilities Setup and Custodial Tech

    The Heights Church • Richardson, TX, US
    [job_card.full_time]
    Perform custodial and event set-up services.Model a Growing and Vibrant Relationship with Christ.Pursue full devotion to Christ and live the life we are inviting others to live.Manifest the fruit o...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Rapid Response- RN ED

    Rapid Response- RN ED

    LanceSoft • Dallas, TX, United States
    [job_card.full_time]
    Pay : $3505 weekly gross for 48 hrs.POSITION : RAPID RESPONSE- RN ER.JOB DESCRIPTION / REQUIREMENTS : .REQ'D : BLS, ACLS, PALS, NIH, TNCC- must need. If anyone interested, please share your updated resum...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    CT Tech, PRN, Rotating

    CT Tech, PRN, Rotating

    Texas Health Resources • Allen, TX, US
    [job_card.full_time]
    Bring your passion to Texas Health so we are Better + Together.Work location : Texas Health Allen 1105 Central Expwy North TX 75013. PRN (as needed), with a rotating schedule.Minimum requirement of t...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Paid Incident and Problem Specialist Training!

    Paid Incident and Problem Specialist Training!

    TEKsystems • Dallas, TX, United States
    [job_card.temporary]
    TEKsystems is a leader in IT solutions and is working with a top American bank holding company and financial services corporation to run a Paid 10. Incident and Problem Specialist!.Locations : Pittsb...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Wraparound Supervisor

    Wraparound Supervisor

    CFGC • Dallas, TX, US
    [job_card.full_time]
    Child and Family Guidance Center is hiring a Wraparound Supervisor for the Dallas- Harry Hines location.The position of Wraparound Supervisor provides day-to-day supervision, coaching, and oversigh...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Solutions Architect

    Software Solutions Architect

    Startekk Inc • Plano, Texas, USA
    [job_card.full_time]
    Health Enterprise Service Bus (HESB).The role focuses on message tracking system integrations and secure data exchange across healthcare systems. Design and develop healthcare integration solutions....[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer, Core Experiences - Garland, USA

    Senior Software Engineer, Core Experiences - Garland, USA

    Speechify • Garland, TX, US
    [job_card.full_time]
    Speechify is the easiest way to listen to the world's information.Articles on the web, documents in the cloud, books on your phone. We absorb it all and let you listen to it at your desk, on the...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Oracle Apps DBA

    Oracle Apps DBA

    Siri InfoSolutions Inc • Plano, Texas, USA
    [job_card.full_time]
    I had a chance to review your profile and wanted to discuss a full-time hire position with our client a major Systems Integrator. Please review the JD below and let me know if you would be intereste...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Associate Principal, Software Engineering : Software Development Test (SDET)

    Lead Associate Principal, Software Engineering : Software Development Test (SDET)

    The Options Clearing Corporation • Dallas, TX, United States
    [job_card.full_time]
    Senior Engineer with deep experience in testing Kafka-based event-driven architectures, Spring boot microservices and writing salable automation framework using Java and cucumber.This role works cl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Survey Team Leader

    Survey Team Leader

    TNP • Allen, TX, US
    [job_card.full_time]
    TNP has an immediate opening in our Allen office for an experienced R.Team Leader to join an established survey team.This position is responsible for project planning, scheduling, and maintaining c...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Neurologist Is Needed for Locums Help in TX

    Neurologist Is Needed for Locums Help in TX

    HealthEcareers - Client • Dallas, TX, USA
    [job_card.full_time]
    If this telehealth opportunity sounds right for you, give us a call today to speak with an expert Weatherby consultant for details. Vascular fellowship highly preferred.EEG experience highly preferr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Application Support

    Application Support

    Akkodis • Plano, TX, US
    [job_card.full_time]
    Charlotte, NC / Plano, TX / Kennesaw, GA(Hybrid).Responsibilities include monitoring applications to ensure 100% SLA compliance and preparing Root Cause Analysis (RCA) documents.The rate may be negoti...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Pediatric Float Pool RN in Rowlett, TX

    Pediatric Float Pool RN in Rowlett, TX

    Vivian Health • Rowlett, TX, United States
    [job_card.full_time] +1
    K Sign Bonus may be Available for New Candidates .Specific Work Schedule Required.Do you want to join an organization that invests in you as an RN Pediatrics Super Pool? At Medical City Dallas, you...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Identity Access Management (IAM) Lead / Architect

    Identity Access Management (IAM) Lead / Architect

    Krest Global Solutions • Dallas, TX, US
    [job_card.full_time]
    Hiring : Identity Access Management (IAM) Lead / Architect – Contract (Onsite / Hybrid, Plano, TX) •.Years (with strong IAM architecture & development background).IAM Architecture & Design ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Integration & Test Engineering Spring 2026 Co-Op (Dallas, TX)

    Integration & Test Engineering Spring 2026 Co-Op (Dallas, TX)

    Shield AI • Dallas, TX, US
    [job_card.full_time] +1
    Founded in 2015, Shield AI is a venture-backed deep-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include the V-BAT and X-BAT aircr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    DSH / S10 Solution Expert

    DSH / S10 Solution Expert

    FinThrive • Plano, TX, United States
    [job_card.full_time]
    The Senior Solution Expert with FinThrive plays a crucial role in coordinating knowledge and expertise across key departments. They work with operations to optimize efficiency and productivity, ensu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]