Talent.com
Analytical Decision Reviewer
Analytical Decision ReviewerScale AI • Phoenix, Arizona, United States
Analytical Decision Reviewer

Analytical Decision Reviewer

Scale AI • Phoenix, Arizona, United States
[job_card.variable_hours_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Join a global community of talented professionals to shape the future of AI. Earn up to $15 USD / hr and additional rewards based on quality of submission.

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI , we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world , who help improve AI models by providing expert human feedback . This data has led to AI advancements for the world's leading AI labs and large language model builders.

We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.

What you will be doing

We are looking for someone who speaks fluent English to contribute their expertise toward training and refining cutting-edge AI systems.

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for.
  • Use the tool of rubrics to address user needs in a structured way.
  • Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What we’re looking for

  • Education : Bachelor’s degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.
  • Nice to Haves :

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.
  • Compensation and benefits

    Earn up to $15 USD / hr, paid out weekly

    Rates vary based on quality, accuracy, and time spent. Paid via PayPal & AirTM

    Free access to

    Model Playground

    Interact, experiment and engage with leading large language models free of cost

    Flexible schedule and

    time commitment

    No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours / week, up to 40 hours working from home

    Join a global community of

    Coding experts

    Join a global network of experts contributing to advanced AI tools

    Disclaimer : For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project.

    Equal Opportunity Employer : Outlier is committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.

    [job_alerts.create_a_job]

    Analytical Reviewer • Phoenix, Arizona, United States

    [internal_linking.similar_jobs]
    Retention Rep - High Earning Potential

    Retention Rep - High Earning Potential

    EchoStar • MARICOPA, Arizona, United States
    [job_card.full_time]
    Are you highly competitive, motivated by results, and looking for a role where your earning potential has no limits? Our award-winning Inside Sales & Retention teams excel at driving customer decis...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote PK / PD Module expert : Translational / Clinical Pharmacology Decision-Maker - AI Trainer ($175-$250 per hour)

    Remote PK / PD Module expert : Translational / Clinical Pharmacology Decision-Maker - AI Trainer ($175-$250 per hour)

    Mercor • Maricopa, Arizona, US
    [filters.remote]
    [job_card.full_time]
    The client is seeking an external expert who brings a • •decision-maker’s mindset • • — someone who has personally driven translational pharmacology choices under governance and uncertainty.Who we’re ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Inbound Retention Rep - Career Growth

    Inbound Retention Rep - Career Growth

    EchoStar • MARICOPA, Arizona, United States
    [job_card.full_time]
    Are you highly competitive, motivated by results, and looking for a role where your earning potential has no limits? Our award-winning Inside Sales & Retention teams excel at driving customer decis...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Model Behavior Reviewer (Remote)

    Model Behavior Reviewer (Remote)

    Scale AI • Phoenix, Arizona, United States
    [filters.remote]
    [job_card.full_time]
    Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted]
    Board Certified Behavior Analyst BCBA

    Board Certified Behavior Analyst BCBA

    Roman Empire ABA Agency, Inc. • Phoenix, AZ, US
    [job_card.full_time] +1
    We’re expanding our clinical team and actively seeking a passionate, team-oriented.Board Certified Behavior Analyst (BCBA). This is a great opportunity to work with an established agency provi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote SaaS Software Data Reviewer - AI Trainer ($30-$37 per hour)

    Remote SaaS Software Data Reviewer - AI Trainer ($30-$37 per hour)

    Mercor • Maricopa, Arizona, US
    [filters.remote]
    [job_card.part_time]
    Role Overview • •Mercor is looking for freelance contributors who are able to analyze the output of various B2B SAAS systems, ranging from Slack messages to Linear tickets to Salesforce entries.This ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote AI Content Reviewer

    Remote AI Content Reviewer

    Outlier • Scottsdale, AZ, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $16 USD / hourly and work remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the future of ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Behavioral Health Tech $17.50-$20 Hourly

    Behavioral Health Tech $17.50-$20 Hourly

    Human Care Services • Maricopa, AZ, US
    [job_card.full_time]
    BHTs play a critical role in delivering direct client / team support, meeting facilitation, compliance adherance and helping clients build the skills necessary for recovery and stability.Provide dire...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Risk Analyst

    Risk Analyst

    Robert Half • Phoenix, AZ, US
    [job_card.temporary]
    We are looking for a skilled Quality Assurance Analyst to join our team in Phoenix, Arizona.In this role, you will focus on ensuring quality and compliance in consumer investigations, with an empha...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Entry Product Support - No Experience

    Data Entry Product Support - No Experience

    GLOCPA • Maricopa, Arizona
    [job_card.full_time]
    We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.[show_more]
    [last_updated.last_updated_30] • [promoted]
    Deliver with Gopuff

    Deliver with Gopuff

    GoPuff • Paradise Valley, AZ, US
    [job_card.part_time] +1
    Deliver with Gopuff and get paid to deliver what your neighbors need from a Gopuff facility near you! With one centralized pickup location and smaller delivery zones, Gopuff makes earning effortles...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Lead Knowledge and Request Analyst

    Lead Knowledge and Request Analyst

    American Family Insurance • Phoenix, AZ, United States
    [job_card.full_time]
    The Team Lead for Knowledge and Request Management plays a crucial role in overseeing and guiding the team responsible for managing the organization's knowledge base and handling service requests e...[show_more]
    [last_updated.last_updated_30] • [promoted]
    CDL-A Regional Truck Driver - 3 Months Experience Required

    CDL-A Regional Truck Driver - 3 Months Experience Required

    C.R. England • Maricopa, AZ, US
    [job_card.full_time]
    If you an experienced solo CDL driver looking for a better carrier,.England, the premier long-haul refrigerated carrier in the country. This Regional fleet delivers no-touch freight to the lower 48 ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    CDL Truck Driver - Home Daily - Excellent Benefits and Equipment

    CDL Truck Driver - Home Daily - Excellent Benefits and Equipment

    C.R. England • Maricopa, AZ, US
    [job_card.full_time]
    England is Now Hiring Dedicated Local Drivers!.Dedicated Local Fleet - Competitive Pay - Full Benefits Package.Valid CDL-A and 3+ months of current experience required. This lane is not suitable for...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted]
    Elementary Educator

    Elementary Educator

    Phoenix Country Day School • Paradise Valley, AZ, US
    [job_card.full_time]
    Our program philosophy is that we seek to care for the whole child with passion and joy.Creating strong relationships with families is an integral component of the PCDS program, as we believe that ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Behavior Management Specialist EMPACT

    Behavior Management Specialist EMPACT

    La Frontera Center Inc. • Maricopa, AZ, US
    [job_card.full_time]
    EMPACT- Suicide Prevention Center, part of the La Frontera family, is an industry-leading non-profit organization dedicated to providing valued community services and resources for behavioral healt...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Data Annotation • Maricopa, Arizona
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Data Annotation • Maricopa, Arizona
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]