Talent.com
LLM Response Reviewer (Remote)_
LLM Response Reviewer (Remote)_Scale AI • Indianapolis, IN, United States
[error_messages.no_longer_accepting]
LLM Response Reviewer (Remote)_

LLM Response Reviewer (Remote)_

Scale AI • Indianapolis, IN, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters.remote]
[job_card.job_description]

Join a global community of talented professionals to shape the future of AI. Earn up to $15 USD / hr and additional rewards based on quality of submission.

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI , weve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data its trained on. Thats why we work with contributors from all over the world , who help improve AI models by providing expert human feedback . This data has led to AI advancements for the world's leading AI labs and large language model builders.

Weve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.

What you will be doing

We are looking for someone who speaks fluent English to contribute their expertise toward training and refining cutting-edge AI systems.

  • Adopt a user mindset to produce natural data to meet the realistic needs you have or would use AI for.
  • Use the tool of rubrics to address user needs in a structured way.
  • Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What were looking for

  • Education : Bachelors degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.
  • Nice to Haves :

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.
  • Compensation and benefits

    Earn up to $15 USD / hr, paid out weekly

    Rates vary based on quality, accuracy, and time spent. Paid via PayPal & AirTM

    Free access to

    Model Playground

    Interact, experiment and engage with leading large language models free of cost

    Flexible schedule and

    time commitment

    No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours / week, up to 40 hours working from home

    Join a global community of

    Coding experts

    Join a global network of experts contributing to advanced AI tools

    Disclaimer : For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project.

    Equal Opportunity Employer : Outlier is committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.

    [job_alerts.create_a_job]

    Reviewer Remote • Indianapolis, IN, United States

    [internal_linking.similar_jobs]
    Mental Health Therapist - Telehealth (Unrestricted License LCSW, LMFT, LMHC - Indiana)

    Mental Health Therapist - Telehealth (Unrestricted License LCSW, LMFT, LMHC - Indiana)

    Lyra Health Inc • INDIANAPOLIS, Indiana, United States
    [job_card.full_time]
    Lyra is transforming mental health care through technology with a human touch to help people feel emotionally healthy at work and at home. We work with industry leaders, such as Morgan Stanley, Uber...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote Customer Support Associate

    Remote Customer Support Associate

    TurboTax • Columbus, Indiana
    [filters.remote]
    [job_card.full_time]
    Work from home with TurboTax Product Expert.Get a $405 Certification bonus³.Work from home & set your own flexible schedule between 8am EST and 12am midnight EST Monday to Sunday⁴.Earn an ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Training Data Reviewer (Remote)

    AI Training Data Reviewer (Remote)

    Scale AI • Indianapolis, Indiana, United States
    [filters.remote]
    [job_card.full_time]
    Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    NMLS Licensed Mortgage Loan Coordinator

    NMLS Licensed Mortgage Loan Coordinator

    VirtualVocations • Southport, Indiana, United States
    [job_card.full_time]
    A company is looking for a Mortgage Loan Coordinator (Remote Opportunity).Key Responsibilities Schedules customer application appointments for Mortgage Loan Originators Handles routine and compl...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Reimbursement Analyst

    Reimbursement Analyst

    VirtualVocations • Southport, Indiana, United States
    [job_card.full_time]
    A company is looking for a Reimbursement Analyst (Remote).Key Responsibilities Analyze claims data and perform financial analyses to provide recommendations on reimbursement models Review and pa...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Virtual LMFT

    Virtual LMFT

    Headway • Indianapolis, IN, US
    [job_card.full_time]
    Licensed Marriage and Family Therapist (LMFT) Wage : Between $90-$127 an hour Licensed Marriage and Family Therapist — Are you ready to launch or expand your private practice? Headway is here to ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Registration / Disclosure Processor

    Registration / Disclosure Processor

    Northwest Bank • Fishers, IN, United States
    [job_card.full_time]
    The Registration / Disclosure Desk Processor is responsible to monitor the overall registration / disclosure process from start to finish, while also providing accurate and appropriate disclosures to c...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Labor and Delivery RN

    Travel Labor and Delivery RN

    American Traveler • Fishers, IN, US
    [job_card.full_time]
    American Traveler is seeking a travel nurse RN Labor and Delivery for a travel nursing job in Fishers, Indiana.Job Description & Requirements. American Traveler is seeking an experienced RN for ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel MRI Tech - $2256.25 / Week

    Travel MRI Tech - $2256.25 / Week

    Host Healthcare • Noblesville, IN, US
    [job_card.full_time]
    Host Healthcare is seeking an experienced MRI Tech for an exciting Travel Allied job in Noblesville, IN.Shift : Inquire Start Date : 01 / 05 / 2026 Duration : 14 weeks Pay : $2256.At Host Healthcare, we ar...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel MRI Tech - $2,535 per week in Bloomington, IN

    Travel MRI Tech - $2,535 per week in Bloomington, IN

    AlliedTravelCareers • Indianapolis, Indiana, US
    [job_card.full_time] +1
    AlliedTravelCareers is working with Lancesoft Inc.MRI Tech in Bloomington, Indiana, 47408!.Established in 2000, LanceSoft is a Certified MBE and Woman-Owned organization. We have been recognized as ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote FP&A Manager – AI Trainer ($50-$60 / hour)

    Remote FP&A Manager – AI Trainer ($50-$60 / hour)

    Data Annotation • Columbus, Indiana
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Customer Care Associate

    Remote Customer Care Associate

    TurboTax • Columbus, Indiana
    [filters.remote]
    [job_card.full_time]
    Work from home with TurboTax Product Expert.Get a $405 Certification bonus³.Work from home & set your own flexible schedule between 8am EST and 12am midnight EST Monday to Sunday⁴.Earn an ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Director, Engineering - Data Breach Response

    Director, Engineering - Data Breach Response

    Relativity • Indianapolis, IN, United States
    [job_card.full_time]
    Relativity is a leading company in AI-powered data intelligence for the legal industry.Our cloud platform helps organizations worldwide manage investigations, lawsuits, and compliance efficiently.R...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Provider Reimbursement Manager

    Provider Reimbursement Manager

    Indianapolis Staffing • Indianapolis, IN, US
    [job_card.full_time]
    Provider Reimbursement Manager.This role requires associates to be in-office 1 - 2 days per week, fostering collaboration and connectivity, while providing flexibility to support productivity and w...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Data Annotation • Columbus, Indiana
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Text Reviewer (Remote)

    Text Reviewer (Remote)

    Scale AI • Indianapolis, Indiana, United States
    [filters.remote]
    [job_card.full_time]
    Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote LMFT

    Remote LMFT

    Headway • Indianapolis, IN, US
    [filters.remote]
    [job_card.full_time]
    Licensed Marriage and Family Therapist (LMFT) Wage : Between $90-$127 an hour Licensed Marriage and Family Therapist — Are you ready to launch or expand your private practice? Headway is here to ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Licensed Property & Casualty Insurance Agent - Remote USA

    Licensed Property & Casualty Insurance Agent - Remote USA

    TTEC • Cicero, Indiana, US
    [filters.remote]
    [job_card.full_time]
    Licensed Property & Casualty Insurance Agent - Remote USA Your potential has a place here with TTEC’s award-winning employment experience. As a Licensed Property & Casualty Insurance Agent working r...[show_more]
    [last_updated.last_updated_1_day] • [promoted]