Talent.com
LLM Response Reviewer (Remote)_
LLM Response Reviewer (Remote)_Scale AI • Philadelphia, Pennsylvania, United States
LLM Response Reviewer (Remote)_

LLM Response Reviewer (Remote)_

Scale AI • Philadelphia, Pennsylvania, United States
[job_card.variable_hours_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters.remote]
[job_card.job_description]

Join a global community of talented professionals to shape the future of AI. Earn up to $15 USD / hr and additional rewards based on quality of submission.

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI , we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world , who help improve AI models by providing expert human feedback . This data has led to AI advancements for the world's leading AI labs and large language model builders.

We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.

What you will be doing

We are looking for someone who speaks fluent English to contribute their expertise toward training and refining cutting-edge AI systems.

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for.
  • Use the tool of rubrics to address user needs in a structured way.
  • Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What we’re looking for

  • Education : Bachelor’s degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.
  • Nice to Haves :

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.
  • Compensation and benefits

    Earn up to $15 USD / hr, paid out weekly

    Rates vary based on quality, accuracy, and time spent. Paid via PayPal & AirTM

    Free access to

    Model Playground

    Interact, experiment and engage with leading large language models free of cost

    Flexible schedule and

    time commitment

    No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours / week, up to 40 hours working from home

    Join a global community of

    Coding experts

    Join a global network of experts contributing to advanced AI tools

    Disclaimer : For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project.

    Equal Opportunity Employer : Outlier is committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.

    [job_alerts.create_a_job]

    Reviewer Remote • Philadelphia, Pennsylvania, United States

    [internal_linking.related_jobs]
    Entry Level Sales Reps - Part Time - Paid Weekly

    Entry Level Sales Reps - Part Time - Paid Weekly

    Vector Marketing • Doylestown, PA, US
    [job_card.full_time] +1
    Vector Marketing, who has been around for over 40 years, is currently interviewing for part time sales positions.Basic responsibilities include working with customers through appointments, selling ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Claim Specialist - Property Field Inspection

    Claim Specialist - Property Field Inspection

    State Farm • Langhorne, PA, United States
    [job_card.full_time]
    Being good neighbors - helping people, investing in our communities, and making the world a better place - is who we are at State Farm. It is at the core of how we operate and the reason for our suc...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Manager, Client Services

    Manager, Client Services

    Syneos Health / inVentiv Health Commercial LLC • Newtown, PA, United States
    [job_card.full_time]
    You're driven, resourceful, and above all else - remarkably smart.You will be responsible for building a trusted relationship with the customer contacts as well as becoming the.Syneos Health accoun...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel MRI Tech - $2,236 to $2,479 per week in Turnersville, NJ

    Travel MRI Tech - $2,236 to $2,479 per week in Turnersville, NJ

    LRS Healthcare • Turnersville, NJ, US
    [job_card.full_time]
    Ready to start your next travel adventure? LRS Healthcare offers a full benefits package, 24 / 7 support, and a responsive, traveler-first culture. What are you waiting for? Apply today!.Valid license...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel MRI Tech - $2,236 to $2,479 per week in Turnersville, NJ

    Travel MRI Tech - $2,236 to $2,479 per week in Turnersville, NJ

    AlliedTravelNetwork • Turnersville, NJ, US
    [job_card.full_time]
    AlliedTravelNetwork is working with LRS Healthcare to find a qualified MRI Tech in Turnersville, New Jersey, 08080!.Ready to start your next travel adventure? LRS Healthcare offers a full benefits ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Compliance Officer, Global Monitoring, Auditing, and Third-Party Risk Management (Remote)

    Senior Compliance Officer, Global Monitoring, Auditing, and Third-Party Risk Management (Remote)

    Jazz Pharmaceuticals • Philadelphia, PA, United States
    [filters.remote]
    [job_card.full_time]
    If you are a current Jazz employee please apply via the Internal Career site.Jazz Pharmaceuticals is a global biopharma company whose purpose is to innovate to transform the lives of patients and ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Nurse Manager (LPN) - Clinical Unit Day Shifts - Sign-on Bonus

    Nurse Manager (LPN) - Clinical Unit Day Shifts - Sign-on Bonus

    Clover Meadows Healthcare and Rehabilitation Center • Lambertville, NJ, US
    [job_card.part_time]
    Licensed Practical Nurses (LPNs).Great Pay Rates! (based on experience and skills).Medical, Dental, Vision Benefits.Tuition Assistance Programs, Career Advancement Opportunity.New Nurse graduates a...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lpn

    Lpn

    First Home Health Care • Yardley, PA, US
    [job_card.full_time]
    As an LPN at First Home, you’ll play a vital role in providing exceptional care to our patients.Your responsibilities will include : . Delivering high-quality nursing care to patients in accorda...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Administrator, Mail and Receiving

    Administrator, Mail and Receiving

    InsideHigherEd • Sewell, New Jersey, United States
    [job_card.full_time]
    The administrator will oversee mailroom personnel, ensuring procedures and best practices are followed with regard to mail, stockroom, shipping, and receiving functions. Acts as a backup to the Supe...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Travel MRI Tech - $2479 / Week

    Travel MRI Tech - $2479 / Week

    LRS Healthcare - Allied • Turnersville, NJ, US
    [job_card.full_time]
    LRS Healthcare - Allied is seeking an experienced MRI Tech for an exciting Travel Allied job in Turnersville, NJ.Shift : Inquire Start Date : 01 / 05 / 2026 Duration : 13 weeks Pay : $2479 / Week.Ready to ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel MRI Tech - $2380 / Week

    Travel MRI Tech - $2380 / Week

    SambaTraveler • Sewell, NJ, US
    [job_card.full_time]
    SambaTraveler is seeking an experienced MRI Tech for an exciting Travel Allied job in Sewell, NJ.Shift : 3x12 hr days Start Date : 12 / 15 / 2025 Duration : 13 weeks Pay : $2380 / Week.Working in healthcar...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Home Services Manager (RN) - $2,500 Sign-On Bonus

    Home Services Manager (RN) - $2,500 Sign-On Bonus

    Acts Retirement-Life Communities • Southampton, PA, United States
    [job_card.part_time]
    Home Services Manager (RN) - $2,500 Sign-On Bonus.Next day pay : Work today, get paid tomorrow with our PayActiv benefit!. We strongly believe in providing our team members with great benefits, such ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Travel MRI Tech - $2496 / Week

    Travel MRI Tech - $2496 / Week

    Uniti Med • Langhorne, PA, US
    [job_card.full_time]
    Uniti Med is seeking an experienced MRI Tech for an exciting Travel Allied job in Langhorne, PA.Shift : Inquire Start Date : ASAP Duration : 13 weeks Pay : $2496 / Week. Uniti Med provides career opport...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel MRI Tech - $2,321 to $2,515 per week in Langhorne, PA

    Travel MRI Tech - $2,321 to $2,515 per week in Langhorne, PA

    AlliedTravelCareers • Langhorne, PA, US
    [job_card.full_time] +1
    AlliedTravelCareers is working with Aya Healthcare to find a qualified MRI Tech in Langhorne, Pennsylvania, 19053!.Aya Healthcare has an immediate opening for the following position : MRI Tech in La...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel MRI Tech - $2,322 per week in Langhorne, PA

    Travel MRI Tech - $2,322 per week in Langhorne, PA

    Atlas MedStaff • Langhorne, PA, US
    [job_card.full_time]
    Atlas Medstaff is currently seeking candidates in the MRI Tech (MRI Tech) profession for a 13 week contract in the Langhorne, Pennsylvania area. Atlas Medstaff is a premier staffing firm dedicated t...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote AI Content Reviewer

    Remote AI Content Reviewer

    Outlier • Philadelphia, PA, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Rental Damage Recovery Analyst

    Rental Damage Recovery Analyst

    Foley, Inc. • Bensalem, PA, United States
    [job_card.full_time]
    Review all EMRs to identify rental damage and document resolution in D365.Notify customers of damage within 48 hours of machine return, ensuring systematic communication and detailed documentation ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    HEDIS Data Reviewer

    HEDIS Data Reviewer

    US Tech Solutions • Philadelphia, PA, US
    [job_card.temporary]
    Location : Philadelphia PA 19113(Hybrid).Duration : 3 months contract with possible extension.Under the direction of the Manager of Medical Record Review Operations, the HEDIS Data Reviewer is respon...[show_more]
    [last_updated.last_updated_30] • [promoted]