Talent.com
AI Output Verification Specialist
AI Output Verification SpecialistScale AI • Philadelphia, Pennsylvania, United States
AI Output Verification Specialist

AI Output Verification Specialist

Scale AI • Philadelphia, Pennsylvania, United States
[job_card.variable_hours_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Join a global community of talented professionals to shape the future of AI. Earn up to $15 USD / hr and additional rewards based on quality of submission.

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI , we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world , who help improve AI models by providing expert human feedback . This data has led to AI advancements for the world's leading AI labs and large language model builders.

We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.

What you will be doing

We are looking for someone who speaks fluent English to contribute their expertise toward training and refining cutting-edge AI systems.

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for.
  • Use the tool of rubrics to address user needs in a structured way.
  • Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What we’re looking for

  • Education : Bachelor’s degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.
  • Nice to Haves :

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.
  • Compensation and benefits

    Earn up to $15 USD / hr, paid out weekly

    Rates vary based on quality, accuracy, and time spent. Paid via PayPal & AirTM

    Free access to

    Model Playground

    Interact, experiment and engage with leading large language models free of cost

    Flexible schedule and

    time commitment

    No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours / week, up to 40 hours working from home

    Join a global community of

    Coding experts

    Join a global network of experts contributing to advanced AI tools

    Disclaimer : For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project.

    Equal Opportunity Employer : Outlier is committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.

    [job_alerts.create_a_job]

    Verification Specialist • Philadelphia, Pennsylvania, United States

    [internal_linking.related_jobs]
    Research Specialist A

    Research Specialist A

    InsideHigherEd • Philadelphia, Pennsylvania, United States
    [job_card.full_time]
    The University of Pennsylvania, the largest private employer in Philadelphia, is a world-renowned leader in education, research, and innovation. This historic, Ivy League school consistently ranks a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Quality Specialist I, Receiving Inspection

    Quality Specialist I, Receiving Inspection

    Biomeme, Inc. • Philadelphia, PA, US
    [job_card.permanent]
    Quality Specialist I, Receiving Inspection.Be part of something altogether life-changing! Working at Biomeme in the Biotechnology industry means being at the forefront of providing healthcare diagn...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel MRI Tech - $2,236 to $2,479 per week in Turnersville, NJ

    Travel MRI Tech - $2,236 to $2,479 per week in Turnersville, NJ

    AlliedTravelNetwork • Turnersville, NJ, US
    [job_card.full_time]
    AlliedTravelNetwork is working with LRS Healthcare to find a qualified MRI Tech in Turnersville, New Jersey, 08080!.Ready to start your next travel adventure? LRS Healthcare offers a full benefits ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel MRI Tech - $2,571 per week in Washington Township, NJ

    Travel MRI Tech - $2,571 per week in Washington Township, NJ

    AlliedTravelCareers • Washington Township, NJ, US
    [job_card.full_time]
    AlliedTravelCareers is working with Triage Staffing LLC to find a qualified MRI Tech in Washington Township, New Jersey, 07882!. Travel Radiology : MRI Tech Washington Township.Location : Wash...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel MRI Tech - $2,571 per week in Washington Township, NJ

    Travel MRI Tech - $2,571 per week in Washington Township, NJ

    Triage Staffing LLC • Washington Township, NJ, US
    [job_card.full_time]
    Travel Radiology : MRI Tech Washington Township.Location : Washington Township.Shift Details : 12H Days (8 : 00 AM-8 : 00 PM). Length : 13 WEEKS 13 weeks.Apply for specific facility det...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    CT Technologist

    CT Technologist

    Clinical Magnet • Stratford, NJ, US
    [job_card.permanent]
    Direct Hire CT Technologist Role $44.Clinical Magnet (part of Icon Medical).This is a DIRECT HIRE OPPORTUNITY.Interacts with co-workers, visitors, and other staff consistently with the values of Je...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    AI Prompt Evaluation Specialist (Remote)

    AI Prompt Evaluation Specialist (Remote)

    Scale AI • Philadelphia, Pennsylvania, United States
    [filters.remote]
    [job_card.full_time]
    Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Content Verification Specialist (Remote)

    Content Verification Specialist (Remote)

    Scale AI • Philadelphia, Pennsylvania, United States
    [filters.remote]
    [job_card.full_time]
    Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Travel CT Tech - $2,006 to $2,198 per week in Langhorne, PA

    Travel CT Tech - $2,006 to $2,198 per week in Langhorne, PA

    AMN Healthcare Allied • LANGHORNE, PA, US
    [job_card.full_time]
    Job Description & Requirements.Computed Tomography Technologist - (CT Tech) .StartDate : ASAP Available Shifts : 12 N Pay Rate : $2006. An exciting opportunity awaits you as a CT Tech in Langhorn...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel MRI Tech - $2,571 per week in Washington Township, NJ

    Travel MRI Tech - $2,571 per week in Washington Township, NJ

    AlliedTravelNetwork • Washington Township, NJ, US
    [job_card.full_time]
    AlliedTravelNetwork is working with Triage Staffing LLC to find a qualified MRI Tech in Washington Township, New Jersey, 07882!. Travel Radiology : MRI Tech Washington Township.Location : Wash...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote AI Writing Specialist

    Remote AI Writing Specialist

    Outlier • Philadelphia, PA, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Specialist C

    Research Specialist C

    InsideHigherEd • Philadelphia, Pennsylvania, United States
    [job_card.full_time]
    The University of Pennsylvania, the largest private employer in Philadelphia, is a world-renowned leader in education, research, and innovation. This historic, Ivy League school consistently ranks a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Testing Assistant

    Testing Assistant

    InsideHigherEd • Sewell, New Jersey, United States
    [job_card.full_time]
    The Testing Assistant is an integral part of the Testing Center providing support for the administration of tests to the RCSJ college community and beyond. The Testing Assistant duties will include ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel MRI Tech - $2,321 to $2,515 per week in Langhorne, PA

    Travel MRI Tech - $2,321 to $2,515 per week in Langhorne, PA

    AlliedTravelCareers • Langhorne, PA, US
    [job_card.full_time] +1
    AlliedTravelCareers is working with Aya Healthcare to find a qualified MRI Tech in Langhorne, Pennsylvania, 19053!.Aya Healthcare has an immediate opening for the following position : MRI Tech in La...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Trainer -Remote AI Writing Specialist

    AI Trainer -Remote AI Writing Specialist

    Outlier • Philadelphia, PA, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Work From Home -Remote AI Writing Specialist

    Work From Home -Remote AI Writing Specialist

    Outlier • Philadelphia, PA, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Associate I

    Research Associate I

    bioMerieux Inc. • Philadelphia, PA, United States
    [job_card.full_time]
    We are looking for a R&D technician to join and grow within the 'Assay Development' team of the 'Food Molecular Diagnostic Franchise' from the 'Industrial Applications' department.The technician wi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Product Designer, AI Networking Platform

    Lead Product Designer, AI Networking Platform

    Cisco Systems, Inc. • Philadelphia, PA, United States
    [job_card.full_time]
    Cisco Networking is an industry leader providing intelligent network solutions for organizations to securely connect users, devices, applications, and workloads everywhere.We empower organizations ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]