Talent.com
Information Evaluation Associate
Information Evaluation AssociateScale AI • Denver, Colorado, United States
[error_messages.no_longer_accepting]
Information Evaluation Associate

Information Evaluation Associate

Scale AI • Denver, Colorado, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Join a global community of talented professionals to shape the future of AI. Earn up to $15 USD / hr and additional rewards based on quality of submission.

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI , we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world , who help improve AI models by providing expert human feedback . This data has led to AI advancements for the world's leading AI labs and large language model builders.

We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.

What you will be doing

We are looking for someone who speaks fluent English to contribute their expertise toward training and refining cutting-edge AI systems.

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for.
  • Use the tool of rubrics to address user needs in a structured way.
  • Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What we’re looking for

  • Education : Bachelor’s degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.
  • Nice to Haves :

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.
  • Compensation and benefits

    Earn up to $15 USD / hr, paid out weekly

    Rates vary based on quality, accuracy, and time spent. Paid via PayPal & AirTM

    Free access to

    Model Playground

    Interact, experiment and engage with leading large language models free of cost

    Flexible schedule and

    time commitment

    No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours / week, up to 40 hours working from home

    Join a global community of

    Coding experts

    Join a global network of experts contributing to advanced AI tools

    Disclaimer : For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project.

    Equal Opportunity Employer : Outlier is committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.

    [job_alerts.create_a_job]

    Evaluation Associate • Denver, Colorado, United States

    [internal_linking.similar_jobs]
    Wealth Advisor Associate Intern

    Wealth Advisor Associate Intern

    Mission Wealth Management LP • Denver, CO, US
    [job_card.part_time]
    As a Barron’s Top 100 RIA firm and voted.Fortune, Pacific Coast Business Times, Inc.Best Workplaces), and Investment News, Mission Wealth is hiring a growth-minded part-time.Wealth Advisor As...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Bilingual Contract SAFE Certified Home Study Evaluator

    Bilingual Contract SAFE Certified Home Study Evaluator

    Clarvida • Denver, CO, US
    [job_card.part_time]
    Clarvida’s success is built on the strength of our people : individuals who bring the right skills and a deep commitment to our mission of improving lives and communities. Our employees are empowered...[show_more]
    [last_updated.last_updated_30]
    ULTIMATE+ Senior Research Associate

    ULTIMATE+ Senior Research Associate

    University of Denver • Denver, Colorado, USA
    [job_card.full_time]
    The Marsico Institute for Early Learning is seeking a Senior Research Associate to take the lead in managing key components of several grants and contracts with an emphasis on developing and provid...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Associate Director, Global Integrated Evidence Operations

    Associate Director, Global Integrated Evidence Operations

    Denver Staffing • Denver, CO, US
    [job_card.full_time]
    Global Integrated Evidence Operations, Associate Director.The Global Integrated Evidence Operations, Associate Director role oversees and coordinates the operational processes, digital system suppo...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Associate Project Delivery Lead Real World Research

    Associate Project Delivery Lead Real World Research

    Colorado Staffing • Denver, CO, US
    [job_card.full_time]
    Principal Real World Research Delivery Lead (RWRDL).Are you ready to take on a challenge and accelerate your career? This is an excellent opportunity for a self-driven, autonomous leader eager for ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Data Analyst Public Health

    Data Analyst Public Health

    Denver Health and Hospital Authority • Denver, Colorado, USA
    [job_card.full_time]
    We are recruiting for a motivated Data Analyst - Public Health to join our team!.Where is your life journey taking you.Being the heartbeat of Denver means our heart reflects something bigger than o...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Analytics & Insights Associate

    Lead Analytics & Insights Associate

    Vizient, Inc. • Centennial, CO, United States
    [job_card.full_time]
    When you're the best, we're the best.We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents. We provide extensive opportunities for ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Wealth Management Associate

    Wealth Management Associate

    Curi Capital LLC • Denver, CO, US
    [job_card.full_time]
    This is a hybrid role located in our Denver office located in Cherry Creek - 250 Fillmore Street, Suite 600.Team members are expected to come into the office three days a week.Curi Capital, founded...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Associate

    Research Associate

    Pinnacle Real Estate Advisors • Denver, Colorado, United States
    [job_card.full_time]
    Pinnacle Real Estate Advisors, a local, high growth, dynamic, and energetic commercial real estate firm, seeks a full-time Database Associate to implement and manage the company’s commercial databa...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Text Quality Evaluator

    Remote Text Quality Evaluator

    Outlier • Frederick, CO, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Associate, Healthcare Valuation and Advisory

    Associate, Healthcare Valuation and Advisory

    Stout • Denver, CO, United States
    [job_card.full_time]
    At Stout, we're dedicated to exceeding expectations in all we do - we call it Relentless Excellence.Both our client service and culture are second to none, stemming from our firmwide embrace of our...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Director, Engineering - Data Breach Response

    Director, Engineering - Data Breach Response

    Relativity • Denver, CO, United States
    [job_card.full_time]
    Relativity is a leading company in AI-powered data intelligence for the legal industry.Our cloud platform helps organizations worldwide manage investigations, lawsuits, and compliance efficiently.R...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Technology Transactions Associate

    Technology Transactions Associate

    5 Legal • Denver, CO, US
    [job_card.full_time]
    Top 50 AmLaw firm is seeking a junior to mid-level associate to join their Technology Transactions Practice Group.Qualified applicants must have a minimum of 3 years experience handling transaction...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Technology and Innovation - OneStream Associate Director

    Technology and Innovation - OneStream Associate Director

    Riveron • Denver, CO, United States
    [job_card.full_time]
    Technology and Innovation - OneStream Associate Director.Technology and Innovation - OneStream Associate Director.Riveron is looking for an Associate Director focused on OneStream software to join ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Specialist, Technical Evaluations & Proposals

    Senior Specialist, Technical Evaluations & Proposals

    Resilience • Denver, CO, United States
    [job_card.full_time]
    A career at Resilience is more than just a job - it's an opportunity to change the future.Resilience is a technology-focused biomanufacturing company that's. We're building a sustainable network of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Analyst - Public Health

    Data Analyst - Public Health

    Denver Health • Denver, CO, United States
    [job_card.full_time]
    We are recruiting for a motivated Data Analyst - Public Health to join our team!.We are here for life's journey.Where is your life journey taking you?. Being the heartbeat of Denver means our heart ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Substance Use and Mental Health Evaluator

    Substance Use and Mental Health Evaluator

    Peer Assistance Services Inc • Denver, CO, US
    [job_card.full_time] +1
    Our mission, to lead with prevention and intervention for substance use and mental health concerns, guides all agency programming. Our values of grit, integrity, and compassion are guideposts for al...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Contract- SAFE Certified Home Study Evaluator

    Contract- SAFE Certified Home Study Evaluator

    Clarvida • Denver, CO, US
    [job_card.full_time]
    Clarvida’s success is built on the strength of our people : individuals who bring the right skills and a deep commitment to our mission of improving lives and communities. Our employees are empowered...[show_more]
    [last_updated.last_updated_variable_days]