Talent.com
Machine Learning Evaluation Assistant
Machine Learning Evaluation AssistantScale AI • Baltimore, Maryland, United States
[error_messages.no_longer_accepting]
Machine Learning Evaluation Assistant

Machine Learning Evaluation Assistant

Scale AI • Baltimore, Maryland, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Join a global community of talented professionals to shape the future of AI. Earn up to $15 USD / hr and additional rewards based on quality of submission.

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI , we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world , who help improve AI models by providing expert human feedback . This data has led to AI advancements for the world's leading AI labs and large language model builders.

We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.

What you will be doing

We are looking for someone who speaks fluent English to contribute their expertise toward training and refining cutting-edge AI systems.

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for.
  • Use the tool of rubrics to address user needs in a structured way.
  • Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

What we’re looking for

  • Education : Bachelor’s degree or higher (or currently enrolled).
  • Analytical and Problem-Solving Skills : Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing : Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail : Commitment to accuracy and ability to assess technical aspects of model outputs.
  • Nice to Haves :

  • Experience in fields like literature, creative writing, history, philosophy, theology, etc.
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.).
  • Interest or background in AI, machine learning, or creative tech tools.
  • Compensation and benefits

    Earn up to $15 USD / hr, paid out weekly

    Rates vary based on quality, accuracy, and time spent. Paid via PayPal & AirTM

    Free access to

    Model Playground

    Interact, experiment and engage with leading large language models free of cost

    Flexible schedule and

    time commitment

    No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours / week, up to 40 hours working from home

    Join a global community of

    Coding experts

    Join a global network of experts contributing to advanced AI tools

    Disclaimer : For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project.

    Equal Opportunity Employer : Outlier is committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.

    [job_alerts.create_a_job]

    Machine Learning • Baltimore, Maryland, United States

    [internal_linking.similar_jobs]
    Lead Machine Learning Engineer

    Lead Machine Learning Engineer

    Capital One • Baltimore, MD, US
    [job_card.full_time] +1
    Lead Machine Learning Engineer.As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale.You’...[show_more]
    [last_updated.last_updated_less] • [promoted] • [new]
    Medical Assistant (CCS2)

    Medical Assistant (CCS2)

    AIDS Healthcare Foundation • Baltimore, MD, US
    [job_card.full_time]
    AMAZING INDIVIDUALS WORKING FOR POSITIVE PEOPLE at AIDS Healthcare Foundation!.Does the idea of doing something that really makes a difference in people’s lives while being well-compensated i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Medical Assistant

    Medical Assistant

    National Spine & Pain • Glen Burnie, MD, US
    [job_card.full_time]
    For more than 30 years, NSPC affiliated physicians have been pioneers in the relief of chronic and acute pain through minimally invasive procedures. With more than 120 locations and 750 medical prof...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Science Level 3 (ML Ops Framework / Cyber Hunting), BS+10 yrs or MS+8

    Data Science Level 3 (ML Ops Framework / Cyber Hunting), BS+10 yrs or MS+8

    Link, LLC • Fort Meade, MD, US
    [job_card.full_time]
    Play an integral role in the development of an ML ops framework for cyber incident detection.This is a project with high visibility that seeks to revolutionize cyber hunting.The role is multifacete...[show_more]
    [last_updated.last_updated_30] • [promoted]
    GENAI / MACHINE LEARNING AI / DATA Scientist

    GENAI / MACHINE LEARNING AI / DATA Scientist

    Hudson Manpower • Maryland, MD, US
    [job_card.full_time]
    I hope this message finds you well.I’m reaching out to share an exciting opportunity that I believe aligns with your experience and expertise in the field for my client. If you are interested, I’d l...[show_more]
    [last_updated.last_updated_30]
    Staff Applied Scientist

    Staff Applied Scientist

    Relativity • Baltimore, MD, United States
    [job_card.full_time]
    At Relativity, we're building a world-class Applied Science team to push the boundaries of intelligent systems in the legal domain. We're looking for a Staff Applied Scientist to join our team.Agent...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Assistant (Center for Digital Health & Artificial Intelligence)

    Research Assistant (Center for Digital Health & Artificial Intelligence)

    Johns Hopkins University • Baltimore, MD, United States
    [job_card.full_time]
    The Center for Digital Health and Artificial Intelligence (CDHAI) at Johns Hopkins University (JHU) is seeking a.CDHAI for an exciting grant-funded opportunity for AI projects which require close c...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Assistant (Institute for Computational Medicine)

    Research Assistant (Institute for Computational Medicine)

    Johns Hopkins University • Baltimore, MD, United States
    [job_card.full_time]
    Specific Duties & Responsibilities.Run routine and ad hoc reports.Use standard tools and computer programs to review data. Assist with data cleaning measures to ensure accuracy of data and preparati...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Analytic Methodologist - Mid

    Analytic Methodologist - Mid

    Cherokee Federal • Fort George G Meade, MD, US
    [job_card.full_time] +1
    Analytic Methodologist - Mid This position requires an active TS / Sensitive Compartmental Information (SCI) clearance with the ability to obtain a Counterintelligence Polygraph.A government contract...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Data Science Level 3 (Advanced AI, NLP ), BS+10 yrs or MS+8 yrs

    Data Science Level 3 (Advanced AI, NLP ), BS+10 yrs or MS+8 yrs

    Link, LLC • Fort Meade, MD, US
    [job_card.full_time]
    DS position in X32 as a support for a Natural Language Processing (NLP) project to accurately and automatically tokenize language data with spoken or written origins. This position involves developi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Data Analyst (Contingent II)

    Research Data Analyst (Contingent II)

    InsideHigherEd • Bowie, Maryland, United States
    [job_card.temporary]
    JR101492 Research Data Analyst (Contingent II) (Open).BSU Research and Innovation, JM.Non-Regular Fixed Term (Fixed Term). Performs a variety of professional and administrative duties in support of ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Trainer -Remote Writing Evaluator

    AI Trainer -Remote Writing Evaluator

    Outlier • Baltimore, MD, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Data Annotation • Bowie, Maryland
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Medical Assistant

    Medical Assistant

    Maryland ENT • Baltimore, MD, US
    [job_card.full_time]
    The primary purpose of the Medical Assistant / MA is to help the providers with patient care and prepare exam rooms.This role will report to the Practice Administrator and be guided by the Office N...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Exploitation Analyst II

    Data Exploitation Analyst II

    Oceaneering International, Inc. • Hanover, MD, United States
    [job_card.full_time]
    Oceaneering Technologies (OTECH) develops, manufactures, and operates customized marine systems, shipboard equipment, subsea vehicles, and engineered solutions for commercial and U.Oceaneering Aero...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Lockheed Martin • Annapolis Junction, MD, US
    [job_card.full_time]
    The Artificial Intelligence / Machine Learning (AI / ML) Engineer designs, creates, tests, and productizes AI / ML algorithms to solve business challenges. The AI / ML models they create should be capable o...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Medical Assistant

    Medical Assistant

    Planned Parenthood of Maryland • Baltimore, MD, US
    [job_card.full_time]
    Planned Parenthood of Maryland (PPM) is a not-for-profit family planning agency that provides high-quality, affordable reproductive health care for women, men, and teens. Our mission is to enable al...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Medical Assistant

    Medical Assistant

    Healthcare For the Homeless Inc • Baltimore, MD, US
    [job_card.full_time]
    Are you passionate about providing compassionate care to underserved populations? Health Care for the Homeless is seeking a. Certified or Registered Medical Assistant (CMA).As a vital member of our ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]