Talent.com
Freelance Agent Evaluation Engineer
Freelance Agent Evaluation EngineerMindrift • Houston, TX, US
Freelance Agent Evaluation Engineer

Freelance Agent Evaluation Engineer

Mindrift • Houston, TX, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.part_time]
  • [job_card.permanent]
  • [filters.remote]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

What this opportunity involves

While each project involves unique tasks, contributors may :

  • Create structured test cases that simulate complex human workflows
  • Define gold-standard behavior and scoring logic to evaluate agent actions
  • Analyze agent logs, failure modes, and decision paths
  • Work with code repositories and test frameworks to validate your scenarios
  • Iterate on prompts, instructions, and test cases to improve clarity and difficulty
  • Ensure that scenarios are production-ready, easy to run, and reusable

What we look for

This opportunity is a good fit for software engineers, open to part-time, non-permanent projects. Ideally, contributors will have :

  • 3+ of software development experience with strong Python focus
  • Experience with Git and code repositories
  • Comfortable with structured formats like JSON / YAML for scenario description
  • Understanding core LLM limitations (hallucinations, bias, context limits) and how these affect evaluation design
  • Familiarity with Docker
  • English proficiency - B2
  • How it works

    Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid

    Project time expectations

    Tasks for this project are estimated to take 6-10 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

    Payment

  • Paid contributions, with rates up to $80 / hour
  • Fixed project rate or individual rates, depending on the project
  • Some projects include incentive payments
  • Note : Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.
  • [job_alerts.create_a_job]

    Freelance Agent Evaluation Engineer • Houston, TX, US

    [internal_linking.similar_jobs]
    Requirements Evaluation & Design (RED) Team Lead

    Requirements Evaluation & Design (RED) Team Lead

    CompQsoft • Houston, TX, United States
    [job_card.full_time]
    POSITION : Requirements Evaluation & Design (RED) Team Lead.Clerance : Active Secret Clearance.Certification : Project Management Professional Certification (minimum). Education : Bachelor's degree in i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Propulsion Engineer

    Sr. Propulsion Engineer

    Venus Aerospace • Houston, TX, United States
    [job_card.full_time] +1
    Venus Aerospace is revolutionizing rocket engine propulsion.With the first generational leap in rocket engine technology since Apollo, our proprietary Rotating Detonation Rocket Engine and Venus De...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Customer Quality Engineer I

    Customer Quality Engineer I

    LivaNova • Houston, TX, United States
    [job_card.full_time]
    As a global medtech company, we are driven by our Vision of changing the trajectory of lives for a new day and our Mission to create ingenious solutions that ignite patient turnarounds.Our relentle...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Evaluator / Reviewer - Statistical Assistants

    Evaluator / Reviewer - Statistical Assistants

    Sepal • Houston, TX, US
    [job_card.full_time] +1
    Role Overview The Occupation-Specific Reviewer evaluates task submissions that require domain expertise in a specific profession or field (e. This role ensures that content is not only guideline-com...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Quality Engineer

    Quality Engineer

    Oceaneering International, Inc. • Houston, TX, United States
    [job_card.full_time]
    Oceaneering Space Systems (OSS) develops, integrates, and applies new and innovative technologies to meet the challenges of working in space and other harsh environments. We are ideally positioned t...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Quality Engineer

    Quality Engineer

    LivaNova • Houston, TX, United States
    [job_card.full_time]
    As a global medtech company, we are driven by our Vision of changing the trajectory of lives for a new day and our Mission to create ingenious solutions that ignite patient turnarounds.Our relentle...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Stationary Engineer

    Stationary Engineer

    Harris County, TX • Houston, TX, United States
    [job_card.full_time] +1
    Institute of Forensic Sciences.The Mission of the Harris County Institute of Forensic Sciences is to provide medical examiner and crime laboratory services of the highest quality in an unbiased man...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Project Engineer

    Senior Project Engineer

    Oceaneering International, Inc. • Houston, TX, United States
    [job_card.full_time]
    As one of the largest providers of Remotely Operated Vehicles (ROVs), Oceaneering offers cost-effective, innovative solutions to solve our customers' most complex challenges.With 99% uptime, our ve...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Quality Engineer

    Quality Engineer

    Venus Aerospace • Houston, TX, United States
    [job_card.permanent]
    Venus Aerospace is revolutionizing rocket engine propulsion.With the first generational leap in rocket engine technology since Apollo, our proprietary Rotating Detonation Rocket Engine and Venus De...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Associate Distribution Engineer

    Associate Distribution Engineer

    Leidos Inc • Houston, TX, United States
    [job_card.full_time]
    We challenge our staff with interesting assignments that provide them with an opportunity to thrive, professionally and personally. For us, helping you grow your career is good business.We're lookin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal GEMT RF Downlink Engineer

    Principal GEMT RF Downlink Engineer

    Raytheon • Friendswood, Texas, United States
    [job_card.full_time]
    Country : United States of America.Location : MA803 : Marlborough, MA Building 3 1001 Boston Post Road Building 3, Marlborough, MA, 01752 USA. Person, or Immigration Status Requirements : Active and tra...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Residential Surveillance Agent

    Residential Surveillance Agent

    Pinkerton Consulting & Investigations, Inc. • Houston, TX, United States
    [job_card.full_time]
    At Pinkerton, the mission is to protect our clients.To do this, we provide enterprise risk management services and programs specifically designed for each client. Pinkerton employees are one of our ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Propulsion Engineer

    Propulsion Engineer

    The Aerospace Corporation • Houston, TX, United States
    [job_card.full_time]
    The Aerospace Corporation is the trusted partner to the nation's space programs, solving the hardest problems and providing unmatched technical expertise. As the operator of a federally funded resea...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Moon to Mars Exploration and Operations Integration Engineer

    Moon to Mars Exploration and Operations Integration Engineer

    The Aerospace Corporation • Houston, TX, United States
    [job_card.full_time]
    The Aerospace Corporation is the trusted partner to the nation's space programs, solving the hardest problems and providing unmatched technical expertise. As the operator of a federally funded resea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Project Engineer

    Project Engineer

    Brightsmith • Houston, TX, United States
    [job_card.full_time]
    An innovative energy technology company is seeking a.This role sits at the intersection of engineering, project development, and regulatory strategy, helping bring complex energy infrastructure pro...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Nondestructive Evaluation (NDE) Engineer - Space Systems

    Nondestructive Evaluation (NDE) Engineer - Space Systems

    Oceaneering International, Inc. • Houston, TX, United States
    [job_card.full_time] +1
    Oceaneering Space Systems (OSS) develops, integrates, and applies new and innovative technologies to meet the challenges of working in space and other harsh environments. We are ideally positioned t...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Surveillance Agent

    Surveillance Agent

    Marshall Investigative Group • Houston, TX, United States
    [job_card.full_time]
    Marshall Investigative Group (MIG), the industry's leading investigative firm, seeks self-motivated individuals with experience in surveillance and mobile investigations to assist in researching in...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Ad Tech Quality Engineer

    Ad Tech Quality Engineer

    Huntsman • Houston, TX, United States
    [job_card.full_time]
    Advanced Technology Quality Engineer.Advanced Technology Quality Engineer.Performance Products Division, located in Conroe, Texas. This position will report to the Technical Manager.The Advanced Tec...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]