Talent.com
Freelance Agent Evaluation Engineer
Freelance Agent Evaluation EngineerMindrift • Houston, TX, US
Freelance Agent Evaluation Engineer

Freelance Agent Evaluation Engineer

Mindrift • Houston, TX, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.part_time]
  • [job_card.permanent]
  • [filters.remote]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

What this opportunity involves

While each project involves unique tasks, contributors may :

  • Create structured test cases that simulate complex human workflows
  • Define gold-standard behavior and scoring logic to evaluate agent actions
  • Analyze agent logs, failure modes, and decision paths
  • Work with code repositories and test frameworks to validate your scenarios
  • Iterate on prompts, instructions, and test cases to improve clarity and difficulty
  • Ensure that scenarios are production-ready, easy to run, and reusable

What we look for

This opportunity is a good fit for software engineers, open to part-time, non-permanent projects. Ideally, contributors will have :

  • 3+ of software development experience with strong Python focus
  • Experience with Git and code repositories
  • Comfortable with structured formats like JSON / YAML for scenario description
  • Understanding core LLM limitations (hallucinations, bias, context limits) and how these affect evaluation design
  • Familiarity with Docker
  • English proficiency - B2
  • How it works

    Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid

    Project time expectations

    Tasks for this project are estimated to take 6-10 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

    Payment

  • Paid contributions, with rates up to $80 / hour
  • Fixed project rate or individual rates, depending on the project
  • Some projects include incentive payments
  • Note : Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.
  • [job_alerts.create_a_job]

    Freelance Agent Evaluation Engineer • Houston, TX, US

    [internal_linking.similar_jobs]
    Requirements Evaluation & Design (RED) Team Lead

    Requirements Evaluation & Design (RED) Team Lead

    CompQsoft • Houston, TX, United States
    [job_card.full_time]
    POSITION : Requirements Evaluation & Design (RED) Team Lead.Clerance : Active Secret Clearance.Certification : Project Management Professional Certification (minimum). Education : Bachelor's degree in i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Propulsion Engineer

    Sr. Propulsion Engineer

    Venus Aerospace • Houston, TX, United States
    [job_card.full_time] +1
    Venus Aerospace is revolutionizing rocket engine propulsion.With the first generational leap in rocket engine technology since Apollo, our proprietary Rotating Detonation Rocket Engine and Venus De...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Customer Quality Engineer I

    Customer Quality Engineer I

    LivaNova • Houston, TX, United States
    [job_card.full_time]
    As a global medtech company, we are driven by our Vision of changing the trajectory of lives for a new day and our Mission to create ingenious solutions that ignite patient turnarounds.Our relentle...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Quality Engineer

    Quality Engineer

    LivaNova • Houston, TX, United States
    [job_card.full_time]
    As a global medtech company, we are driven by our Vision of changing the trajectory of lives for a new day and our Mission to create ingenious solutions that ignite patient turnarounds.Our relentle...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Project Engineer

    Senior Project Engineer

    Oceaneering International, Inc. • Houston, TX, United States
    [job_card.full_time]
    As one of the largest providers of Remotely Operated Vehicles (ROVs), Oceaneering offers cost-effective, innovative solutions to solve our customers' most complex challenges.With 99% uptime, our ve...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Quality Engineer

    Quality Engineer

    Venus Aerospace • Houston, TX, United States
    [job_card.permanent]
    Venus Aerospace is revolutionizing rocket engine propulsion.With the first generational leap in rocket engine technology since Apollo, our proprietary Rotating Detonation Rocket Engine and Venus De...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Associate Distribution Engineer

    Associate Distribution Engineer

    Leidos Inc • Houston, TX, United States
    [job_card.full_time]
    We challenge our staff with interesting assignments that provide them with an opportunity to thrive, professionally and personally. For us, helping you grow your career is good business.We're lookin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal GEMT RF Downlink Engineer (Bellaire)

    Principal GEMT RF Downlink Engineer (Bellaire)

    Raytheon • Bellaire, Texas, US
    [job_card.part_time]
    MA803 : Marlborough, MA Building 3 1001 Boston Post Road Building 3, Marlborough, MA, 01752 USA.Person, or Immigration Status Requirements : . At Raytheon, the foundation of everything we do is rooted ...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Principal GEMT RF Downlink Engineer...

    Principal GEMT RF Downlink Engineer...

    Raytheon • Houston, Texas, US
    [job_card.full_time]
    Date Posted : 2025-12-22 Country : United States of America Location : MA803 : Marlborough, MA Building 3 1001 Boston Post Road Building 3, Marlborough, MA, 01752 USA Position Role Type : Onsite ...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Principal GEMT RF Downlink Engineer (Houston)

    Principal GEMT RF Downlink Engineer (Houston)

    Raytheon • Houston, Texas, US
    [job_card.part_time]
    MA803 : Marlborough, MA Building 3 1001 Boston Post Road Building 3, Marlborough, MA, 01752 USA.Person, or Immigration Status Requirements : . At Raytheon, the foundation of everything we do is rooted ...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Propulsion Engineer

    Propulsion Engineer

    The Aerospace Corporation • Houston, TX, United States
    [job_card.full_time]
    The Aerospace Corporation is the trusted partner to the nation's space programs, solving the hardest problems and providing unmatched technical expertise. As the operator of a federally funded resea...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Moon to Mars Exploration and Operations Integration Engineer

    Moon to Mars Exploration and Operations Integration Engineer

    The Aerospace Corporation • Houston, TX, United States
    [job_card.full_time]
    The Aerospace Corporation is the trusted partner to the nation's space programs, solving the hardest problems and providing unmatched technical expertise. As the operator of a federally funded resea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal GEMT RF Downlink Engineer (Friendswood)

    Principal GEMT RF Downlink Engineer (Friendswood)

    Raytheon • Friendswood, Texas, US
    [job_card.part_time]
    MA803 : Marlborough, MA Building 3 1001 Boston Post Road Building 3, Marlborough, MA, 01752 USA.Person, or Immigration Status Requirements : . At Raytheon, the foundation of everything we do is rooted ...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Nondestructive Evaluation (NDE) Engineer - Space Systems

    Nondestructive Evaluation (NDE) Engineer - Space Systems

    Oceaneering International, Inc. • Houston, TX, United States
    [job_card.full_time] +1
    Oceaneering Space Systems (OSS) develops, integrates, and applies new and innovative technologies to meet the challenges of working in space and other harsh environments. We are ideally positioned t...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Logistics Senior System Engineer (Bellaire)

    Logistics Senior System Engineer (Bellaire)

    Raytheon • Bellaire, Texas, US
    [job_card.part_time]
    MA132 : Tewksbury, Ma Bldg 2 Sudbury 50 Apple Hill Drive Sudbury - Building 2, Tewksbury, MA, 01876 USA.Person, or Immigration Status Requirements : . The ability to obtain and maintain a U.At Raytheon...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Principal Account Engineer

    Principal Account Engineer

    Munich RE • Houston, TX, United States
    [job_card.full_time]
    Atlanta, United States; Austin, United States; Dallas, United States; Hartford, United States; Houston, United States;.Use your experience in the power generation industry or heavy manufacturing to...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Ad Tech Quality Engineer

    Ad Tech Quality Engineer

    Huntsman • Houston, TX, United States
    [job_card.full_time]
    Advanced Technology Quality Engineer.Advanced Technology Quality Engineer.Performance Products Division, located in Conroe, Texas. This position will report to the Technical Manager.The Advanced Tec...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal GEMT RF Downlink Engineer (Pearland)

    Principal GEMT RF Downlink Engineer (Pearland)

    Raytheon • Pearland, Texas, US
    [job_card.part_time]
    MA803 : Marlborough, MA Building 3 1001 Boston Post Road Building 3, Marlborough, MA, 01752 USA.Person, or Immigration Status Requirements : . At Raytheon, the foundation of everything we do is rooted ...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]