Talent.com
MCP & Tools Python Developer - Agent Evaluation Infrastructure
MCP & Tools Python Developer - Agent Evaluation InfrastructureMindrift • AZ, US
MCP & Tools Python Developer - Agent Evaluation Infrastructure

MCP & Tools Python Developer - Agent Evaluation Infrastructure

Mindrift • AZ, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.part_time]
  • [filters.remote]
  • [filters_job_card.quick_apply]
[job_card.job_description]

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.

At Mindrift , innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI.

What we do

The Mindrift platform, launched and powered by Toloka , connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world expertise from across the globe.

Who we're looking for

Calling all security researchers, engineers, and penetration testers with a strong foundation in problem-solving, offensive security, and AI-related risk assessment.

If you thrive on digging into complex systems, uncovering hidden vulnerabilities, and thinking creatively under constraints, join us!

We’re looking for someone who can bring a hands-on approach to technical challenges, whether breaking into systems to expose weaknesses or building secure tools and processes. We value contributors with a passion for continuous learning, experimentation, and adaptability.

About the project

We’re on the hunt for hands-on Python engineers for a new project focused on developing Model Context Protocol (MCP) servers and internal tools for running and evaluating agent behavior. You’ll implement base methods for agent action verification, integrate with internal and client infrastructures, and help fill tooling gaps across the team.

What you’ll be doing :

  • Developing and maintaining MCP-compatible evaluation servers
  • Implementing logic to check agent actions against scenario definitions
  • Creating or extending tools that writers and QAs use to test agents
  • Working closely with infrastructure engineers to ensure compatibility
  • Occasionally helping with test writing or debug sessions when needed

Although we’re only looking for experts for this current project, contributors with consistent high-quality submissions may receive an invitation for ongoing collaboration across future projects.

How to get started :

Apply to this post, qualify, and get the chance to contribute to a project aligned with your skills, on your own schedule. Shape the future of AI while building tools that benefit everyone.

Requirements

The ideal contributor will have :

  • 4+ years of Python development experience, ideally in backend or tools
  • Solid experience building APIs, testing frameworks, or protocol-based interfaces
  • Understanding of Docker, Linux CLI, and HTTP-based communication
  • Ability to integrate new tools into existing infrastructures
  • Familiarity with how LLM agents are prompted, executed, and evaluated
  • Clear documentation and communication skills - you’ll work with QA and writers
  • We also value applicants who have :

  • Experience with Model Context Protocol (MCP) or similar structured agent-server interfaces
  • Knowledge of FastAPI or similar async web frameworks
  • Experience working with LLM logs, scoring functions, or sandbox environments
  • Ability to support dev environments (devcontainers, CI configs, linters)
  • JS experience
  • Benefits

  • Get paid for your expertise, with  rates that can go up to $80 / hour  depending on your skills, experience, and project needs.
  • Take part in a flexible, remote, freelance project that fits around your primary professional or academic commitments.
  • Participate in an advanced AI project and gain valuable experience to enhance your portfolio.
  • Influence how future AI models understand and communicate in your field of expertise.
  • [job_alerts.create_a_job]

    Python Developer • AZ, US

    [internal_linking.similar_jobs]
    Freelance Agent Evaluation Analyst

    Freelance Agent Evaluation Analyst

    Mindrift • AZ, US
    [filters.remote]
    [job_card.part_time] +1
    [filters_job_card.quick_apply]
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...[show_more]
    [last_updated.last_updated_variable_days]
    Border Patrol Agent

    Border Patrol Agent

    U.S. Customs and Border Protection • Roosevelt, Arizona, US
    [job_card.permanent]
    Customs and Border Protection (CBP) offers those interested in a career in law enforcement an exceptional opportunity to work with an elite team of highly trained professionals whose camaraderie, p...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Customs and Border Protection Officer

    Customs and Border Protection Officer

    U.S. Customs and Border Protection • Roosevelt, Arizona, US
    [job_card.full_time]
    Customs and Border Protection Officer (CBPO) NEW RECRUITMENT INCENTIVES! U.Customs and Border Protection (CBP) offers those interested in a career in law enforcement an exceptional opportunity to w...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Customs and Border Protection Officer - Experienced (GS9)

    Customs and Border Protection Officer - Experienced (GS9)

    U.S. Customs and Border Protection • Roosevelt, Arizona, US
    [job_card.full_time]
    Customs and Border Protection Officer (CBPO) NEW RECRUITMENT INCENTIVES! U.Customs and Border Protection (CBP) offers those interested in a career in law enforcement an exceptional opportunity to w...[show_more]
    [last_updated.last_updated_30] • [promoted]
    U.S. Customs and Border Protection Officer

    U.S. Customs and Border Protection Officer

    U.S. Customs and Border Protection • Roosevelt, Arizona, US
    [job_card.full_time]
    Customs and Border Protection Officer (CBPO) NEW RECRUITMENT INCENTIVES! U.Customs and Border Protection (CBP) offers those interested in a career in law enforcement an exceptional opportunity to w...[show_more]
    [last_updated.last_updated_30] • [promoted]
    U.S. Border Patrol Agent

    U.S. Border Patrol Agent

    U.S. Customs and Border Protection • Roosevelt, AZ, United States
    [job_card.full_time]
    Border Patrol Agent (BPA) Entry Level.NEW RECRUITMENT AND RETENTION INCENTIVES!.Duty assignments available at the time of offer may include the Southwest Border, including prioritized locations.Bor...[show_more]
    [last_updated.last_updated_30] • [promoted]
    C# Developer

    C# Developer

    Openkyber • AZ, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    A technology solutions company located in Mesa, AZ is currently looking for a QA Automation Engineer to add to their growing team. They are currently working on a massive project to modernize a coup...[show_more]
    [last_updated.last_updated_variable_days]
    Ready to change your life and someone else’s?

    Ready to change your life and someone else’s?

    Joy of Life Inc • Roosevelt, AZ, United States
    [job_card.full_time]
    Ready to change your life — and someone else’s? .At Joy of Life, every day you make a real difference.Join a team where compassion meets opportunity and earn up to $100K while doing what truly matt...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Application Developer

    Application Developer

    Openkyber • AZ, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Candidates should be based in AZ currently.Application Developer (Senior Engineer -Kotlin / Java ) Summary Our client is seeking a strong Software Engineer ...[show_more]
    [last_updated.last_updated_1_day]
    Technology Lead

    Technology Lead

    Qualis1 Inc • AZ, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Job Title : Technology Lead | Big Data Data Processing | Spark Work Location : Phoenix, AZ 85054 Work Model : Hybrid (3 d...[show_more]
    [last_updated.last_updated_variable_days]
    Field Engineer - 401k with employer match

    Field Engineer - 401k with employer match

    TD SYNNEX • Not Specified, AZ, US
    [job_card.full_time]
    Hey tech enthusiasts! Is the world of NetApp one you've explored? Join our crew as a NetApp Field Engineer! We're looking for talent who can whip up turn-key solutions for NetApp and beyond.Whether...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Neurodevelopmental Disabilities Physician

    Neurodevelopmental Disabilities Physician

    Capstone Recruiting Advisors • Not Specified, AZ, USA
    [job_card.full_time]
    Neurodevelopmental Disabilities Physician at Capstone Recruiting Advisors summary : .Join a leading neurological practice as a Neurodevelopmental Disabilities Physician, focusing on patient care in a...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Helicopter Pilot Med-Trans EG

    Helicopter Pilot Med-Trans EG

    Med-Trans Corporation • Arizona, AZ, United States
    [job_card.full_time]
    If your passion is flying and you want to work in an environment where every second counts, contact us today!.Safety is a key pillar of our services!. This posting is for multiple Visual Flight Rule...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    NetApp Field Engineer

    NetApp Field Engineer

    TD SYNNEX • Not Specified, AZ, US
    [job_card.full_time]
    Hey tech enthusiasts! Is the world of NetApp one you've explored? Join our crew as a NetApp Field Engineer! We're looking for talent who can whip up turn-key solutions for NetApp and beyond.Whether...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Border Patrol Agent - Earn up to $30,000 in Recruitment Incentives

    Border Patrol Agent - Earn up to $30,000 in Recruitment Incentives

    U.S. Customs and Border Protection • Roosevelt, AZ, United States
    [job_card.full_time]
    Border Patrol Agent (BPA) Entry Level.NEW RECRUITMENT AND RETENTION INCENTIVES!.Duty assignments available at the time of offer may include the Southwest Border, including prioritized locations.Bor...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Systems Engineer II - Modeling Simulation & Analysis Engineer

    Systems Engineer II - Modeling Simulation & Analysis Engineer

    Raytheon • AZ, United States
    [job_card.full_time]
    AZ204 : RMS Rita Road Bldg 9020 9000 South Rita Rd Building 9020, Tucson, AZ, 85747 USA.Person, or Immigration Status Requirements : . At Raytheon, the foundation of everything we do is rooted in our v...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    NetApp Field Engineer - Tuition Reimbursement

    NetApp Field Engineer - Tuition Reimbursement

    TD SYNNEX • Not Specified, AZ, US
    [job_card.full_time]
    Hey tech enthusiasts! Is the world of NetApp one you've explored? Join our crew as a NetApp Field Engineer! We're looking for talent who can whip up turn-key solutions for NetApp and beyond.Whether...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    NetApp Field Engineer - PTO + Holidays

    NetApp Field Engineer - PTO + Holidays

    TD SYNNEX • Not Specified, AZ, US
    [job_card.full_time]
    Hey tech enthusiasts! Is the world of NetApp one you've explored? Join our crew as a NetApp Field Engineer! We're looking for talent who can whip up turn-key solutions for NetApp and beyond.Whether...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]