Talent.com
Python Insfrastructure Engineer - Model Evaluation
Python Insfrastructure Engineer - Model EvaluationAlignerr • New York, NY, United States
Python Insfrastructure Engineer - Model Evaluation

Python Insfrastructure Engineer - Model Evaluation

Alignerr • New York, NY, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

About the Job

Alignerr connects top technical experts with leading AI labs to build, evaluate, and improve next-generation models. We work on real production systems and high-impact research workflows across data, tooling, and infrastructure.

Position

Senior Python Full-Stack Engineer - AI Data & Infrastructure

Type : Contract, Remote Commitment : 20-40 hours / week Compensation : Competitive, hourly (based on experience)

Role Responsibilities

  • Design, build, and optimize high-performance systems in Python supporting AI data pipelines and evaluation workflows
  • Develop full-stack tooling and backend services for large-scale data annotation , validation, and quality control
  • Improve reliability, performance, and safety across existing Python codebases
  • Collaborate with data, research, and engineering teams to support model training and evaluation workflows
  • Identify bottlenecks and edge cases in data and system behavior, and implement scalable fixes
  • Participate in synchronous reviews to iterate on system design and implementation decisions

Qualifications

Must-Have

  • Native or fluent English speaker
  • Full-stack developer experience with a strong systems programming background
  • 3-5+ years of professional experience writing production Python.
  • Experience building evaluation harnesses for ML models, integrating with inference frameworks.
  • Strong background in observability and metrics collection to monitor system reliability and model performance.
  • Clear written and verbal communication skills.
  • Ability to commit 20-40 hours per week.
  • Preferred

  • Prior experience with data annotation , data quality, or evaluation systems
  • Familiarity with AI / ML workflows, model training, or benchmarking pipelines
  • Experience with distributed systems or developer tooling
  • Application Process

  • Submit your resume
  • Complete a short technical screening
  • Project matching and onboarding
  • $50 - $75 an hour

    [job_alerts.create_a_job]

    Engineer Python • New York, NY, United States

    [internal_linking.similar_jobs]
    Python Software Engineer

    Python Software Engineer

    Provision People • New York, NY, United States
    [job_card.full_time]
    Our award-winning client is seeking a Python Software Engineer to join their team.The Software Engineer will join the firm's Core Technology Team as a key player in building and scaling the company...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Infrastructure Engineer, Model Serving Platform

    AI Infrastructure Engineer, Model Serving Platform

    Scale AI, Inc. • New York, NY, United States
    [job_card.full_time]
    As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting-edge research and product...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Python Engineer

    Python Engineer

    Genesis10 • New York, NY, United States
    [job_card.permanent] +1
    Genesis10 is currently seeking a Python Engineer with our client in the financial industry located in New York, NY.This is a 12 + month contract position. Ensure that software is developed to meet f...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    MCP & Tools Python Developer - Agent Evaluation Infrastructure

    MCP & Tools Python Developer - Agent Evaluation Infrastructure

    Mind Rift • New York, NY, United States
    [job_card.full_time]
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Python Engineer - AI for Equities Technology

    Python Engineer - AI for Equities Technology

    Millennium Management Corp • New York, NY, United States
    [job_card.full_time]
    Python Engineer - AI for Equities Technology.We are building a cutting-edge data transformation platform designed to convert unstructured data into structured, machine-readable formats for AI and a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Python Data Engineer (Azure), Investment Management

    Python Data Engineer (Azure), Investment Management

    DataArt • New York, NY, United States
    [job_card.full_time]
    Our client is a US-based investment management company listed in the Fortune Global 500.It offers insurance, investment management, and other financial products and services to retail and instituti...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Python Software Engineer - API Integration

    Python Software Engineer - API Integration

    ORBIS • New York, NY, United States
    [job_card.full_time]
    Orbis are proudly partnering with a rapidly growing AI Start-up to hire a Back-end Python Engineer with API Integration experience as part of the next phase of their ambitious growth plans.The orga...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Associate Infrastructure Engineer

    Associate Infrastructure Engineer

    HRT, LLC • New York, New York, US
    [job_card.full_time]
    Associate Infrastructure Engineer- New York, NY-Dev and maint lat sensitive bld & testing infra using prop SW tools in C++ & Python for bldg distrib computing pltfrms, processing lg amts of...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    ML Infrastructure Engineer

    ML Infrastructure Engineer

    Vantai • New York, NY, United States
    [job_card.full_time]
    VantAI pairs bleeding-edge machine learning techniques with deep systems biology expertise to build computational models that uncover hidden relationships between molecules, targets, and diseases.T...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Solutions Engineer

    Solutions Engineer

    Squirro • New York, NY, United States
    [job_card.full_time]
    We are looking for a Solutions Engineer, specialising in Search, or GenAI, or DevOps with strong Python skills, and with relevant work experience in a software product company.You'll be helping to ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Critical Infrastructure Engineer

    Critical Infrastructure Engineer

    DataBank Holdings, Ltd. • Orangeburg, NY, United States
    [job_card.full_time]
    DataBank's managed data center services are anchored in world-class facilities.Our customized technology solutions are designed to help customers effectively manage risk, improve technology perform...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Python Engineer - GD1

    Python Engineer - GD1

    DRW • New York, NY, United States
    [job_card.full_time]
    We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk. Headquartered in Chicago with offices throughout the U.C...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Python Engineer

    Python Engineer

    Apex Informatics • Jersey City, NJ, United States
    [job_card.full_time]
    Jersey City , NJ, Manhattan, NY , Middle town, NY, Houston TX, (5 Days Onsite).W2 Candidates only (nearby candidates).Must have : Python, AWS, Trading experience, Containerization, Equity or Derivat...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Infrastructure Engineer

    Infrastructure Engineer

    Endex • New York, New York, United States
    [job_card.full_time]
    Over the next few years, every financial institution will have teams of AI analysts working alongside their sharpest minds. At Endex, we're on a mission to bridge the present to the inevitable by bu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Infrastructure Engineer

    Infrastructure Engineer

    Blacksmith • New York, New York, United States
    [job_card.full_time]
    At Blacksmith, we provide cloud infra to help companies run their CI (GitHub Actions) substantially faster and cheaper.Our mission is to build a CI cloud. Our bet is that CI, as a class of workloads...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Infrastructure Engineer, Sandboxing

    Infrastructure Engineer, Sandboxing

    Anthropic • New York, New York, United States
    [job_card.full_time]
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior IT & Cloud Infrastructure Engineer

    Senior IT & Cloud Infrastructure Engineer

    Drawbridge Partners • New York, New York, United States
    [job_card.full_time]
    Senior IT & Cloud Infrastructure Engineer.At Drawbridge, we are committed to attracting and retaining the best individuals who enjoy working in a dynamic environment. You will be joining an agile te...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Python AWS Engineer

    Python AWS Engineer

    Saxon Global • New York, NY, United States
    [job_card.full_time]
    Primary function is to develop, test and debug in Python in an AWS environment.Python programming experience - will also accept Go. Experienced in Python API development, testing and debugging.Must ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]