Talent.com
Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($35-$35 per hour)
Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($35-$35 per hour)Mercor • Vallejo, California, US
Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($35-$35 per hour)

Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($35-$35 per hour)

Mercor • Vallejo, California, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters.remote]
[job_card.job_description]

##

  • Role Description

Mercor is hiring on behalf of a leading AI research lab to bring on highly skilled

  • Machine Learning Engineers
  • with a proven record of building, training, and evaluating high-performance ML systems in real-world environments. In this role, you will design, implement, and curate high-quality machine learning datasets, tasks, and evaluation workflows that power the training and benchmarking of advanced AI systems. This position is ideal for engineers who have excelled in competitive machine learning settings such as Kaggle, possess deep modelling intuition, and can translate complex real-world problem statements into robust, well-structured ML pipelines and datasets. You will work closely with researchers and engineers to develop realistic ML problems, ensure dataset quality, and drive reproducible, high-impact experimentation.
  • Candidates should have 2+ years of applied ML experience or a strong record in competitive ML, and must be based in India.
  • Ideal applicants are proficient in Python, experienced in building reproducible pipelines, and familiar with benchmarking frameworks, scoring methodologies, and ML evaluation best practices.
  • ##
  • Responsibilities
  • Frame unique ML problems for enhancing ML capabilities of LLMs. - Design, build, and optimise machine learning models for classification, prediction, NLP, recommendation, or generative tasks. - Run rapid experimentation cycles, evaluate model performance, and iterate continuously. - Conduct advanced feature engineering and data preprocessing. - Implement adversarial testing, model robustness checks, and bias evaluations. - Fine-tune, evaluate, and deploy transformer-based models where necessary. - Maintain clear documentation of datasets, experiments, and model decisions. - Stay updated on the latest ML research, tools, and techniques to push modelling capabilities forward.
  • ##
  • Required Qualifications
  • At least
  • 2 years
  • of full-time experience in machine learning model development - Technical degree in Computer Science, Electrical Engineering, Statistics, Mathematics, or a related field - Demonstrated competitive machine learning experience (Kaggle, DrivenData, or equivalent) - Evidence of top-tier performance in ML competitions (Kaggle medals, finalist placements, leaderboard rankings) - Strong proficiency in
  • Python
  • PyTorch / TensorFlow
  • , and modern ML / NLP frameworks - Solid understanding of ML fundamentals : statistics, optimisation, model evaluation, architectures - Experience with distributed training, ML pipelines, and experiment tracking - Strong problem-solving skills and algorithmic thinking - Experience working with cloud environments (AWS / GCP / Azure) - Exceptional analytical, communication, and interpersonal skills - Ability to clearly explain modelling decisions, tradeoffs, and evaluation results - Fluency in English
  • ##
  • Preferred / Nice to Have
  • Kaggle
  • Grandmaster
  • Master
  • , or multiple
  • Gold Medals
  • Experience creating benchmarks, evaluations, or ML challenge problems - Background in generative models, LLMs, or multimodal learning - Experience with large-scale distributed training - Prior experience in AI research, ML platforms, or infrastructure teams - Contributions to technical blogs, open-source projects, or research publications - Prior mentorship or technical leadership experience - Published research papers (conference or journal) - Experience with LLM fine-tuning, vector databases, or generative AI workflows - Familiarity with MLOps tools : Weights & Biases, MLflow, Airflow, Docker, etc. - Experience optimising inference performance and deploying models at scale
  • ##
  • Why Join
  • Gain exposure to cutting-edge AI research workflows, collaborating closely with data scientists, ML engineers, and research leaders shaping next-generation AI systems. - Work on high-impact machine learning challenges while experimenting with advanced modelling strategies, new analytical methods, and competition-grade validation techniques. - Collaborate with world-class AI labs and technical teams operating at the frontier of forecasting, experimentation, tabular ML, and multimodal analytics. - Flexible engagement options (
  • 30–40 hrs / week or full-time
  • ) — ideal for ML engineers eager to apply Kaggle-level problem solving to real-world, production-grade AI systems. - Fully remote and globally flexible — optimised for deep technical work, async collaboration, and high-output research environments.
    • [job_alerts.create_a_job]

    Senior Machine Learning Engineer • Vallejo, California, US

    [internal_linking.similar_jobs]
    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Data Annotation • Berkeley, California
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI Engineer — Agentic LLMs Lead & Mentor (Remote)

    Senior AI Engineer — Agentic LLMs Lead & Mentor (Remote)

    LiveRamp • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A leading data collaboration platform in San Francisco is seeking a Senior Staff AI Engineer to lead the development of advanced AI agents. This role entails mentoring a talented team and collaborat...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior LLM Engineer : Custom Models & Generative AI

    Senior LLM Engineer : Custom Models & Generative AI

    Amazon Jobs • San Francisco, CA, United States
    [job_card.full_time]
    A leading technology company in San Francisco is seeking a Software Development Engineer to drive the development of custom Large Language Models (LLMs). You will design and implement scalable train...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Generative AI Engineer — LLMs & Scaled Training

    Generative AI Engineer — LLMs & Scaled Training

    Amazon Web Services (AWS) • San Francisco, California, United States
    [job_card.full_time]
    A leading cloud provider in San Francisco is seeking a Machine Learning Engineer to innovate in developing Large Language Models for various applications. The role involves designing distributed tra...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior ML Engineer - AI Evaluation & LLM Simulation

    Senior ML Engineer - AI Evaluation & LLM Simulation

    Apple Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A leading technology company in San Francisco is seeking a Senior or Staff-level Applied ML Engineer.In this hands-on role, you will help design and build AI evaluation systems, focusing on creatin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Applied AI Engineer : Lead LLM Agent Evaluations (Remote)

    Applied AI Engineer : Lead LLM Agent Evaluations (Remote)

    Canvas Medical • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A healthcare technology firm is looking for an Applied AI Software Engineer to lead evaluations of AI agents in clinical operations. The ideal candidate has over 5 years of experience in machine lea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote Senior ML Engineer - AdTech AI for Ads Platform

    Remote Senior ML Engineer - AdTech AI for Ads Platform

    TechLink Resources, Inc • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A tech recruitment agency seeks a Machine Learning Engineer with AdTech experience in San Francisco.The ideal candidate will drive innovation by applying AI and machine learning to optimize the adv...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior ML Modeling Engineer — Remote AI for Support

    Senior ML Modeling Engineer — Remote AI for Support

    Block • San Francisco, California, United States
    [filters.remote]
    [job_card.full_time]
    A technology company located in San Francisco is seeking an experienced leader in machine learning to drive innovative initiatives and improve customer support via AI. This role requires over 10 yea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior ML Engineer — Production-Ready LLMs + Equity

    Senior ML Engineer — Production-Ready LLMs + Equity

    Supio • San Francisco, CA, United States
    [job_card.full_time]
    A leading tech company in San Francisco is looking for a Senior Machine Learning Engineer to drive the validation of AI systems. The role involves designing and deploying machine learning systems, c...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Staff ML Engineer — LLMs & Production AI

    Senior Staff ML Engineer — LLMs & Production AI

    Rippling • San Francisco, CA, United States
    [job_card.full_time]
    A prominent tech company based in San Francisco is looking for a Senior Staff Machine Learning Engineer to drive innovation in their products. You will collaborate across teams to develop and implem...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI / ML Engineer - Distributed Training on Neuron

    Senior AI / ML Engineer - Distributed Training on Neuron

    Amazon • San Francisco, CA, United States
    [job_card.full_time]
    A leading technology company in San Francisco is seeking a Senior Machine Learning Engineer to join the AWS Neuron Distributed Training team. This role involves developing and enabling software stac...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Machine Learning Engineer - LLMs & Document AI

    Senior Machine Learning Engineer - LLMs & Document AI

    EvenUp • San Francisco, CA, United States
    [job_card.full_time]
    EvenUp is on a mission to close the justice gap using technology and AI.We empower personal injury lawyers and victims to get the justice they deserve. Our products enable law firms to secure faster...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI / ML Engineer - Build Tax-Ready AI Features (Remote)

    AI / ML Engineer - Build Tax-Ready AI Features (Remote)

    Keeper Tax Inc. • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A technology company in the finance sector is seeking an experienced AI / ML engineer to develop user-friendly features powered by advanced machine learning tools. Ideal candidates will have a strong ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior LLM Engineer, AI Product & Orchestration

    Senior LLM Engineer, AI Product & Orchestration

    Fermatcommerce • San Francisco, CA, United States
    [job_card.full_time]
    A cutting-edge AI commerce platform is seeking a skilled Software Engineer to develop and enhance LLM-powered features.This role involves designing and building production-grade intelligence engine...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI / ML Engineer - Known

    AI / ML Engineer - Known

    Matter Intelligence • San Francisco, CA, United States
    [job_card.full_time]
    You’ll develop and deploy the ML systems that make Known work - from compatibility scoring and recommendations to natural language / voice interaction. You’ll work closely with platform engineers to s...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Machine Learning Engineer - Model Evaluations, Public Sector

    Machine Learning Engineer - Model Evaluations, Public Sector

    Scale AI, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Machine Learning Engineer - Model Evaluations, Public Sector.The Public Sector ML team at Scale deploys advanced AI systems-including LLMs, agentic models, and multimodal pipelines-into mission-cri...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior ML Engineer — Scalable AI & Personalization (Remote)

    Senior ML Engineer — Scalable AI & Personalization (Remote)

    Quizlet • San Francisco, California, United States
    [filters.remote]
    [job_card.full_time]
    A leading educational technology company in San Francisco is seeking a Machine Learning Engineer to drive AI initiatives. This role requires extensive experience in Python, ML libraries, and a solid...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote Senior ML Engineer : Production Generative AI & RAG

    Remote Senior ML Engineer : Production Generative AI & RAG

    DigitalOcean • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A tech cloud company in San Francisco is looking for a Senior Engineer II, Copilots, to lead the development of AI solutions. The role involves designing AI applications and implementing systems for...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]