Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($35-$35 per hour)Mercor • Avondale, Arizona, US

Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($35-$35 per hour)

Mercor • Avondale, Arizona, US

[job_card.variable_days_ago]

[job_preview.job_type]

[job_card.full_time]

[filters.remote]

[job_card.job_description]

Role Description

Mercor is hiring on behalf of a leading AI research lab to bring on highly skilled

Machine Learning Engineers

with a proven record of building, training, and evaluating high-performance ML systems in real-world environments. In this role, you will design, implement, and curate high-quality machine learning datasets, tasks, and evaluation workflows that power the training and benchmarking of advanced AI systems. This position is ideal for engineers who have excelled in competitive machine learning settings such as Kaggle, possess deep modelling intuition, and can translate complex real-world problem statements into robust, well-structured ML pipelines and datasets. You will work closely with researchers and engineers to develop realistic ML problems, ensure dataset quality, and drive reproducible, high-impact experimentation.

Candidates should have 2+ years of applied ML experience or a strong record in competitive ML, and must be based in India.

Ideal applicants are proficient in Python, experienced in building reproducible pipelines, and familiar with benchmarking frameworks, scoring methodologies, and ML evaluation best practices.

Responsibilities

Frame unique ML problems for enhancing ML capabilities of LLMs. - Design, build, and optimise machine learning models for classification, prediction, NLP, recommendation, or generative tasks. - Run rapid experimentation cycles, evaluate model performance, and iterate continuously. - Conduct advanced feature engineering and data preprocessing. - Implement adversarial testing, model robustness checks, and bias evaluations. - Fine-tune, evaluate, and deploy transformer-based models where necessary. - Maintain clear documentation of datasets, experiments, and model decisions. - Stay updated on the latest ML research, tools, and techniques to push modelling capabilities forward.

Required Qualifications

At least

2 years

of full-time experience in machine learning model development - Technical degree in Computer Science, Electrical Engineering, Statistics, Mathematics, or a related field - Demonstrated competitive machine learning experience (Kaggle, DrivenData, or equivalent) - Evidence of top-tier performance in ML competitions (Kaggle medals, finalist placements, leaderboard rankings) - Strong proficiency in

Python

PyTorch / TensorFlow

, and modern ML / NLP frameworks - Solid understanding of ML fundamentals : statistics, optimisation, model evaluation, architectures - Experience with distributed training, ML pipelines, and experiment tracking - Strong problem-solving skills and algorithmic thinking - Experience working with cloud environments (AWS / GCP / Azure) - Exceptional analytical, communication, and interpersonal skills - Ability to clearly explain modelling decisions, tradeoffs, and evaluation results - Fluency in English

Preferred / Nice to Have

Kaggle

Grandmaster

Master

, or multiple

Gold Medals

Experience creating benchmarks, evaluations, or ML challenge problems - Background in generative models, LLMs, or multimodal learning - Experience with large-scale distributed training - Prior experience in AI research, ML platforms, or infrastructure teams - Contributions to technical blogs, open-source projects, or research publications - Prior mentorship or technical leadership experience - Published research papers (conference or journal) - Experience with LLM fine-tuning, vector databases, or generative AI workflows - Familiarity with MLOps tools : Weights & Biases, MLflow, Airflow, Docker, etc. - Experience optimising inference performance and deploying models at scale

Why Join

Gain exposure to cutting-edge AI research workflows, collaborating closely with data scientists, ML engineers, and research leaders shaping next-generation AI systems. - Work on high-impact machine learning challenges while experimenting with advanced modelling strategies, new analytical methods, and competition-grade validation techniques. - Collaborate with world-class AI labs and technical teams operating at the frontier of forecasting, experimentation, tabular ML, and multimodal analytics. - Flexible engagement options (

30–40 hrs / week or full-time

) — ideal for ML engineers eager to apply Kaggle-level problem solving to real-world, production-grade AI systems.

[job_alerts.create_a_job]

Senior Machine Learning Engineer • Avondale, Arizona, US

[internal_linking.similar_jobs]

Remote Senior Java Engineer - AI Trainer

SuperAnnotate • Goodyear, Arizona, US

[filters.remote]

[job_card.full_time]

As a Senior Java Engineer, you will work remotely on an hourly paid basis to review AI-generated Java code, architectural solutions, and technical explanations, as well as generate high-quality ref...[show_more]

[last_updated.last_updated_variable_days]

Remote Rust Engineer - AI Trainer

SuperAnnotate • Surprise, Arizona, US

[filters.remote]

[job_card.full_time]

As an hourly paid, fully remote Rust Engineer for AI Data Training, you will review AI-generated Rust code and explanations or generate your own, evaluate the reasoning quality and step-by-step pro...[show_more]

[last_updated.last_updated_variable_days]

Remote Mechanical Engineer - AI Trainer

SuperAnnotate • Avondale, Arizona, US

[filters.remote]

[job_card.full_time]

In this hourly, remote contractor role, you will review AI-generated engineering solutions and / or generate expert Mechanical Engineering content, evaluating reasoning quality and step-by-step probl...[show_more]

[last_updated.last_updated_variable_days]

Remote Investment Analyst - AI Model Trainer

Data Annotation • Surprise, AZ, United States

[job_card.full_time] +1

We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

SuperAnnotate • Glendale, Arizona, US

[filters.remote]

[job_card.full_time]

AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with mode...[show_more]

[last_updated.last_updated_variable_days]