Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($21-$21 per hour)Mercor • Yonkers, New York, US
[error_messages.no_longer_accepting]
Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($21-$21 per hour)
Mercor • Yonkers, New York, US
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
- [filters.remote]
[job_card.job_description]Machine Learning Engineers with a proven record of building, training, and evaluating high-performance ML systems in real-world environments. In this role, you will design, implement, and curate high-quality machine learning datasets, tasks, and evaluation workflows that power the training and benchmarking of advanced AI systems. This position is ideal for engineers who have excelled in competitive machine learning settings such as Kaggle, possess deep modelling intuition, and can translate complex real-world problem statements into robust, well-structured ML pipelines and datasets. You will work closely with researchers and engineers to develop realistic ML problems, ensure dataset quality, and drive reproducible, high-impact experimentation. Candidates should have 3+ years of applied ML experience or a strong record in competitive ML, and must be based in India. Ideal applicants are proficient in Python, experienced in building reproducible pipelines, and familiar with benchmarking frameworks, scoring methodologies, and ML evaluation best practices. ## Responsibilities Frame unique ML problems for enhancing ML capabilities of LLMs. - Design, build, and optimise machine learning models for classification, prediction, NLP, recommendation, or generative tasks. - Run rapid experimentation cycles, evaluate model performance, and iterate continuously. - Conduct advanced feature engineering and data preprocessing. - Implement adversarial testing, model robustness checks, and bias evaluations. - Fine-tune, evaluate, and deploy transformer-based models where necessary. - Maintain clear documentation of datasets, experiments, and model decisions. - Stay updated on the latest ML research, tools, and techniques to push modelling capabilities forward. ## Required Qualifications At least 3 years of full-time experience in machine learning model development - Technical degree in Computer Science, Electrical Engineering, Statistics, Mathematics, or a related field - Demonstrated competitive machine learning experience (Kaggle, DrivenData, or equivalent) - Evidence of top-tier performance in ML competitions (Kaggle medals, finalist placements, leaderboard rankings) - Strong proficiency in Python PyTorch / TensorFlow , and modern ML / NLP frameworks - Solid understanding of ML fundamentals : statistics, optimisation, model evaluation, architectures - Experience with distributed training, ML pipelines, and experiment tracking - Strong problem-solving skills and algorithmic thinking - Experience working with cloud environments (AWS / GCP / Azure) - Exceptional analytical, communication, and interpersonal skills - Ability to clearly explain modelling decisions, tradeoffs, and evaluation results - Fluency in English ## Preferred / Nice to Have Kaggle Grandmaster Master , or multiple Gold Medals Experience creating benchmarks, evaluations, or ML challenge problems - Background in generative models, LLMs, or multimodal learning - Experience with large-scale distributed training - Prior experience in AI research, ML platforms, or infrastructure teams - Contributions to technical blogs, open-source projects, or research publications - Prior mentorship or technical leadership experience - Published research papers (conference or journal) - Experience with LLM fine-tuning, vector databases, or generative AI workflows - Familiarity with MLOps tools : Weights & Biases, MLflow, Airflow, Docker, etc. - Experience optimising inference performance and deploying models at scale ## Why Join Gain exposure to cutting-edge AI research workflows, collaborating closely with data scientists, ML engineers, and research leaders shaping next-generation AI systems. - Work on high-impact machine learning challenges while experimenting with advanced modelling strategies, new analytical methods, and competition-grade validation techniques. - Collaborate with world-class AI labs and technical teams operating at the frontier of forecasting, experimentation, tabular ML, and multimodal analytics. - Flexible engagement options ( 30–40 hrs / week or full-time ) — ideal for ML engineers eager to apply Kaggle-level problem solving to real-world, production-grade AI systems. - Fully remote and globally flexible — optimised for deep technical work, async collaboration, and high-output research environments.
##
- Role Description
Mercor is hiring on behalf of a leading AI research lab to bring on highly skilled
[job_alerts.create_a_job]
Senior Machine Learning Engineer • Yonkers, New York, US
[internal_linking.similar_jobs]
Constellation is a cutting-edge AI solution that empowers highly regulated and complex industries with the insights and content they need to fuel their business.
Specializing in industries such as h...[show_more]
At Sigma, we’re not just adding AI—we’re building the future of how people work with data.Our platform already lets users explore billions of rows of data in seconds with a spreadsheet-like interfa...[show_more]
Savant is transforming how healthcare and life sciences organizations unlock the value trapped in unstructured medical data.
Our platform combines cutting-edge large language models (LLMs) with doma...[show_more]
Profound is an NYC-based AI startup helping brands measure and improve their visibility in AI platforms such as ChatGPT.We partner with some of the biggest brands and marketing agencies, including ...[show_more]
Accrete is a dynamic and innovative company focused on transforming the future of artificial intelligence.We specialize in creating advanced AI solutions that turn complex data into actionable insi...[show_more] At Sigma, we’re not just adding AI—we’re building the future of how people work with data.Our platform already lets users explore billions of rows of data in seconds with a spreadsheet-like interfa...[show_more] 
SeatGeek believes live events are powerful experiences that unite humans.With our technological savvy and fan-first attitude we’re simplifying and modernizing the ticketing industry.SeatGeek is a t...[show_more]
Constrafor is a SaaS and fintech platform purpose-built for construction.We are setting new standards of productivity and cost-efficiency for the way General Contractors and Subcontractors manage p...[show_more]
PhysicsX is a deep-tech company with roots in numerical physics and Formula One, dedicated to accelerating hardware innovation at the speed of software.
We are building an AI-driven simulation softw...[show_more]
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...[show_more]
Machine Learning Engineer - Model Evaluations, Public Sector.The Public Sector ML team at Scale deploys advanced AI systems-including LLMs, agentic models, and multimodal pipelines-into mission-cri...[show_more]
We’re recruiting AI & ML Engineers across some of the fastest-growing startups in the world — including .Poolside, Parallel, Final Round AI, and Harmonic.
These companies are building cutting-edge p...[show_more]
We are on the lookout for an innovative and driven.In this role, you will be responsible for designing, developing, and deploying AI models that will enhance our products and improve our services.B...[show_more]
At Trovo Health, we’re bringing scalable superhuman support to healthcare providers.Our proprietary, clinically-backed AI coordinator acts as an extension of the care team to help enhance the patie...[show_more]
Curinos empowers financial institutions to make better, faster and more profitable decisions through industry-leading proprietary data, technologies and insights.
With decades-long expertise in the ...[show_more]
Spotify is looking for a Staff ML Engineer to join the Native Ads product area in the Music Mission.In Native Ads, we build consumer and industry-facing music promotion products which provide creat...[show_more]
EvolutionIQ’s mission is to improve the lives of injured and disabled workers and enable them to return to the workforce, saving billions of dollars in avoidable costs and lost productivity to the ...[show_more]
Lead Machine Learning Engineer -ML / AI At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems.
Our investments in technology infrastructure and world...[show_more]
Senior Machine Learning Engineer
Constellation Software • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Staff AI / ML Engineer
Sigma Computing • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI / ML Engineer
Savant Bio • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
AI / ML Engineer
Profound • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Machine Learning Engineer
Accrete-ai • New York, New York, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior AI / ML Engineer
Sigma Computing • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Machine Learning Engineer
Seatgeek • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Sr. AI / ML Engineer
Constrafor • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Machine Learning Engineer
Physicsx • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior AI / ML Software Engineer – Remote
UnitedHealth Group • New York, New York, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Machine Learning Engineer - Model Evaluations, Public Sector
Scale AI, Inc. • New York, NY, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI & Machine Learning Engineer (Multiple Roles, Remote & On-Site)
Mlabs • Jersey City, New Jersey, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
AI Engineer
Zone It Solutions • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Machine Learning Engineer
Trovo Health • New York, NY, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Machine Learning Engineer
Curinos • New York, New York, United States
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]
Staff Machine Learning Engineer, NativeAds
Spotify • New York, New York, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Machine Learning (ML) Engineer (AI Insurtech)
Evolutioniq • New York, New York, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Lead Machine Learning Engineer -ML / AI
Capital One • New York City, NY, US
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]