Staff ML Research Scientist — LLM EvaluationsScale AI • San Francisco, CA, United States
Staff ML Research Scientist — LLM Evaluations
Scale AI • San Francisco, CA, United States
[job_card.1_day_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A leading AI evaluation firm in San Francisco is seeking a Staff Machine Learning Research Scientist. You will lead the development of evaluation methodologies for large language models, define success metrics, and collaborate with industry leaders. The ideal candidate has over 5 years of experience with LLMs and proven leadership skills in a fast-paced environment. The position offers a competitive salary and comprehensive benefits.
#J-18808-Ljbffr
[job_alerts.create_a_job]
Research Scientist • San Francisco, CA, United States
[internal_linking.similar_jobs]
A technology consulting firm is seeking a Data Science Subject Matter Expert to work on AI evaluation.In this entry-level role, you will design workflows for data collection, ensure high-quality da...[show_more]
A leading mobility technology company in San Francisco is seeking an experienced Applied Scientist to join their Mobility Matching Science team.
This role involves developing data-driven insights, c...[show_more]
Candidates must be authorized to work in the United States.Our client, an emerging start-up, is building a revolutionary recommender system, utilizing Artificial intelligence, for the use of their ...[show_more]
A cutting-edge technology company is seeking a Machine Learning Scientist I / II focused on LLM Training & Inference Research.
This role involves leading efforts in training and deploying large langua...[show_more]
Senior Research Engineer, LLM Evaluation and Behavioral Analysis.Together AI is building the fastest, most capable open‑source‑aligned LLMs and inference stack in the world.As part of the Turbo org...[show_more]
Cambridge, MA (Eastern Time / UTC -4).Pragmatike is hiring on behalf of a.AI startup recognized as a Top 10 GenAI company by GTM Capital.
Staff / Principal ML Ops Engineer.ML infrastructure and prod...[show_more]
We’re creating the foundation for AI systems that don’t just generate, but retrieve, link, and reason over enterprise knowledge.
In just over a year, we’ve begun partnering with Fo...[show_more]
Client Opportunity | Through Phizenix.Phizenix, a certified minority and women-led recruiting firm, is hiring on behalf of an innovative generative AI startup that's developing diffusion-based ...[show_more]
We’re building a future where AI systems are not only powerful but safe, aligned, and robust against misuse.Our team focuses on advancing practical safety techniques for large language models (LLMs...[show_more]
At Agtonomy, we’re not just building tech—we’re transforming how vital industries get work done.Our Physical AI and fleet services turn heavy machinery into intelligent, autonomou...[show_more]
Machine Learning Engineer, Training Infrastructure.We are looking for an ML Engineer with 3+ YOE in high-performance computing systems to manage and optimize our computational infrastruct...[show_more]
ML Research Scientist, Foundation Models (Senior / Staff / Principal).ML Research Scientist, Foundation Models (Senior / Staff / Principal).
Get AI-powered advice on this job and more exclusive feat...[show_more]
A moonshot company is seeking a Machine Learning Engineer / Scientist to join their interdisciplinary team in San Francisco.
The role involves building ML systems for developing new cryoprotectant for...[show_more]
XQ Institute is the nation's leading organization dedicated to rethinking the high school experience so that every student graduates ready to succeed in life.
We work in communities nationwide, ...[show_more]
Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbreaking new class of grid management called active grid response...[show_more]
Our three-sided marketplace connects 18 million students and alumni, 1,500+ academic institutions across the U.Europe, and 1 million employers to power how the next generation explores careers, bui...[show_more]
Staff Machine Learning Research Scientist, LLM Evals.Join the team shaping the future of AI at Scale.As the leading data and evaluation partner for frontier AI companies, Scale is dedicated to adva...[show_more]
A global talent marketplace is seeking Machine Learning Researchers for a remote role evaluating AI-generated research plans.
This position offers flexible hours and competitive pay up to $140 / hour....[show_more]
Remote Data Science SME — AI Evaluation & LLM Tests
Braintrust • San Francisco, CA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Staff Scientist : Mobility Matching & ML Optimization
Uber • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI & ML - Staff Scientist
Signify Technology • San Francisco, CA, United States
[job_card.full_time] +1
[last_updated.last_updated_variable_days] • [promoted]
LLM Training & Inference Scientist for Scientific AI
Lila Sciences, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Research Engineer, LLM Evaluation and Behavioral Analysis
Together AI • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Staff / Principal ML Ops Engineer
PRAGMATIKE • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_1_day] • [promoted]
MLE, ML Platform
zaimler • San Mateo, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
ML Engineer
Phizenix • Menlo Park, CA, US
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Senior Staff ML Engineer - AI Safety & Evaluation
A10 Networks, Inc • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior / Staff Machine Learning Engineer, Perception
Agtonomy • South San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Machine Learning Engineer, Training Infrastructure
IntelliPro Group Inc. • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
ML Research Scientist, Foundation Models (Senior / Staff / Principal)
Genesis Therapeutics • Burlingame, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
ML Scientist for Breakthrough Biotech Discovery
Until • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Head of Research, Evaluation, and Insights
XQ • Oakland, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Applied ML Scientist, ML DSP
Gridware • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Staff AI Research Scientist - Evaluation, Handshake AI
Handshake • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Staff Machine Learning Research Scientist, LLM Evals
Scale AI, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote ML Researcher & AI Research Plan Evaluator
Mercor • San Francisco, CA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [promoted] • [new]