AI Agent Monitoring & Evaluation ScientistDatagrid • San Francisco, California, United States
AI Agent Monitoring & Evaluation Scientist
Datagrid • San Francisco, California, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]
A growing AI technology company in San Francisco is seeking a Data Scientist focused on AI Agent Monitoring & Evaluation. You will build evaluation frameworks and monitoring tools for AI agents, ensuring quality and reliability across multiple systems. The ideal candidate has 3-7 years of experience in data science and is skilled in ML systems and dashboarding practices. A competitive salary range of $125,000 - $185,000 is offered, along with generous benefits and a flexible work environment.
#J-18808-Ljbffr
[job_alerts.create_a_job]
Ai Scientist • San Francisco, California, United States
[internal_linking.similar_jobs]
A leading e-commerce company is looking for a Principal Applied Scientist to lead a team in developing innovative AI solutions for advertisers in San Francisco.
This role involves managing a roadmap...[show_more]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
We are looking for dedicated professionals who thrive on tackling complex challenges and are committed to improving the lives of patients.
If you value innovation, collaboration, and integrity, and ...[show_more]
A leading AI evaluation firm is looking for a Senior Data Scientist to explore data that powers AI evaluations.You will analyze complex datasets, conduct experiments, and collaborate with ML resear...[show_more]
Symbolica is an AI research lab pioneering the application of category theory to enable logical reasoning in machines.We're a well-resourced, nimble team of experts on a mission to bridge the g...[show_more]
About Richmond Wholesale Meats : .Richmond Wholesale Meats, a Pro Food Solutions company, is a trusted leader in protein distribution with over 60 years of experience serving foodservice operators, g...[show_more]
DimRed is building a platform to automate the most challenging parts of scaling AI Agents and LLM-based systems.We believe the path forward for AI systems is grounded in reliability and interpretab...[show_more]
The organization conducts cutting-edge research in areas such as energy, environment, computing, and materials science, fostering collaboration among world-class scientists and engineers.Its missio...[show_more]
A leading technology company is seeking AI Research Scientists / Research Engineers to drive innovation and tackle enterprise-level problems through AI.
Successful candidates will have a strong backgr...[show_more]
A leading research firm in San Francisco is looking for a Research Scientist to join their expanding Research Group.The ideal candidate will have a PhD in relevant fields and 2+ years' experience w...[show_more]
At Atom Computing, we build quantum computers using arrays of optically trapped neutral atoms that will empower customers to achieve unprecedented computational breakthroughs.Join a world-class tea...[show_more]
Assistant Project Scientist - Functional Genomics and Developmental Biology - Molecular and Cell Biology.The UC academic salary scales set the minimum pay determined by rank and step at appointment...[show_more]
A leading AI technology company is seeking a Research Scientist for their AI Research team.The role involves developing cutting-edge AI technologies and collaborating with engineers on ambitious pr...[show_more]
Anomali is headquartered in Silicon Valley and is the Leading AI-Powered Security Operations Platform that is modernizing security operations.
At the center of it is an omnipresent, intelligent, and...[show_more]
Retro develops therapies for diseases driven by the biology of aging.We focus on cellular reprogramming and autophagy to rejuvenate cell and tissue function with the ultimate aim of adding 10 years...[show_more]
A health technology company is seeking a Data Scientist - AI Agent to support innovations in data-driven healthcare.This hybrid position requires advanced expertise in AI and ML, with responsibilit...[show_more]
Kasa is the leading tech-enabled hotel and apartment hotel brand and manager.Kasa has built a hospitality operating system that fundamentally improves the profitability of hospitality assets while ...[show_more]
A growing AI technology company in San Francisco is seeking a Data Scientist focused on AI Agent Monitoring & Evaluation.
You will build evaluation frameworks and monitoring tools for AI agents, ens...[show_more]
Principal AI Scientist - Advertiser Growth
Amazon • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote M&A Associate - AI Trainer ($50-$60 / hour)
Data Annotation • Berkeley, California
[filters.remote]
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Contract Research Associate (In Vivo)
5AM Ventures • Berkeley, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Data Scientist - AI Evaluation & Equity
Arena Inteliigence • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Agent Engineer
Symbolica AI • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Research and Development (R&D) and Sourcing Associate
Wolf Recruiting • Richmond, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Founding AI Research Scientist
DimRed • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Electronics Engineering Associate
LTD Global • Berkeley, CA, US
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
AI Research Scientist — Agentic & Multimodal Systems
Salesforce, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Research Scientist : AI Agents & LLMs (Hybrid, SF)
Goliath Partners • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Optimization Engineer (Operations Research)
Atom Computing • Berkeley, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Assistant Project Scientist - Functional Genomics and Developmental Biology
InsideHigherEd • Berkeley, California, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Research Scientist – Generative AI & Agentic Systems
Salesforce • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Engineer, AI Evaluation & Reliability (Agentic AI)
Anomali • Redwood City, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Microglia Scientist
Retro • Redwood City, CA, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Healthcare AI Scientist : LLM Agents & Data Innovation
Verily • San Bruno, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
AI Innovation Specialist
Kasa • San Francisco, CA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
AI Agent Monitoring & Evaluation Scientist
Datagrid • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]