Senior Machine Learning Engineer

A company is looking for a Senior Machine Learning Engineer - AI Eval & Safety.

Key Responsibilities

Architect and develop large-scale evaluation platforms for LLMs and agents

Define standards and metrics for evaluating LLMs and agents

Collaborate with stakeholders to translate evaluation goals into measurable frameworks

Required Qualifications

5+ years of ML engineering experience, with 3+ years in large-scale evaluation of LLMs

Proven experience in building evaluation platforms across various contexts

Deep expertise in designing LLM evaluation metrics

Strong background in scalable platform engineering, including APIs and pipelines

Proficiency in Python, PyTorch, and modern ML ops environments