Talent.com
AI Evaluation Platform Engineer
AI Evaluation Platform EngineerVirtualVocations • Burbank, California, United States
[error_messages.no_longer_accepting]
AI Evaluation Platform Engineer

AI Evaluation Platform Engineer

VirtualVocations • Burbank, California, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.temporary]
[job_card.job_description]

A company is looking for a Senior Platform Engineer, AI Evaluation (24 months fixed-term).

Key Responsibilities

Evolve and extend the internal evaluation framework for AI-driven experiences

Collaborate with ML data engineers and platform developers to implement an eval-driven development process

Develop documentation and training materials while gathering internal requirements

Required Qualifications

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field

5 years of Software Engineering experience, including 2+ years in evaluating generative AI systems

Strong programming skills in Go, Python, SQL, and experience with a data pipeline framework

Familiarity with large language model architecture and industry-standard APIs

[job_alerts.create_a_job]

Ai Platform Engineer • Burbank, California, United States

[internal_linking.similar_jobs]
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND Corporation • Santa Monica, CA, United States
[job_card.temporary]
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...[show_more]
[last_updated.last_updated_30] • [promoted]
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND • Santa Monica, CA, United States
[job_card.temporary]
RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda.As Research Lead - AI Cyb...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Cyber Testing & Evaluation Research Lead

AI Cyber Testing & Evaluation Research Lead

RAND Corporation • Santa Monica, CA, United States
[job_card.full_time]
A leading research organization is seeking a Research Lead for AI Cyber Testing & Evaluation in Santa Monica.The ideal candidate will have over 6 years of technical and management experience, leadi...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote AI Writing Evaluator

Remote AI Writing Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Work From Home -Remote AI Writing Evaluator

Work From Home -Remote AI Writing Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Senior Machine Learning Engineer

Senior Machine Learning Engineer

Capital Group • Los Angeles, CA, United States
[job_card.full_time]
I can succeed as a Machine Learning Engineer at Capital Solutions Group Technology (CSGT)".As a Machine Learning Engineer in CSGT, you will design and implement intelligent systems that enhance por...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Engineer

AI Engineer

Black Rock Solutions Corporation • Los Angeles, CA, US
[job_card.full_time]
We are seeking an AI Engineer with strong C# Microsoft Full Stack expertise and deep experience across the Microsoft ecosystem. The candidate must have hands-on proficiency in Azure AI Foundry for m...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Principal AI Engineer

Principal AI Engineer

Alo Yoga • Beverly Hills, California, USA
[job_card.full_time]
Its at the core of why we do what we do at ALOits our calling.Because mindful movement in the studio leads to better living. It changes who yogis are off the mat making their lives and their communi...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Core Eng Manager — Lead & Scale AI Platforms

AI Core Eng Manager — Lead & Scale AI Platforms

Disneyland Hong Kong • Glendale, California, United States
[job_card.full_time]
A leading entertainment company is seeking a Manager in Software Engineering to lead the AI Core Engineering team.In this role, you will oversee a team of engineers to build core AI capabilities an...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote GenAI Engineer

Remote GenAI Engineer

Irvine Technology Corporation • Los Angeles, CA, US
[filters.remote]
[job_card.full_time]
RAG (Retrieval-Augmented Generation) pipelines.The ideal candidate will be a hands-on builder with experience developing AI pipelines and models in production environments - ideally coming out of.A...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Software Engineer - AI Platform

Senior Software Engineer - AI Platform

StubHub • Los Angeles, CA, US
[job_card.full_time]
StubHub is on a mission to redefine the live event experience on a global scale.Whether someone is looking to attend their first event or their hundredth, we're here to delight them all the way...[show_more]
[last_updated.last_updated_30] • [promoted]
Lead AI AppSec Engineer

Lead AI AppSec Engineer

Capital Group • Los Angeles, CA, United States
[job_card.full_time]
I can succeed as a Lead AI AppSec Engineer at Capital Group".As a LeadAIAppSecEngineer,you will work with application teams to ensure the security of custom andprocuredAI solutions.You'llcollaborat...[show_more]
[last_updated.last_updated_30] • [promoted]
Generative AI Engineer

Generative AI Engineer

Apptad Inc • Los Angeles, California, USA
[job_card.full_time]
Generative AI AI ML and Data Science technologies.Extensive handson experience in implementing end to end projects utilizing GenerativeAI. Experience in building production grade solutions utilizing...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Research and Development Engineer 3

Research and Development Engineer 3

InsideHigherEd • Los Angeles, California, United States
[job_card.full_time]
Welcome to the Department of Earth, Planetary, and Space Sciences (EPSS) at UCLA.Our mission is to understand Earth and our surrounding solar system, as well as extrasolar planets and the star syst...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Lead ML Engineer – Ad Platforms AI & Innovation

Lead ML Engineer – Ad Platforms AI & Innovation

Disney Cruise Line - The Walt Disney Company • Santa Monica, CA, United States
[job_card.full_time]
A leading entertainment company is seeking a lead machine learning engineer in Santa Monica.This role focuses on driving innovation in advertising through AI and machine learning, requiring experie...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Trainer -Remote Writing Evaluator

AI Trainer -Remote Writing Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Trainer -Remote Text Quality Evaluator

AI Trainer -Remote Text Quality Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote Text Quality Evaluator

Remote Text Quality Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]