Talent.com
AI Evaluation Platform Engineer
AI Evaluation Platform EngineerVirtualVocations • Burbank, California, United States
[error_messages.no_longer_accepting]
AI Evaluation Platform Engineer

AI Evaluation Platform Engineer

VirtualVocations • Burbank, California, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.temporary]
[job_card.job_description]

A company is looking for a Senior Platform Engineer, AI Evaluation (24 months fixed-term).

Key Responsibilities

Evolve and extend the internal evaluation framework for AI-driven experiences

Collaborate with ML data engineers and platform developers to implement an eval-driven development process

Develop documentation and training materials while gathering internal requirements

Required Qualifications

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field

5 years of Software Engineering experience, including 2+ years in evaluating generative AI systems

Strong programming skills in Go, Python, SQL, and experience with a data pipeline framework

Familiarity with large language model architecture and industry-standard APIs

[job_alerts.create_a_job]

Ai Platform Engineer • Burbank, California, United States

[internal_linking.similar_jobs]
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND Corporation • Santa Monica, CA, United States
[job_card.temporary]
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...[show_more]
[last_updated.last_updated_30] • [promoted]
Reverse Engineer Vulnerability Researcher

Reverse Engineer Vulnerability Researcher

The Aerospace Corporation • El Segundo, CA, United States
[job_card.full_time]
The Aerospace Corporation is the trusted partner to the nation's space programs, solving the hardest problems and providing unmatched technical expertise. As the operator of a federally funded resea...[show_more]
[last_updated.last_updated_30] • [promoted]
Founding AI Engineer

Founding AI Engineer

Kixie • Santa Monica, California, United States
[job_card.full_time]
At Kixie, we’re building a modern, all-in-one sales engagement platform that helps teams work smarter and close deals faster. Our cloud-based calling and texting solution integrates seamlessly with ...[show_more]
[last_updated.last_updated_30] • [promoted]
Principal AI Engineer

Principal AI Engineer

Kizen • Los Angeles, California, United States
[job_card.full_time]
Hybrid (Minimum 4 days in office) | Full Time | https : / / kizen.At Kizen, we’re engineering a more humane future where AI drives universal healthcare, more impactful work, world-class education, ...[show_more]
[last_updated.last_updated_30] • [promoted]
Remote AI Writing Evaluator

Remote AI Writing Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote English Writer

Remote English Writer

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Senior Machine Learning Engineer

Senior Machine Learning Engineer

Capital Group • Los Angeles, CA, United States
[job_card.full_time]
I can succeed as a Machine Learning Engineer at Capital Group".We are seeking an experienced Machine Learning Engineer to design, research, implement, deliver and operate Generative AI capabilities...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Engineer

AI Engineer

Black Rock Solutions Corporation • Los Angeles, CA, US
[job_card.full_time]
We are seeking an AI Engineer with strong C# Microsoft Full Stack expertise and deep experience across the Microsoft ecosystem. The candidate must have hands-on proficiency in Azure AI Foundry for m...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer

AI Engineer

Open Roles At Outsmart • Culver City, California, United States
[job_card.full_time]
In this role, you’ll be at the forefront of the machine learning that powers Outsmart’s applications.As an early member of the engineering team you’ll play a critical role in setting the tone for O...[show_more]
[last_updated.last_updated_30] • [promoted]
Applied AI Engineer

Applied AI Engineer

Axle Mobility • Los Angeles, California, United States
[filters.remote]
[job_card.full_time]
Axle is rebuilding the back office of commercial vehicle operations with AI-native tools for the people who keep the world moving : drivers, technicians, service leaders, operators, and fleet manage...[show_more]
[last_updated.last_updated_30] • [promoted]
Lead AI AppSec Engineer

Lead AI AppSec Engineer

Capital Group • Los Angeles, CA, United States
[job_card.full_time]
I can succeed as a Lead AI AppSec Engineer at Capital Group".As a LeadAIAppSecEngineer,you will work with application teams to ensure the security of custom andprocuredAI solutions.You'llcollaborat...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Trainer -Remote Writing Evaluator

AI Trainer -Remote Writing Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Trainer -Remote Text Quality Evaluator

AI Trainer -Remote Text Quality Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote Text Quality Evaluator

Remote Text Quality Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Lead AI Security Engineer

Lead AI Security Engineer

Capital Group • Los Angeles, CA, United States
[job_card.full_time]
I can succeed as a Lead AI Security Engineer at Capital Group".As aLeadAISecurity Engineer, you willbe responsible forsecuring Capital Group's enterprise AI Platforms. You'llcollaborate with platfor...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Engineer

AI Engineer

Capsule • Los Angeles, California, United States
[job_card.full_time]
Capsule is building the world’s most intuitive AI-powered video editing tool, designed for modern teams.We’re a Series A startup led by two serial founders who have built and scaled creative platfo...[show_more]
[last_updated.last_updated_30] • [promoted]
Lead Engineer, AI

Lead Engineer, AI

Absurd Ventures • Santa Monica, California, United States
[job_card.full_time]
We are seeking a highly skilled and experienced.As the Lead AI Engineer, you will be responsible for overseeing the design, development, and optimization of game artificial intelligence systems- fr...[show_more]
[last_updated.last_updated_30] • [promoted]
Work From Home -Remote Text Quality Evaluator

Work From Home -Remote Text Quality Evaluator

Outlier • Remote, LA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]