Talent.com
AI Evaluation Platform Engineer
AI Evaluation Platform EngineerVirtualVocations • Alexandria, Virginia, United States
[error_messages.no_longer_accepting]
AI Evaluation Platform Engineer

AI Evaluation Platform Engineer

VirtualVocations • Alexandria, Virginia, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.temporary]
[job_card.job_description]

A company is looking for a Senior Platform Engineer, AI Evaluation (24 months fixed-term).

Key Responsibilities

Evolve and extend the internal evaluation framework for AI-driven experiences

Collaborate with ML data engineers and platform developers to implement an eval-driven development process

Develop documentation and training materials while gathering internal requirements

Required Qualifications

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field

5 years of Software Engineering experience, including 2+ years in evaluating generative AI systems

Strong programming skills in Go, Python, SQL, and experience with a data pipeline framework

Familiarity with large language model architecture and industry-standard APIs

[job_alerts.create_a_job]

Ai Platform Engineer • Alexandria, Virginia, United States

[internal_linking.similar_jobs]
Remote AI Writing Evaluator

Remote AI Writing Evaluator

Outlier • Remote, WV, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer

AI Engineer

Hatch IT • Washington, DC, US
[job_card.full_time]
Expression is seeking an experienced.Generative AI to support the continued growth of their Data Science Department.In this role, you will design and execute high-impact AI solutions for a wide ran...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Sustaining Engineer Principal - AI Center of Excellence - Remote

AI Sustaining Engineer Principal - AI Center of Excellence - Remote

Prime Therapeutics • Washington, DC, United States
[filters.remote]
[job_card.full_time]
AI Sustaining Engineer Principal - AI Center of Excellence - Remote.The Principal Artificial Intelligence (AI) Engineer is responsible for delivering on the modernization of Prime’s AI capabilities...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Model Evaluator (Remote)

AI Model Evaluator (Remote)

Scale AI • Washington, District Of Columbia, United States
[filters.remote]
[job_card.full_time]
Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Senior AI / ML Engineer (SWE-3)

Senior AI / ML Engineer (SWE-3)

Leidos • Burtonsville, MD, US
[job_card.full_time]
National Security Sector's (NSS) Cyber & Analytics Business Area (CABA).Our talented team is at the forefront in Security Engineering, Computer Network Operations (CNO), Mission Software, A...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Edge AI Research Engineer — Transformer Models for Edge

Edge AI Research Engineer — Transformer Models for Edge

Anduril Industries, Inc. • Washington, DC, United States
[job_card.full_time]
A defense technology company is seeking an AI Engineer to advance military capabilities with cutting-edge technologies.The ideal candidate will have a BS in a relevant field and 5+ years of experie...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer - Palantir Foundry - Senior Engineer

AI Engineer - Palantir Foundry - Senior Engineer

Silverthorne Advisory Group LLC • Arlington, VA, US
[job_card.full_time]
Silverthorne Advisory Group is seeking a skilled and highly motivated Senior Engineer to join an exciting and growing opportunity within the Defense sector. As a Senior Engineer, you’ll apply ...[show_more]
[last_updated.last_updated_30] • [promoted]
Research Engineer : Generative AI & LLMs

Research Engineer : Generative AI & LLMs

Meta • Washington, DC, United States
[job_card.full_time]
A leading technology company is seeking a Research Engineer to join their Large Language Model Research team.The role involves designing advanced methods for language models and requires a strong b...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer

AI Engineer

3E • Bethesda, Maryland, United States, 20814
[job_card.full_time]
We are a mission-driven company dedicated to creating a safer and more sustainable world!3E provides award-winning regulatory expertise and cutting-edge technology that seamlessly integrates data a...[show_more]
[last_updated.last_updated_30]
Technology Evangelist / Public Sector

Technology Evangelist / Public Sector

Supermicro • Washington, DC, United States
[job_card.full_time]
Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior AI Engineer (Gen AI Platform Services, Agentic Systems)

Senior AI Engineer (Gen AI Platform Services, Agentic Systems)

Capital One • Washington, DC, United States
[job_card.full_time] +1
Senior AI Engineer (Gen AI Platform Services, Agentic Systems).Overview : At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has be...[show_more]
[last_updated.last_updated_30] • [promoted]
Machine Learning Engineer - Model Evaluations, Public Sector

Machine Learning Engineer - Model Evaluations, Public Sector

Scale AI, Inc. • Washington, DC, United States
[job_card.full_time]
Machine Learning Engineer - Model Evaluations, Public Sector.The Public Sector ML team at Scale deploys advanced AI systems-including LLMs, agentic models, and multimodal pipelines-into mission-cri...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Platform Engineer

Platform Engineer

Raft • Arlington, VA, United States
[job_card.full_time]
All of the programs we support require.All work must be conducted within the continental U.Distributed Data Systems, Platforms at Scale, and Complex Application Development, with headquarters in Mc...[show_more]
[last_updated.last_updated_30] • [promoted]
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND Corporation • Washington, District of Columbia, United States
[job_card.temporary]
RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda.As Research Lead - AI Cyb...[show_more]
[last_updated.last_updated_30] • [promoted]
Edge AI Research Engineer, ML for Autonomy

Edge AI Research Engineer, ML for Autonomy

Anduril Industries • Washington, DC, United States
[job_card.full_time]
A leading defense technology company in Washington is seeking a Research Engineer specializing in Machine Learning to develop and fine-tune advanced AI systems. You will be responsible for automatin...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Model Evaluator

AI Model Evaluator

Scale AI • Washington, District Of Columbia, United States
[job_card.full_time]
Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Product Manager, Public Sector Platform & AI

Product Manager, Public Sector Platform & AI

Relativity • Washington, DC, United States
[job_card.full_time]
The Product Management team is looking for a Product Manager with a strong background in product lifecycle and DevOps / Agile practices as well as strong communication and collaboration skills.You wi...[show_more]
[last_updated.last_updated_30] • [promoted]
Edge ML Research Engineer – Transformer AI for Defense

Edge ML Research Engineer – Transformer AI for Defense

Slope • Washington, DC, United States
[job_card.full_time]
A leading defense technology company located in Washington, D.AI Engineer to enhance military capabilities with innovative AI systems. The successful candidate will be responsible for fine-tuning tr...[show_more]
[last_updated.last_updated_variable_days] • [promoted]