Talent.com
AI Evaluation Platform Engineer
AI Evaluation Platform EngineerVirtualVocations • Portsmouth, Virginia, United States
[error_messages.no_longer_accepting]
AI Evaluation Platform Engineer

AI Evaluation Platform Engineer

VirtualVocations • Portsmouth, Virginia, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.temporary]
[job_card.job_description]

A company is looking for a Senior Platform Engineer, AI Evaluation (24 months fixed-term).

Key Responsibilities

Evolve and extend the internal evaluation framework for AI-driven experiences

Collaborate with ML data engineers and platform developers to implement an eval-driven development process

Develop documentation and training materials while gathering internal requirements

Required Qualifications

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field

5 years of Software Engineering experience, including 2+ years in evaluating generative AI systems

Strong programming skills in Go, Python, SQL, and experience with a data pipeline framework

Familiarity with large language model architecture and industry-standard APIs

[job_alerts.create_a_job]

Ai Platform Engineer • Portsmouth, Virginia, United States

[internal_linking.similar_jobs]
Data Engineer Lead

Data Engineer Lead

CSA Global LLC • Norfolk, VA, US
[job_card.full_time]
Client Solution Architects (CSA) is currently seeking a Data Engineer Lead to support a program in the Norfolk, Virginia area. For nearly 50 years, CSA has delivered integrated technology and operat...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer (Navy / DoD)

Data Engineer (Navy / DoD)

THOR Solutions, LLC • Norfolk, VA, US
[job_card.temporary]
US Navy Ship Anti-Submarine Warfare (ASW) Readiness and Effectiveness Measuring (SHAREM) at Surface and Mine Warfighting Development Center (SMWDC) in. This position is associated with an upcoming c...[show_more]
[last_updated.last_updated_30] • [promoted]
Staff.Structural.Engineer (Chesapeake, VA)

Staff.Structural.Engineer (Chesapeake, VA)

GTT, LLC • Chesapeake, VA, US
[job_card.full_time]
This position requires a technically strong engineer who can balance.The role offers the option of a.Lead civil / structural design work from conceptual phase through completion.Design and analyze ci...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote Financial Advising Expert - AI Trainer ($50-$60 / hour)

Remote Financial Advising Expert - AI Trainer ($50-$60 / hour)

Data Annotation • Chesapeake, Virginia
[filters.remote]
[job_card.full_time] +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
[last_updated.last_updated_30] • [promoted]
Project Engineer

Project Engineer

Ulliman Schutte • Chesapeake, VA, US
[job_card.full_time]
WHY ULLIMAN SCHUTTE? We are Building a Better Environment!.We're looking for passionate Project Engineers in the Chesapeake, VA area who are eager to learn, grow, and contribute to building som...[show_more]
[last_updated.last_updated_30] • [promoted]
Data Science & AI Engineers & Developers Onsite at NATO ACT Norfolk

Data Science & AI Engineers & Developers Onsite at NATO ACT Norfolk

Ironclad Defense Works • Norfolk, Virginia, United States
[job_card.full_time]
Data Science & AI Engineers & Developers – Onsite at NATO ACT Norfolk.HQ Supreme Allied Command Transformation (HQ SACT), Norfolk, VA. Active NATO or National SECRET (or higher) security clearance.I...[show_more]
[last_updated.last_updated_30] • [promoted]
Remote Machine Learning Engineer - AI Trainer ($80-$120 per hour)

Remote Machine Learning Engineer - AI Trainer ($80-$120 per hour)

Mercor • Newport News, Virginia, US
[filters.remote]
[job_card.part_time]
At Mercor, we’re building the talent engine that helps leading labs and research orgs move AI forward.Our latest initiative focuses on benchmarking and improving model performance and training spee...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Data Engineer Lead

Data Engineer Lead

Csa Global • Norfolk, Virginia, United States
[job_card.full_time]
Client Solution Architects (CSA) is currently seeking a Data Engineer Lead to support a program in the Norfolk, Virginia area. For nearly 50 years, CSA has delivered integrated technology and operat...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote M&A Associate - AI Trainer ($50-$60 / hour)

Remote M&A Associate - AI Trainer ($50-$60 / hour)

Data Annotation • Chesapeake, Virginia
[filters.remote]
[job_card.full_time] +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
[last_updated.last_updated_30] • [promoted]
Project Engineer III

Project Engineer III

Oceaneering • Chesapeake, VA, US
[job_card.full_time]
Oceaneering Marine Services Division (MSD) has over 30 years of experience providing full-service submarine and surface ship repairs supporting maintenance and alterations aboard commercial and U.W...[show_more]
[last_updated.last_updated_30] • [promoted]
Remote AI Writing Evaluator

Remote AI Writing Evaluator

Outlier • Hampton, VA, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
[last_updated.last_updated_1_day] • [promoted]
Distinguished AI Engineer

Distinguished AI Engineer

Capital One • Newport News, VA, United States
[job_card.full_time] +1
At Capital One, we are creating responsible and reliable AI systems, changing banking for good.For years, Capital One has been an industry leader in using machine learning to create real-time, pers...[show_more]
[last_updated.last_updated_30] • [promoted]
Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

Data Annotation • Chesapeake, Virginia
[filters.remote]
[job_card.full_time] +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
[last_updated.last_updated_30] • [promoted]
Arrangement Engineer (Engineer 3) - 25195

Arrangement Engineer (Engineer 3) - 25195

HII • Chesapeake, VA, US
[job_card.full_time]
Anticipated Salary Range : $78,897.Security Clearance : Ability to Obtain.Mission Technologies' Global Security (GS) group comprises live, virtual, constructive (LVC) solutions; fleet sustainment...[show_more]
[last_updated.last_updated_30] • [promoted]
AI Annotation Specialist

AI Annotation Specialist

Outlier • Portsmouth, VA, United States
[filters.remote]
[job_card.full_time]
Additional pay available based on project performance.Freelance / 1099 contract — not an internship.Flexible hours — you choose when and how much to work. Weekly via our secure platform.Outlier, a pla...[show_more]
[last_updated.last_updated_1_day] • [promoted]
ForeScout Engineer - Active TS / SCI with CI Poly

ForeScout Engineer - Active TS / SCI with CI Poly

ENS Solutions, LLC • Norfolk, VA, US
[job_card.full_time]
On our expert team, you’ll perform work focused on implementing and operating next generation security solutions for government and commercial clients. You’ll perform hands-on evaluation...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Project Engineer - Traveling Position

Project Engineer - Traveling Position

Gpac • Norfolk, Virginia, United States
[job_card.full_time]
[filters_job_card.quick_apply]
Assist Project Managers in planning, coordinating, and executing projects on-site.Review drawings, specifications, and submittals to ensure compliance. Track schedules, budgets, and resources, and r...[show_more]
[last_updated.last_updated_30]
Remote Investment Analyst – AI Trainer ($50-$60 / hour)

Remote Investment Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • Chesapeake, Virginia
[filters.remote]
[job_card.full_time] +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
[last_updated.last_updated_30] • [promoted]