AI Evaluation Platform EngineerVirtualVocations • Portsmouth, Virginia, United States
[error_messages.no_longer_accepting]
AI Evaluation Platform Engineer
VirtualVocations • Portsmouth, Virginia, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.temporary]
[job_card.job_description]
A company is looking for a Senior Platform Engineer, AI Evaluation (24 months fixed-term).
Key Responsibilities
Evolve and extend the internal evaluation framework for AI-driven experiences
Collaborate with ML data engineers and platform developers to implement an eval-driven development process
Develop documentation and training materials while gathering internal requirements
Required Qualifications
Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
5 years of Software Engineering experience, including 2+ years in evaluating generative AI systems
Strong programming skills in Go, Python, SQL, and experience with a data pipeline framework
Familiarity with large language model architecture and industry-standard APIs
[job_alerts.create_a_job]
Ai Platform Engineer • Portsmouth, Virginia, United States
[internal_linking.similar_jobs]
Client Solution Architects (CSA) is currently seeking a Data Engineer Lead to support a program in the Norfolk, Virginia area.
For nearly 50 years, CSA has delivered integrated technology and operat...[show_more]
At Capital One, we are creating responsible and reliable AI systems, changing banking for good.For years, Capital One has been an industry leader in using machine learning to create real-time, pers...[show_more]
As a remote, hourly paid R Engineer, you will review AI-generated responses and generate high-quality R and data-analysis-focused content, evaluating the reasoning quality and step-by-step problem-...[show_more]
At Capital One, we are creating responsible and reliable AI systems, changing banking for good.For years, Capital One has been an industry leader in using machine learning to create real-time, pers...[show_more]
WHY ULLIMAN SCHUTTE? We are Building a Better Environment!.We're looking for passionate Project Engineers in the Chesapeake, VA area who are eager to learn, grow, and contribute to building som...[show_more] As a Senior C++ Engineer, you will work remotely on an hourly paid basis to review AI-generated C++ code, systems designs, and technical explanations, as well as generate high-quality reference imp...[show_more] As a Senior SQL Engineer, you will work remotely on an hourly paid basis to review AI-generated SQL queries, database designs, and data-processing logic, as well as generate high-quality reference ...[show_more] 
Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for.
If you're passionate about improving models and excited by the futu...[show_more] Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for.
If you're passionate about improving models and excited by the futu...[show_more] Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for.
If you're passionate about improving models and excited by the futu...[show_more] 
Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborati...[show_more]
US Navy Ship Anti-Submarine Warfare (ASW) Readiness and Effectiveness Measuring (SHAREM) at Surface and Mine Warfighting Development Center (SMWDC) in.
This position is associated with an upcoming c...[show_more] Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for.
If you're passionate about improving models and excited by the futu...[show_more] 
Assist Project Managers in planning, coordinating, and executing projects on-site.Review drawings, specifications, and submittals to ensure compliance.
Track schedules, budgets, and resources, and r...[show_more] Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for.
If you're passionate about improving models and excited by the futu...[show_more] Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for.
If you're passionate about improving models and excited by the futu...[show_more] As a Senior C Engineer, you will work remotely on an hourly paid basis to review AI-generated C code, low-level systems designs, and technical explanations, as well as generate high-quality referen...[show_more] As an hourly paid, fully remote Rust Engineer for AI Data Training, you will review AI-generated Rust code and explanations or generate your own, evaluate the reasoning quality and step-by-step pro...[show_more]
Data Engineer Lead
CSA Global LLC • Norfolk, VA, US
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Distinguished AI Engineer
Capital One • Newport News, VA, US
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Remote R Engineer AI Trainer
SuperAnnotate • Newport News, Virginia, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [new]
Distinguished AI Engineer (Newport News)
Capital One • Newport News, Virginia, US
[job_card.full_time] +1
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Project Engineer
Ulliman Schutte • Chesapeake, VA, US
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Remote Senior C++ Engineer AI Trainer
SuperAnnotate • Chesapeake, Virginia, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [new]
Remote Senior SQL Engineer AI Trainer
SuperAnnotate • Chesapeake, Virginia, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [new]
AI Trainer -Remote Text Quality Evaluator
Outlier • Norfolk, VA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Text Quality Evaluator
Outlier • Chesapeake, VA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Work From Home -Remote Text Quality Evaluator
Outlier • Chesapeake, VA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Lead Data Engineer (Intelligent Foundations and Experiences)
Capital One • Norfolk, VA, United States
[job_card.full_time] +1
[last_updated.last_updated_30] • [promoted]
Data Engineer (Navy / DoD)
THOR Solutions, LLC • Norfolk, VA, US
[job_card.temporary]
[last_updated.last_updated_30] • [promoted]
AI Trainer -Remote Writing Evaluator
Outlier • Chesapeake, VA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Project Engineer - Traveling Position
Gpac • Norfolk, Virginia, United States
[job_card.full_time]
[filters_job_card.quick_apply]
[last_updated.last_updated_30]
Work From Home -Remote AI Writing Evaluator
Outlier • Chesapeake, VA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote AI Writing Evaluator
Outlier • Chesapeake, VA, United States
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Remote Senior C Engineer AI Trainer
SuperAnnotate • Newport News, Virginia, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [new]
Remote Rust Engineer AI Trainer
SuperAnnotate • Chesapeake, Virginia, US
[filters.remote]
[job_card.full_time]
[last_updated.last_updated_variable_hours] • [new]