Talent.com
AI Evaluation Platform Engineer
AI Evaluation Platform EngineerVirtualVocations • Ann Arbor, Michigan, United States
AI Evaluation Platform Engineer

AI Evaluation Platform Engineer

VirtualVocations • Ann Arbor, Michigan, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.temporary]
[job_card.job_description]

A company is looking for a Senior Platform Engineer, AI Evaluation (24 months fixed-term).

Key Responsibilities

Evolve and extend the internal evaluation framework for AI-driven experiences

Collaborate with ML data engineers and platform developers to implement an eval-driven development process

Develop documentation and training materials while gathering internal requirements

Required Qualifications

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field

5 years of Software Engineering experience, including 2+ years in evaluating generative AI systems

Strong programming skills in Go, Python, SQL, and experience with a data pipeline framework

Familiarity with large language model architecture and industry-standard APIs

[job_alerts.create_a_job]

Ai Platform Engineer • Ann Arbor, Michigan, United States

[internal_linking.related_jobs]
Senior ML / AI Engineer

Senior ML / AI Engineer

Source One Technical Solutions • Ann Arbor, MI, United States
[job_card.full_time]
Source One is a consulting services company and we’re currently looking for the following individual to work as a consultant to our client, an autonomous vehicle company in Ann Arbor, MI.We are una...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Software Engineer, Applications & Customer Solutions

Software Engineer, Applications & Customer Solutions

MemryX • Ann Arbor, Michigan, United States, 48109
[job_card.full_time]
AI accelerators for edge computing.Founded in 2019 and headquartered in Ann Arbor, Michigan, the company also operates existing engineering branches in Taipei, Hsinchu (Taiwan), and Bangalore (Indi...[show_more]
[last_updated.last_updated_30]
Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)

Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)

Mercor • Ann Arbor, Michigan, US
[filters.remote]
[job_card.full_time]
Role Overview • • Mercor is collaborating with a leading AI research lab to develop a next-generation evaluation dataset for frontier AI models. We are seeking experts with advanced domain knowledge a...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Senior ML / AI Engineer (Ann Arbor)

Senior ML / AI Engineer (Ann Arbor)

Source One Technical Solutions • Ann Arbor, MI, US
[job_card.part_time]
Source One is a consulting services company and were currently looking for the following individual to work as a consultant to our client, an autonomous vehicle company in Ann Arbor, MI.We are unab...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Engineer & Researcher, Inference

AI Engineer & Researcher, Inference

Speechify • Ann Arbor, Michigan, United States
[job_card.full_time]
PLEASE APPLY THROUGH THIS LINK : .The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify’s text-to-speech products to turn whatever ...[show_more]
[last_updated.last_updated_30] • [promoted]
Remote Machine Learning Engineer - AI Trainer ($80-$120 per hour)

Remote Machine Learning Engineer - AI Trainer ($80-$120 per hour)

Mercor • Ann Arbor, Michigan, US
[filters.remote]
[job_card.part_time]
At Mercor, we’re building the talent engine that helps leading labs and research orgs move AI forward.Our latest initiative focuses on benchmarking and improving model performance and training spee...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Machine Learning AI Engineer

Machine Learning AI Engineer

The Mice Groups, Inc. • Ann Arbor, MI, United States
[job_card.full_time]
ML / AI Engineer / Contract, W2 only / Hybrid, 3 days per week onsite in Ann Arbor, MI or Palo Alto, CA / 1 year, extendable. Simplify vehicle software development and increase developer agility by ...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
AI Systems Engineer

AI Systems Engineer

Vertex Sigma Software • Superior Township, MI, US
[job_card.full_time]
[filters_job_card.quick_apply]
Deploy and secure an on-premises AI infrastructure for hosting large language models (LLMs).Install, configure, and maintain AI model-serving frameworks on internal GPU-enabled servers.Develop and ...[show_more]
[last_updated.last_updated_variable_days]
AI Product Owner

AI Product Owner

WTW • Ann Arbor, Michigan, USA
[job_card.full_time]
As a Product Owner supporting the Expert development team you will play a pivotal role in driving the future of technically focused product initiatives. You will serve as the bridge between business...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
ML AI Engineer

ML AI Engineer

Mice Groups • Ann Arbor, MI, US
[job_card.full_time]
ML / AI Engineer / Contract / Hybrid, 3 days per week onsite in Ann Arbor, MI or Palo Alto, CA / 1 year, extendable.Summary : Simplify vehicle software development and increase developer agility by ...[show_more]
[last_updated.last_updated_30] • [promoted]
Senior Machine Learning Engineer - App Engine (CUDA / C++)

Senior Machine Learning Engineer - App Engine (CUDA / C++)

Torc Robotics • Ann Arbor, Michigan, United States
[job_card.full_time]
The mission of the Application Engine Team is to provide a robust, efficient, and flexible platform for integrating and managing various deep learning models and processes in the context of L4 auto...[show_more]
[last_updated.last_updated_30] • [promoted]
Freelance Luxury Brand Evaluator - Southeast & Central Michigan - Apply Now

Freelance Luxury Brand Evaluator - Southeast & Central Michigan - Apply Now

CXG • Ann Arbor, MI, US
[job_card.full_time]
[filters_job_card.quick_apply]
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...[show_more]
[last_updated.last_updated_30]
Remote Text Quality Evaluator

Remote Text Quality Evaluator

Outlier • Fenton, MI, United States
[filters.remote]
[job_card.full_time]
Earn up to $16 USD / hourly and work remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the future of ...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Artificial Intelligence Engineer

Artificial Intelligence Engineer

InfoStride • Ann Arbor, MI, United States
[job_card.full_time]
Job Title : Machine Learning / AI Engineer.Location : Ann Arbor, MI (Hybrid – 3 days onsite per week).We are seeking a Machine Learning / AI Engineer to join our cutting-edge automotive software team...[show_more]
[last_updated.last_updated_variable_hours] • [promoted] • [new]
Gaming Product Evaluator (Hiring Immediately)

Gaming Product Evaluator (Hiring Immediately)

Little Wheel • Ann Arbor, Michigan, us
[job_card.temporary]
Join Our Team as a Website Tester at Little Wheel Little Wheel is a gambling technology company focused on researching and building products that put players first. We are currently hiring Website T...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($21-$21 per hour)

Remote Senior Machine Learning Engineer - LLM Evaluation / Task Creations (India Based) - AI Trainer ($21-$21 per hour)

Mercor • Ann Arbor, Michigan, US
[filters.remote]
[job_card.full_time]
Role Description • • Mercor is hiring on behalf of a leading AI research lab to bring on highly skilled • •Machine Learning Engineers • • with a proven record of building, training, and evaluating high-...[show_more]
[last_updated.last_updated_variable_days] • [promoted]
Vehicle Evaluator

Vehicle Evaluator

Michigan Staffing • Ann Arbor, MI, US
[job_card.full_time]
Martin Technologies is looking for dependable and safety-conscious drivers to join our team as Vehicle Evaluators.This position offers structured paid training, a professional certification upon su...[show_more]
[last_updated.last_updated_1_day] • [promoted]
Machine Learning Engineer II - App Engine (CUDA)

Machine Learning Engineer II - App Engine (CUDA)

Torc Robotics • Ann Arbor, Michigan, United States
[job_card.full_time]
The mission of the Application Engine Team is to provide a robust, efficient, and flexible platform for integrating and managing various deep learning models and processes in the context of L4 auto...[show_more]
[last_updated.last_updated_30] • [promoted]