AI Evaluation Platform EngineerVirtualVocations • Jersey City, New Jersey, United States

AI Evaluation Platform Engineer

VirtualVocations • Jersey City, New Jersey, United States

[job_card.variable_days_ago]

[job_preview.job_type]

[job_card.temporary]

[job_card.job_description]

A company is looking for a Senior Platform Engineer, AI Evaluation (24 months fixed-term).

Key Responsibilities

Evolve and extend the internal evaluation framework for AI-driven experiences

Collaborate with ML data engineers and platform developers to implement an eval-driven development process

Develop documentation and training materials while gathering internal requirements

Required Qualifications

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field

5 years of Software Engineering experience, including 2+ years in evaluating generative AI systems

Strong programming skills in Go, Python, SQL, and experience with a data pipeline framework

Familiarity with large language model architecture and industry-standard APIs

[job_alerts.create_a_job]

Ai Platform Engineer • Jersey City, New Jersey, United States

[internal_linking.related_jobs]

AI Engineer - AI Platform

Traversal • New York, NY, United States

[job_card.full_time]

AI Site Reliability Engineer (SRE) for the enterprise—already trusted by some of the largest companies in the world to troubleshoot, remediate, and even prevent the most complex production incident...[show_more]

[last_updated.last_updated_30] • [promoted]

Applied AI Engineer - Agent

The General Intelligence Company Of New York • New York, NY, United States

[job_card.full_time]

We’re hiring an Applied AI Engineer to push the boundaries of our Cofounder agent.You’ll own core backend systems and applied LLM work : advancing agent reliability and autonomy, building evaluation...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

AI Engineer

Point72 • New York, New York, United States

[job_card.full_time]

AI Engineer, Investment Services .A CAREER WITH POINT72’S COO TEAM.The AI Engineer, Investment Services will be responsible for exploring opportunities to develop and build potential solutions that...[show_more]

[last_updated.last_updated_30] • [promoted]

Forward Deployed Engineer (AI Solutions) Atrix

Pear VC • New York City, New York, USA

[job_card.full_time]

At Atrix our journey began with a simple belief : .Breakthrough medicines and technologies change lives and the people making them deserve better tools. We often celebrate the final moment : a patient ...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Applied AI Engineer

Columbia University • New York, NY, United States

[job_card.full_time]

Job Type : Officer of Administration.Salary Range : $130,000-$150,000.The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to departm...[show_more]

[last_updated.last_updated_30] • [promoted]

Applied AI Engineer

Thread Ai • New York, NY, United States

[job_card.full_time] +1

Thread AI is focused on building an AI-native workflow orchestration engine looking for dedicated individuals to join its growing team. Our goal is to make infrastructure simple for enterprises and ...[show_more]

[last_updated.last_updated_30] • [promoted]

AI Engineer

Rilla • New York, New York, United States

[job_card.full_time]

Rilla builds the world’s leading conversation intelligence software for offline commerce.By recording, analyzing, and indexing conversations, our platform supplies unparalleled alpha to the critica...[show_more]

[last_updated.last_updated_30] • [promoted]

Generative AI Engineer

QTech • New York City, New York, USA

[job_card.full_time]

Job Title : Generative AI Engineer.Seeking an experienced Generative AI Engineer with hands-on expertise in LLM-based systems and intelligent agents. The ideal candidate will work closely with data s...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

AI Research Engineer, Enterprise Evaluations

Scale AI, Inc. • New York, NY, United States

[job_card.full_time]

Scale AI is seeking a technically rigorous and driven.This high-impact role is critical to our mission of delivering the industry's leading. You will be a hands-on contributor to the core systems th...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

APPLIED AI ENGINEER – Global Investment Firm

J Harlan Group • New York City, New York, USA

[job_card.full_time]

APPLIED AI ENGINEER Global Investment Firm.J Harlan Group is conducting a search for an APPLIED AI ENGINEER for a world-renowned global investment and technology firm headquartered in NYC.Technolo...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Forward Deployed Engineer (150k-190k + Equity) at

Jack & Jill / External ATS • New York City, New York, USA

[job_card.full_time]

This is a job that we are recruiting for on behalf of one of our customers.Hes an AI agent that sends you unmissable jobs and then helps you ace the interview. Hell make sure you are considered for ...[show_more]

[last_updated.last_updated_variable_hours] • [promoted] • [new]

Applied AI Research Engineer

Norm Ai • New York, New York, United States

[job_card.full_time]

Norm Ai is the Compliance AI Platform for legal standards-based reasoning & workflow automation.We developed the first Domain Specific Language (DSL) for fully representing regulatory requirements ...[show_more]

[last_updated.last_updated_30] • [promoted]

Generative AI Engineer

Regard • New York, New York, United States

[job_card.full_time]

As a Generative AI Engineer at Regard, you’ll work across the full lifecycle of developing and deploying AI-driven features, from ideation and design to prototyping, implementation, evaluation, and...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

AI Engineer

Metropolitan Commercial Bank • New York, New York, United States

[job_card.full_time]

Metropolitan Commercial Bank (the “Bank”) is a full-service commercial bank based in New York City.The Bank provides a broad range of business, commercial, and personal banking products and service...[show_more]

[last_updated.last_updated_30] • [promoted]

AI Research Engineer, Enterprise Evaluations

Scale AI • New York, NY, United States

[job_card.full_time]

AI Research Engineer, Enterprise Evaluations.Scale AI is seeking a technically rigorous and driven.This high‑impact role is critical to our mission of delivering the industry's leading.You will be ...[show_more]

[last_updated.last_updated_variable_days] • [promoted]

Machine Learning Systems Engineer - Data & Evaluation, Horizons

Anthropic • New York, New York, United States

[job_card.full_time]

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]

[last_updated.last_updated_30] • [promoted]

Forward Deployed AI Engineer

Palantir Technologies • New York, New York, United States

[job_card.full_time]

Palantir builds the world’s leading software for data-driven decisions and operations.By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving ...[show_more]

[last_updated.last_updated_30] • [promoted]

Applied AI Engineer

Valence • New York, New York, United States

[job_card.full_time]

Valence has built the first-to-market AI native coaching platform for enterprise, offering personalized, expert, and human-like guidance & support to any leader or employee.At Valence, we're not ju...[show_more]

[last_updated.last_updated_30] • [promoted]