Talent.com

Program evaluation Jobs in San Francisco, CA

Create a job alert for this search

Program evaluation • san francisco ca

Last updated: 2 days ago

Data Scientist - AI Evaluation

MercorSan Francisco, California, United States
RemoteRemote
Part-timePart-time
Quick Apply

Headquartered in San Francisco, our investors include.Design precise, task-specific grading criteria for data science deliverables.Provide detailed written justifications for evaluations and scores... Show more

Program Manager

AECOMOakland, California, United States
Full-time +1Full-time +1

AECOM is seeking an experienced.Oil and Gas business line in Oakland, California.This role will lead the successful delivery of complex environmental projects for clients in the refining, industria... Show more

Humanities Evaluation Specialist - Remote

YO AI LabsSan Francisco, CA, USA
RemoteRemote
Full-timeFull-time
Quick Apply

Humanities Evaluation Specialist.Humanities Evaluation Specialists.AI training project involving research, critical analysis, question development, and evaluation.No prior AI experience is required... Show more

Program Manager

RejuvenationSan Francisco, CA, United States
Full-timeFull-time

Program Manager, Inventory Planning Strategy.The Program Manager, Inventory Planning Strategy, is responsible for leading the assessment, design, documentation, and implementation of best-practice ... Show more

Evaluation Manager

Children's Council of San FranciscoSan Francisco, CA, United States
Full-timeFull-time

For more than 50 years, Children's Council has been the heart of childcare and early education in San Francisco, advancing the belief that high-quality childcare can transform lives and communities... Show more

Evaluation and Learning Director

CYCSan Francisco, CA, United States
$90,000.00–$105,000.00 yearly$90,000.00–$105,000.00 yearly
Full-timeFull-time

Evaluation And Learning Director.For more than 54 years, Community Youth Center of San Francisco (CYC) has given San Francisco youth a sense of belonging and the tools and experiences they need to ... Show more

Evaluation and Learning Director

CYCSFSan Francisco, CA, US
$90,000.00–$105,000.00 yearly$90,000.00–$105,000.00 yearly
Full-timeFull-time
Quick Apply

JOB ANNOUNCEMENT For more than 54 years, Community Youth Center of San Francisco (CYC) has given San Francisco youth a sense of belonging and the tools and experiences they need to succeed in life.... Show more

Program Manager

Salvation Army Western TerritorySan Francisco, CA, United States
PermanentPermanent

The Way Out is a homeless initiative of The Salvation Army San Francisco focused on the intersection of homelessness and drug addiction, and is delivered through a Recovery System of Care.Services ... Show more

Program Manager

Zortech SolutionsSan Francisco, CA, United States
Full-timeFull-time

Location: Denver CO or San Francisco CA (On Site couple of days a week).Develop and manage project governance plans, project schedules, success criteria, and project milestones.Own and drive end-to... Show more

Diagnostic Supervisor (Remote) - Veterans Evaluation Services

MaximusSan Francisco, US
$69,250.00 yearly$69,250.00 yearly
RemoteRemote
Full-timeFull-time

Essential Duties and Responsibilities: - Supervise, instruct, and support the Diagnostics team: Diagnostic Cappers, Diagnostic Facility Recruiters, Diagnostic Schedulers, Diagnostic Uploader... Show more

Program Manager

RockstarSan Francisco, CA, US
$90,000.00–$130,000.00 yearly$90,000.00–$130,000.00 yearly
Full-timeFull-time
Quick Apply

Rockstar is recruiting for an award-winning platform that helps families navigate their child’s educational journey.This platform enables parents to find, apply, and register for schools and progra... Show more

Senior Specialist / Manager, AI Safety Data and Evaluation Program

Lila SciencesSan Francisco, CA, United States
$88,000.00 yearly$88,000.00 yearly
Full-timeFull-time

We're building a talent-dense, high-agency AI safety team at Lila that will engage all core teams within the organization (science, model training, lab integration, etc.The initial focus of this te... Show more

Director, Research - Evaluation & Training

Snorkel AISan Francisco, CA, United States
Full-timeFull-time

Director, Research - Evaluation & Training.New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote).At Snorkel, we believe meaningful AI doesn't start with the model, it start... Show more

Merchant Mariner Evaluation Specialist (Deck)

TSAOakland, CA, United States
Full-timeFull-time

Merchant Mariner Evaluation Specialist (Deck).You will serve as a Merchant Mariner Evaluation Specialist (Deck) and be responsible for providing advice and administration on the regulatory provisio... Show more

Program Manager

ConiferSan Francisco, CA, United States
Full-timeFull-time

Program Manager For Ev Powertrain Systems.As a Program Manager, you will be responsible for leading and coordinating the development and delivery of our EV powertrain systems.You will work closely ... Show more

Program Manager

Saiia Construction Company LLC, a MasTec CompanyOakland, CA, United States
$50.67–$76.01 hourly$50.67–$76.01 hourly
Full-timeFull-time

Inclusion & Belonging Program Manager, Principal.Intren West (IW) Professional Services Construction Management Solutions provides strategic program management, construction management, and operati... Show more

Program Manager

ArtechBrisbane, CA, United States
Full-timeFull-time

Location: Brisbane, CA Hybrid Duration: 12 Months Pay Range: $130-148/hr.At the Associate Director level, the Project Manager (PM) is accountable for one or more Global Program Teams (GPTs) and as... Show more

Agent Evaluation Infrastructure Engineer

MaxIT Consulting - Max Corporate GroupSan Francisco, California, United States
Full-timeFull-time
Quick Apply

San Francisco, California | Primarily On-site.Agent Evaluation Infrastructure Engineer.You will work on the engineering and research problems behind realistic agent environments, post-training syst... Show more

Remote Software Developer – AI Research & Evaluation

TuringSan Francisco, California, United States
RemoteRemote
Full-timeFull-time
Quick Apply

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support... Show more

Program Supervisor

KyoBrisbane, CA, United States
$30.00 hourly$30.00 hourly
Full-timeFull-time

Kyo is a leading provider of Applied Behavior Analysis (ABA), an evidence-based therapy for individuals with autism.Kyo serves thousands of children and teens across 11 states.Every day, we seek to... Show more

People also ask
Data Scientist - AI Evaluation

Data Scientist - AI Evaluation

MercorSan Francisco, California, United States
30+ days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Data Scientist Talent Network
Type: Contract
Compensation: $100–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for data science deliverables. This includes exploratory data analyses, statistical modeling work, machine learning pipelines, and technical reports.
  • Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy.
  • Provide detailed written justifications for evaluations and scores to maintain transparency.
  • Apply consistent, evidence-based judgment for reproducible and defensible assessments.
  • Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement.

Qualifications

Must-Have

  • 1+ years of professional data science experience.
  • Experience at a leading technology, research, or quantitative firm.
  • Strong command of Python, SQL, statistical modeling, and machine learning.
  • Exceptional written communication skills for conveying technical findings.
  • Detail-oriented and consistent approach to evaluating complex work.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.