Talent.com

Program evaluation Jobs in San Francisco, CA

Create a job alert for this search

Program evaluation • san francisco ca

Last updated: 1 day ago

Data Scientist - AI Evaluation

MercorSan Francisco, California, United States
RemoteRemote
Part-timePart-time
Quick Apply

Headquartered in San Francisco, our investors include.Design precise, task-specific grading criteria for data science deliverables.Provide detailed written justifications for evaluations and scores... Show more

Program Manager

AECOMOakland, California, United States
Full-time +1Full-time +1

AECOM is seeking an experienced.Oil and Gas business line in Oakland, California.This role will lead the successful delivery of complex environmental projects for clients in the refining, industria... Show more

Humanities Evaluation Specialist - Remote

YO AI LabsSan Francisco, CA, USA
RemoteRemote
Full-timeFull-time
Quick Apply

Humanities Evaluation Specialist.Humanities Evaluation Specialists.AI training project involving research, critical analysis, question development, and evaluation.No prior AI experience is required... Show more

Program Manager

RejuvenationSan Francisco, CA, United States
Full-timeFull-time

Program Manager, Inventory Planning Strategy.The Program Manager, Inventory Planning Strategy, is responsible for leading the assessment, design, documentation, and implementation of best-practice ... Show more

Evaluation Manager

Children's Council of San FranciscoSan Francisco, CA, United States
Full-timeFull-time

For more than 50 years, Children's Council has been the heart of childcare and early education in San Francisco, advancing the belief that high-quality childcare can transform lives and communities... Show more

Director, Business Development - Search & Evaluation

Formation Bio (Formerly TrailSpark)San Francisco, CA, United States
Full-timeFull-time

Director, Business Development - Search & Evaluation.Formation Bio is a tech and AI driven pharma company differentiated by radically more efficient drug development.Advancements in AI and drug dis... Show more

Program Assistant

Jewish Vocational Service (JVS)San Francisco, CA, US
Full-timeFull-time
Quick Apply

JVS is a nonprofit working to close opportunity gaps in employment by supporting jobseekers with the skills and confidence to secure quality careers with family-sustaining wages.Grounded in core va... Show more

Evaluation and Learning Director

CYCSFSan Francisco, CA, US
$90,000.00–$105,000.00 yearly$90,000.00–$105,000.00 yearly
Full-timeFull-time
Quick Apply

JOB ANNOUNCEMENT For more than 54 years, Community Youth Center of San Francisco (CYC) has given San Francisco youth a sense of belonging and the tools and experiences they need to succeed in life.... Show more

Evaluation and Learning Director

CYCSan Francisco, CA, United States
$90,000.00–$105,000.00 yearly$90,000.00–$105,000.00 yearly
Full-timeFull-time

Evaluation And Learning Director.For more than 54 years, Community Youth Center of San Francisco (CYC) has given San Francisco youth a sense of belonging and the tools and experiences they need to ... Show more

Program Manager

MasTec IncOakland, California, United States
$50.67–$76.01 hourly$50.67–$76.01 hourly
Full-timeFull-time

Intren West (IW) Professional Services Construction Management Solutions provides strategic program management, construction management, and operational consulting services supporting complex infra... Show more

Diagnostic Supervisor (Remote) - Veterans Evaluation Services

MaximusSan Francisco, US
$69,250.00 yearly$69,250.00 yearly
RemoteRemote
Full-timeFull-time

Essential Duties and Responsibilities: - Supervise, instruct, and support the Diagnostics team: Diagnostic Cappers, Diagnostic Facility Recruiters, Diagnostic Schedulers, Diagnostic Uploader... Show more

Senior Specialist / Manager, AI Safety Data and Evaluation Program

Lila SciencesSan Francisco, CA, United States
$88,000.00 yearly$88,000.00 yearly
Full-timeFull-time

We're building a talent-dense, high-agency AI safety team at Lila that will engage all core teams within the organization (science, model training, lab integration, etc.The initial focus of this te... Show more

Merchant Mariner Evaluation Specialist (Deck)

TSAOakland, CA, United States
Full-timeFull-time

Merchant Mariner Evaluation Specialist (Deck).You will serve as a Merchant Mariner Evaluation Specialist (Deck) and be responsible for providing advice and administration on the regulatory provisio... Show more

Program Manager

ConiferSan Francisco, CA, United States
Full-timeFull-time

Program Manager For Ev Powertrain Systems.As a Program Manager, you will be responsible for leading and coordinating the development and delivery of our EV powertrain systems.You will work closely ... Show more

Program Manager

Saiia Construction Company LLC, a MasTec CompanyOakland, CA, United States
$50.67–$76.01 hourly$50.67–$76.01 hourly
Full-timeFull-time

Inclusion & Belonging Program Manager, Principal.Intren West (IW) Professional Services Construction Management Solutions provides strategic program management, construction management, and operati... Show more

Program Manager

ArtechBrisbane, CA, United States
Full-timeFull-time

Location: Brisbane, CA Hybrid Duration: 12 Months Pay Range: $130-148/hr.At the Associate Director level, the Project Manager (PM) is accountable for one or more Global Program Teams (GPTs) and as... Show more

Program Coordinator

The Posse FoundationSan Francisco, CA, United States
Full-timeFull-time

Posse Bay Area - San Francisco, CA 94104.The Program Coordinator is the primary administrative support for the local site.During recruitment, program coordinators manage incoming nominations, the i... Show more

Agent Evaluation Infrastructure Engineer

MaxIT Consulting - Max Corporate GroupSan Francisco, California, United States
Full-timeFull-time
Quick Apply

San Francisco, California | Primarily On-site.Agent Evaluation Infrastructure Engineer.You will work on the engineering and research problems behind realistic agent environments, post-training syst... Show more

Remote Software Developer – AI Research & Evaluation

TuringSan Francisco, California, United States
RemoteRemote
Full-timeFull-time
Quick Apply

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support... Show more

Program Supervisor

KyoBrisbane, CA, United States
$30.00 hourly$30.00 hourly
Full-timeFull-time

Kyo is a leading provider of Applied Behavior Analysis (ABA), an evidence-based therapy for individuals with autism.Kyo serves thousands of children and teens across 11 states.Every day, we seek to... Show more

People also ask
Data Scientist - AI Evaluation

Data Scientist - AI Evaluation

MercorSan Francisco, California, United States
30+ days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Data Scientist Talent Network
Type: Contract
Compensation: $100–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for data science deliverables. This includes exploratory data analyses, statistical modeling work, machine learning pipelines, and technical reports.
  • Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy.
  • Provide detailed written justifications for evaluations and scores to maintain transparency.
  • Apply consistent, evidence-based judgment for reproducible and defensible assessments.
  • Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement.

Qualifications

Must-Have

  • 1+ years of professional data science experience.
  • Experience at a leading technology, research, or quantitative firm.
  • Strong command of Python, SQL, statistical modeling, and machine learning.
  • Exceptional written communication skills for conveying technical findings.
  • Detail-oriented and consistent approach to evaluating complex work.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.