Talent.com

Program evaluation Jobs in San Francisco, CA

Create a job alert for this search

Program evaluation • san francisco ca

Last updated: 1 day ago

Data Scientist - AI Evaluation

MercorSan Francisco, California, United States
RemoteRemote
Part-timePart-time
Quick Apply

Headquartered in San Francisco, our investors include.Design precise, task-specific grading criteria for data science deliverables.Provide detailed written justifications for evaluations and scores... Show more

Program Manager

Intren WestOakland, CA, United States
Full-timeFull-time

Intren West (IW) Professional Services Construction Management Solutions provides strategic program management, construction management, and operational consulting services supporting complex infra... Show more

Humanities Evaluation Specialist - Remote

YO AI LabsSan Francisco, CA, USA
RemoteRemote
Full-timeFull-time
Quick Apply

Humanities Evaluation Specialist.Humanities Evaluation Specialists.AI training project involving research, critical analysis, question development, and evaluation.No prior AI experience is required... Show more

Director, Business Development - Search & Evaluation

Formation Bio (Formerly TrailSpark)San Francisco, CA, United States
Full-timeFull-time

Director, Business Development - Search & Evaluation.Formation Bio is a tech and AI driven pharma company differentiated by radically more efficient drug development.Advancements in AI and drug dis... Show more

Program Manager

KaavSan Francisco, CA, United States
Full-timeFull-time

Client: Photon/Williams Sonoma.Looking for Retail/E-commerce domain background, Final client round is F2F in SFO.Uses established Program management methodologies/tools to develop and execute IT pr... Show more

PROGRAM MANAGER

Omni InclusiveSan Francisco, CA, United States
Full-timeFull-time

The Program Manager will oversee the implementation and management of Biovia ELN projects, ensuring alignment with organizational goals.This role requires a strategic thinker with extensive experie... Show more

Program Manager

Bianchi Electric, a MasTec CompanyOakland, CA, United States
$50.67–$76.01 hourly$50.67–$76.01 hourly
Full-timeFull-time

Inclusion & Belonging Program Manager, Principal.Intren West (IW) Professional Services Construction Management Solutions provides strategic program management, construction management, and operati... Show more

Evaluation and Learning Director

CYCSFSan Francisco, CA, US
$90,000.00–$105,000.00 yearly$90,000.00–$105,000.00 yearly
Full-timeFull-time
Quick Apply

JOB ANNOUNCEMENT For more than 54 years, Community Youth Center of San Francisco (CYC) has given San Francisco youth a sense of belonging and the tools and experiences they need to succeed in life.... Show more

Evaluation and Learning Director

CYCSan Francisco, CA, United States
$90,000.00–$105,000.00 yearly$90,000.00–$105,000.00 yearly
Full-timeFull-time

Evaluation And Learning Director.For more than 54 years, Community Youth Center of San Francisco (CYC) has given San Francisco youth a sense of belonging and the tools and experiences they need to ... Show more

Program Lead

RekaSan Francisco, CA, United States
Full-timeFull-time

Claru (a Reka business line) San Francisco Full-time.The physical world where skill lives has never been recorded in a form a model can learn from.We sell data to frontier labs and robotics compani... Show more

Program Director

The Posse FoundationSan Francisco, CA, United States
$70,000.00–$75,000.00 yearly$70,000.00–$75,000.00 yearly
Full-timeFull-time

Posse Bay Area - San Francisco, CA 94104.The primary responsibilities of the program director are to oversee and manage the Posse program for up to six (6) university partners; manage a staff of up... Show more

Program Manager

QcellsSan Francisco, CA, US
$98,000.00–$117,600.00 yearly$98,000.00–$117,600.00 yearly
Full-timeFull-time

Qcells is seeking a Program Manager to join EnFin's Enterprise Planning & PMO function and will report to the Director of Strategy & Program Management.In this role, you will own end-to-end deliver... Show more

Diagnostic Supervisor (Remote) - Veterans Evaluation Services

MaximusSan Francisco, US
$69,250.00 yearly$69,250.00 yearly
RemoteRemote
Full-timeFull-time

Essential Duties and Responsibilities: - Supervise, instruct, and support the Diagnostics team: Diagnostic Cappers, Diagnostic Facility Recruiters, Diagnostic Schedulers, Diagnostic Uploader... Show more

Program Manager

MasTec IncOakland, California, United States
$50.67–$76.01 hourly$50.67–$76.01 hourly
Full-timeFull-time

Intren West (IW) Professional Services Construction Management Solutions provides strategic program management, construction management, and operational consulting services supporting complex infra... Show more

Director, Research - Evaluation & Training

Snorkel AISan Francisco, CA, United States
Full-timeFull-time

Director, Research - Evaluation & Training.New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote).At Snorkel, we believe meaningful AI doesn't start with the model, it start... Show more

Program Manager

ArtechBrisbane, CA, United States
Full-timeFull-time

Location: Brisbane, CA Hybrid Duration: 12 Months Pay Range: $130-148/hr.At the Associate Director level, the Project Manager (PM) is accountable for one or more Global Program Teams (GPTs) and as... Show more

Agent Evaluation Infrastructure Engineer

MaxIT Consulting - Max Corporate GroupSan Francisco, California, United States
Full-timeFull-time
Quick Apply

San Francisco, California | Primarily On-site.Agent Evaluation Infrastructure Engineer.You will work on the engineering and research problems behind realistic agent environments, post-training syst... Show more

Program Analyst / Senior Program Analyst

State Bar of CaliforniaSan Francisco, CA, United States
Full-timeFull-time

The Office of Access and Inclusion (OA&I) leads the grantmaking for legal services, and policymaking on access to justice and diversity, equity, and inclusion work at the State Bar.In 2026, OA&I, w... Show more

Software Developer – AI Research & Evaluation

TuringSan Francisco, California, United States
Full-timeFull-time
Quick Apply

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support... Show more

Program Director

Cross Country HealthcareOakland, CA, United States
Full-timeFull-time

Cross Country is looking for top talent to join our team! We are a market-leading, tech-enabled workforce solutions and advisory firm with more than four decades of experience helping organizations... Show more

People also ask
Data Scientist - AI Evaluation

Data Scientist - AI Evaluation

MercorSan Francisco, California, United States
30+ days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Data Scientist Talent Network
Type: Contract
Compensation: $100–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for data science deliverables. This includes exploratory data analyses, statistical modeling work, machine learning pipelines, and technical reports.
  • Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy.
  • Provide detailed written justifications for evaluations and scores to maintain transparency.
  • Apply consistent, evidence-based judgment for reproducible and defensible assessments.
  • Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement.

Qualifications

Must-Have

  • 1+ years of professional data science experience.
  • Experience at a leading technology, research, or quantitative firm.
  • Strong command of Python, SQL, statistical modeling, and machine learning.
  • Exceptional written communication skills for conveying technical findings.
  • Detail-oriented and consistent approach to evaluating complex work.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.