Talent.com

Program evaluation h1.location_city

[job_alerts.create_a_job]

Program evaluation • newark nj

[last_updated.last_updated_variable_hours]

Legal Expert - Evaluation Specialist

MercorNew York, New York, United States
[filters.remote]
[job_card.part_time]
[filters_job_card.quick_apply]

Headquartered in San Francisco, our investors include.AI Model Evaluation Specialist.Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.Identify fabr...[internal_linking.show_more]

 • [job_card.new]

Senior Software Engineer – LLM Evaluation - RibbitZ

TarakiNew York, New York, United States
[filters.remote]
[job_card.full_time]
[filters_job_card.quick_apply]

As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.This includes cura...[internal_linking.show_more]

Program Manager

Schneider ElectricNew York, NY, US
[job_card.full_time]

Schneider Electric has an opportunity for a Program Manager to support our North America customer programs.This individual will report within the Customer Execution & Programs Office.The Program Ma...[internal_linking.show_more]

Project Employee, Job Evaluation Analyst

The National Basketball AssociationNew York, NY, United States
[job_card.temporary]

WORK OPTION: The NBA currently provides eligible employees the option of working remotely one day per week.This is a temporary position with an expected duration not to exceed (10) months.Global To...[internal_linking.show_more]

Program Manager

WebMDNewark, NJ, United States
[job_card.full_time]

Medscape, a division of WebMD, develops and hosts physician portals and related mobile applications that make it easier for physicians and healthcare professionals to access clinical reference sour...[internal_linking.show_more]

Program Manager

SecuritasElizabeth, NJ, United States
[job_card.full_time]

Program Manager – Global Clients Americas (GCA).Freehold, NJ – In office, 5 days/week.Medical, Dental, Vision, 401(k) with company match, Paid Time Off, Career Growth Opportunities.Lead, Influence,...[internal_linking.show_more]

Program Assistant

The New York Academy of SciencesNew York, NY, US
[job_card.full_time]
[filters_job_card.quick_apply]

ABOUT THE NEW YORK ACADEMY OF SCIENCES The New York of Academy of Sciences is an independent, not-for-profit organization that since 1817 has been committed to advancing science for the benefit of ...[internal_linking.show_more]

Program Recruiter

Project RenewalNew York, NY, United States
[job_card.full_time]

Recruitment & Engagement Specialist.Program: Workforce Development.Schedule: Hybrid Schedule (post 90-day successful employment).Salary Range: $50,000 - $55,000 per year.Program Description: Next S...[internal_linking.show_more]

Program Manager

Northbound SearchNew York, NY, United States
[job_card.full_time]

Our client is seeking a program management consultant to join their PMO team which is responsible for establishing and maintaining project management standards across the firm.This is an open-ended...[internal_linking.show_more]

Program Coordinator

Phipps Neighborhoods Inc.New York, NY, United States
[job_card.full_time]

Phipps Neighborhoods, the social service affiliate of Phipps Houses, has been a catalyst for community growth and empowerment for over 50 years.Our mission is focused on creating safe, inclusive sp...[internal_linking.show_more]

Program Manager

DIVERSE LYNX LLCNew York, NY, US
[job_card.full_time]

Assigned to projects under the management of the NYC H+H Office of Ambulatory Care and Population Health, and under the direction of the relevant program leads for each discrete initiative.Project/...[internal_linking.show_more]

SUMMER COLLEGE INTERN - Program Reporting and Evaluation

New York City Department Of InvestigationNew York, NY, United States
[job_card.full_time]

SUMMER COLLEGE INTERN - Program Reporting and Evaluation.Job Title: One (1) Summer Intern.Summary: The Mayor's Office of Management and Budget (OMB) is the City government's chief financial agency....[internal_linking.show_more]

Program Director

Bond HealthNew York, NY
[job_card.full_time]

Program Director needed in Manhattan.Program/Department Description:.The OMH licensed Intensive Crisis Residence (ICR) is inspired by the Soteria model and is designed as an alternative to psychiat...[internal_linking.show_more]

SUMMER GRADUATE INTERN - Program Reporting and Evaluation

NYC JobsNew York, NY, United States
[job_card.full_time]

The Mayor's Office of Management and Budget (OMB) is the City government's chief financial agency.OMB's staff of analysts and experts assembles and oversees the Mayor's expense and capital budgets,...[internal_linking.show_more]

Program Assistant - DOC Program

New Jersey Association on CorrectionNewark, NJ, US
[job_card.full_time]
[filters_job_card.quick_apply]

SUMMARY Residential program for adult residents which are state inmates classified to a work release program.The Program Assistant provides essential support to ensure the smooth operation of the f...[internal_linking.show_more]

Program Manager

Vanguard StaffingNew York, NY, US
[job_card.permanent]

University located in midtown Manhattan, is seeking a Program Manager.This is a long-term temporary role with potential for Temporary-to-Direct Hire.This position will be fully onsite, Monday throu...[internal_linking.show_more]

Program Manager

JobotNew York, New York, US
[job_card.full_time]

Private-Held Niche Commercial Insurer Hiring a Program Manager to Lead Insurance Programs This Jobot Job is hosted by: Caitlyn Hardy Are you a fit? Easy Apply now by clicking the "Quick Apply" butt...[internal_linking.show_more]

Program Supervisor

Catholic Charities of the Archdiocese of NewarkJersey City, NJ, US
[job_card.full_time]
[filters_job_card.quick_apply]

Catholic Charities of the Archdiocese of Newark is currently seeking a Full Time Program Supervisor for its Mobile Response & Stabilization Services Program located in Jersey City, NJ.Master's Degr...[internal_linking.show_more]

Legal Expert - Evaluation Specialist

Legal Expert - Evaluation Specialist

MercorNew York, New York, United States
[job_card.variable_hours_ago]
[job_preview.job_type]
  • [job_card.part_time]
  • [filters.remote]
  • [filters_job_card.quick_apply]
[job_card.job_description]

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $50–$75/hour
Commitment: ~20 hours/week

Role Responsibilities

  • Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
  • Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
  • Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
  • Score and rank multiple model responses using structured rubrics across dimensions.
  • Provide written justifications with specific evidence for each evaluation.

Qualifications

Must-Have

  • Master’s degree or higher in Legal or a relevant professional field.
  • Professional experience applying domain expertise in a practitioner or advisory capacity.
  • Familiarity with industry-specific standards, regulations, or clinical guidelines.
  • Strong written communication and critical reasoning skills.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume to begin.
  • Complete the Model Response Evaluation assessment.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.