Talent.com

Program evaluation h1.location_city

[job_alerts.create_a_job]

Program evaluation • newark nj

[last_updated.last_updated_1_day]

Senior Software Engineer – LLM Evaluation - RibbitZ

TarakiNew York, New York, United States
[filters.remote]
[job_card.full_time]
[filters_job_card.quick_apply]

As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.This includes cura...[internal_linking.show_more]

Program Manager

Schneider ElectricNew York, NY, US
[job_card.full_time]

Schneider Electric has an opportunity for a Program Manager to support our North America customer programs.This individual will report within the Customer Execution & Programs Office.The Program Ma...[internal_linking.show_more]

Project Employee, Job Evaluation Analyst

The National Basketball AssociationNew York, NY, United States
[job_card.temporary]

WORK OPTION: The NBA currently provides eligible employees the option of working remotely one day per week.This is a temporary position with an expected duration not to exceed (10) months.Global To...[internal_linking.show_more]

Program Manager

WebMDNewark, NJ, United States
[job_card.full_time]

Medscape, a division of WebMD, develops and hosts physician portals and related mobile applications that make it easier for physicians and healthcare professionals to access clinical reference sour...[internal_linking.show_more]

Program Recruiter

Project RenewalNew York, NY, United States
[job_card.full_time]

Recruitment & Engagement Specialist.Program: Workforce Development.Schedule: Hybrid Schedule (post 90-day successful employment).Salary Range: $50,000 - $55,000 per year.Program Description: Next S...[internal_linking.show_more]

Program Manager

Northbound SearchNew York, NY, United States
[job_card.full_time]

Our client is seeking a program management consultant to join their PMO team which is responsible for establishing and maintaining project management standards across the firm.This is an open-ended...[internal_linking.show_more]

Program Manager

DIVERSE LYNX LLCNew York, NY, US
[job_card.full_time]

Assigned to projects under the management of the NYC H+H Office of Ambulatory Care and Population Health, and under the direction of the relevant program leads for each discrete initiative.Project/...[internal_linking.show_more]

Program Manager

eTeamNew York City, NY
[job_card.full_time]

Job title- Monetization Strategy & Commercial Program Manager.Location- NYC, NY (Hybrid - Tuesday, Wednesday, and Thursday).This contractor will focus on accelerating commercial model advancements ...[internal_linking.show_more]

SUMMER COLLEGE INTERN - Program Reporting and Evaluation

New York City Department Of InvestigationNew York, NY, United States
[job_card.full_time]

SUMMER COLLEGE INTERN - Program Reporting and Evaluation.Job Title: One (1) Summer Intern.Summary: The Mayor's Office of Management and Budget (OMB) is the City government's chief financial agency....[internal_linking.show_more]

Program Director

Bond HealthNew York, NY
[job_card.full_time]

Program Director needed in Manhattan.Program/Department Description:.The OMH licensed Intensive Crisis Residence (ICR) is inspired by the Soteria model and is designed as an alternative to psychiat...[internal_linking.show_more]

Program Director

Phipps Neighborhoods Inc.New York, NY, United States
[job_card.temporary]

Compensation: $75,000-$80,000k annually.Responsible for the administration and supervision of the daily operations of the SRO.Responsible for the supervision of: Administrative Assistant, Senior RA...[internal_linking.show_more]

Program Scheduler

Direct Staffing IncClifton, NJ, United States
[job_card.full_time]

We have a great opportunity for a Program Scheduler who will be responsible for maintaining schedule analysis documentation in support of assigned programs or projects.Prepares, develops and coordi...[internal_linking.show_more]

SUMMER GRADUATE INTERN - Program Reporting and Evaluation

NYC JobsNew York, NY, United States
[job_card.full_time]

The Mayor's Office of Management and Budget (OMB) is the City government's chief financial agency.OMB's staff of analysts and experts assembles and oversees the Mayor's expense and capital budgets,...[internal_linking.show_more]

Program Assistant - DOC Program

New Jersey Association on CorrectionNewark, NJ, US
[job_card.full_time]
[filters_job_card.quick_apply]

SUMMARY Residential program for adult residents which are state inmates classified to a work release program.The Program Assistant provides essential support to ensure the smooth operation of the f...[internal_linking.show_more]

Program Manager

Vanguard StaffingNew York, NY, US
[job_card.permanent]

University located in midtown Manhattan, is seeking a Program Manager.This is a long-term temporary role with potential for Temporary-to-Direct Hire.This position will be fully onsite, Monday throu...[internal_linking.show_more]

 • [job_card.promoted]

Program Coordinator

New York UniversityNew York, NY, US
[job_card.full_time]

Reporting to the Director, provides analytical, research, data, & operational support to facilitate ongoing New York State Education Department (NYSED) & multi-state authorization compliance for al...[internal_linking.show_more]

Program Manager

JobotNew York, New York, US
[job_card.full_time]

Private-Held Niche Commercial Insurer Hiring a Program Manager to Lead Insurance Programs This Jobot Job is hosted by: Caitlyn Hardy Are you a fit? Easy Apply now by clicking the "Quick Apply" butt...[internal_linking.show_more]

Program Supervisor

Catholic Charities of the Archdiocese of NewarkJersey City, NJ, US
[job_card.full_time]
[filters_job_card.quick_apply]

Catholic Charities of the Archdiocese of Newark is currently seeking a Full Time Program Supervisor for its Mobile Response & Stabilization Services Program located in Jersey City, NJ.Master's Degr...[internal_linking.show_more]

Senior Software Engineer – LLM Evaluation - RibbitZ

Senior Software Engineer – LLM Evaluation - RibbitZ

TarakiNew York, New York, United States
[job_card.1_day_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters.remote]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Our client RibbitZ is looking for Senior Software Engineer-LLM Evaluation to work remotely.

As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross-functional teams to enhance enterprise-level AI-driven coding solutions.

What Does a Typical Day Look Like?

  • Working on AI model training initiatives by curating code examples, building solutions, and correcting code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
  • Evaluate and refine AI-generated code to ensure that it is efficient, scalable, and reliable.
  • Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.
  • Build agents that can verify the quality of the code and identify error patterns.
  • Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them
  • Design verification mechanisms that can automatically verify a solution to a software engineering task.

Required Skills

  • Several years of software engineering experience (+5 years), including, 2+years of continuous full-time experience at a top-tier product company (e.g., Google, Stripe, Amazon, Apple, Meta, Netflix, Microsoft, Datadog, Dropbox, Shopify, PayPal, IBM Research).
  • Strong expertise in building full-stack applications and deploying scalable, production-grade software using modern languages and tools.
  • Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
  • Excellent oral and written communication skills for clear, structured evaluation rationales.

Eligibility (Strictly Enforced):

  • Software Engineering profiles only
  • Candidates must be based in the US
  • 5+ years of relevant experience
  • Immediate assessment availability

Top companies:

  • Google (Alphabet)
  • Apple
  • Amazon
  • Meta (Facebook)
  • Netflix
  • Microsoft
  • Tesla
  • NVIDIA
  • Adobe
  • Salesforce
  • Github
  • Atlassian
  • hashiCorp
  • Databricks
  • Snowflake
  • Cloudflare, DigitalOcean, MongoDB
  • Elastic, Confluent, Airbnb, Dropbox
  • Stripe, Palantir, Uber, Lyft
  • Square (Block), Twilio, Snap Inc.
  • Pinterest, Figma, Oracle, Cisco
  • Paypal, Doordash, Rivian, Reddit, Coinbase, Splunk
  • Spotify, Goldman Sachs, Morgan Stanley
  • JP Morgan Chase, Capital One
  • Plaid, Shopify, Intuit, Workday, ServiceNow
  • Hugging Face, VMware, Brex, Wise
  • Epic Games, Unity Technologies
  • Activision Blizzard, Riot Games, Valve
  • Huawei, Bloomberg, ByteDance
  • Alibaba, Baidu, Notion, Klarna
  • Instacart, Zillow.