Talent.com

Program evaluator Jobs in Ventura, CA

Create a job alert for this search

Program evaluator • ventura ca

Last updated: 3 hours ago

Remote Shopify Storefront Agent Evaluator - AI Trainer ($40-$50 per hour)

MercorOxnard, California, US
$40.00 hourly
Remote
Full-time

About the role Shopify's **Storefront Agent** is the AI shopping assistant that sits on a merchant's store — it searches the catalog in natural language, recommends products, builds carts, and answ... Show more

 • New!

Program Manager 3 - OneSat

Northrop GrummanOxnard, CA, United States
$193,000.00 yearly
Full-time

Deputy Program Manager 3 Oxnard.At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact people's lives around the world today, and for generat... Show more

After School Program/Primary School Professional -Oxnard, CA

AlphaBEST Education, Inc.Oxnard, CA, USA
$19.00 hourly
Part-time
Quick Apply

After School Program/Primary School Professional.Part-time-Oxnard, CA **Bilingual (English/Spanish) is preferred**.Inspire and lead as a Early Learning Education After-school Instructor in a dynami... Show more

Adult Ed - Certified Nurse Assistant (CNA) Program Lead (Part-Time)

Ventura Unified School DistrictVentura, CA, United States
Part-time

Certified Nurse Assistant Training Program Lead.This position is part-time (1-19 hrs/week).Under the direction of the Director/Principal of Ventura Adult and Continuing Education, provide regulator... Show more

Senior Technical Program Manager

Kore1Oxnard, CA, United States
Full-time

Senior Technical Program Manager.KORE1, a nationwide provider of staffing and recruiting solutions, has an immediate opening for a Senior Technical Program Manager in Ventura County, California.We ... Show more

Child and Youth Program Training and Curriculum Specialist

US NavyVentura, CA, United States
Full-time

Help Duties include but are not limited to: Training.Serves as a lead participant in achieving and maintaining DoD certification and national accreditation or equivalent.Develops, coordinates, and ... Show more

ERP Program Manager (Oracle E-Business Suite EBS | SIOP | Supply Chain)

Johnson Service GroupOxnard, CA, US
$160,000.00 yearly
Permanent
Quick Apply

ERP Program Manager (Oracle E-Business Suite) EBS  | SIOP | Supply Chain).This role will lead two key strategic initiatives:.Oracle E-Business Suite (EBS) ERP Upgrade & Transformation 	... Show more

Sr. Program Analyst

General DynamicsOxnard, CA, United States
Full-time

The people supporting and securing some of the most complex government, defense, and intelligence projects across the country.We ensure today is safe and tomorrow is smarter.Our work has meaning an... Show more

Pharmacy Technician - Entry Level Training Program

Dreambound Inc.San Buenaventura (Ventura), California, United States
Full-time

Note : This is an educational program, not a job.Successful completion of the program does not guarantee employment but will equip you with valuable skills for the healthcare job market.Looking to ... Show more

 • Promoted

Youth Development Professional - Afterschool Program

Boys & Girls Clubs of Greater Oxnard and Port HuenemeOxnard, CA, US
Part-time
Quick Apply

Plans, implements, supervises, and evaluates activities provided in within a specific program area (such as education, social recreation, arts & crafts, and physical education).KEY ROLES (Essen... Show more

PROGRAM MANAGER

VSolvit LLCOxnard, CA, United States
Full-time

The Program Manager is responsible for supporting and managing complex program teams working on large programs.Must interface across the SME's and customers in an environment where the workforce is... Show more

Sr. Program Analyst

General Dynamics Information TechnologyOxnard, CA, United States
$93,662.00 yearly
Full-time

The people supporting and securing some of the most complex government, defense, and intelligence projects across the country.We ensure today is safe and tomorrow is smarter.Our work has meaning an... Show more

DoW Financial and Program Management Support Specialists

GuidehouseVentura, CA, United States
$87,100.00 yearly
Full-time

Financial Management Professional.Guidehouse is currently seeking financial management professionals in support of our Department of Defense client.These teammates will bring a vast range of experi... Show more

Program Manager

Veteran Enterprise Technology Services, LLC (VETS)Ventura, CA, United States
Full-time

This position is contingent upon contract award.This position is responsible for:.Providing supervision of team of 20 + staff, including Naval Architect, ship crew, and program admin team.Serving a... Show more

Program Administrator

UFW FoundationOxnard, CA, United States
Full-time

The Program Administrator will support all aspects of the Immigration Services Program and projects including planning, organizing, staffing, leading, and executing program activities.Secondary dut... Show more

Senior Technical Program Manager

KORE1 TechnologiesOxnard, CA, United States
Full-time

Senior Technical Program Manager.KORE1, a nationwide provider of staffing and recruiting solutions, has an immediate opening for a Senior Technical Program Manager in Ventura County, California.We ... Show more

Program and Customer Support Analyst

Acute TalentVentura, US
Full-time

We are seeking a Program and Customer Support Analyst to support a federal program onsite in Port Hueneme, California.This role provides cross-functional support for program management activities a... Show more

Child and Youth Program Training and Curriculum Specialist

US Marine CorpsVentura, CA, United States
Full-time

Duties include but are not limited to: Training.Serves as a lead participant in achieving and maintaining DoD certification and national accreditation or equivalent.Develops, coordinates, and deliv... Show more

Diesel Technician Apprenticeship (Military Veterans)

Isuzu Veterans Apprenticeship Program (IVAP)Oxnard, CA, US
Full-time +1
Quick Apply

Gibbs Isuzu Trucks of Fresno, California.This opportunity is part of the Isuzu Veterans Apprenticeship Program (IVAP), a U.Department of Labor and GI Bill®-approved Registered Apprenticeship progra... Show more

Program Manager

Banner Quality Management Inc. (BQMI)Oxnard, CA, United States
Full-time

BQMI) is seeking a Program Manager to provide leadership and technical expertise in support of the Naval Surface Warfare Center, Port Hueneme Division (NSWC PHD).The Program Manager will be respons... Show more

People also ask
Remote Shopify Storefront Agent Evaluator - AI Trainer ($40-$50 per hour)

Remote Shopify Storefront Agent Evaluator - AI Trainer ($40-$50 per hour)

MercorOxnard, California, US
3 hours ago
Salary
$40.00 hourly
Job type
  • Full-time
  • Remote
Job description
## About the role Shopify's **Storefront Agent** is the AI shopping assistant that sits on a merchant's store — it searches the catalog in natural language, recommends products, builds carts, and answers questions about shipping, returns, and store policies. Your job is to stress-test it and grade what comes back. You'll send the agent a handful of realistic shopper prompts, then score each response against a short rubric. The work is straightforward and self-contained: no coding, no data pipelines, no long-form writing. ## What you'll do - Prompt the Storefront Agent as a real shopper would — product discovery, comparisons, sizing and stock questions, shipping and returns, edge cases and awkward requests - Grade each response on a small set of dimensions: - **Relevance** — did it actually answer what was asked, within the constraints the shopper gave? - **Accuracy** — is every claim (price, stock, policy, delivery window) true and grounded in the store's own catalog and policy data, rather than plausible-sounding invention? - **Safety** — did it avoid harmful advice, unsupported claims, and actions it wasn't authorized to take? - Leave a short, concrete note on anything that failed, so the reason is legible to someone who wasn't there - **Commitment:** up to 5 hours/week ## Qualifications **Required:** - **Consumer e-commerce fluency** — you shop online regularly and have a clear sense of what a good vs. a useless product recommendation looks like. - **Careful, consistent judgment** — you can apply the same rubric the same way across many responses, and separate "this response was wrong" from "this response wasn't what I'd have written." - **Clear, concise written English** — enough to explain in a sentence or two why a response failed. **Strongly preferred:** - **Hands-on Shopify merchant experience** — you've run or operated a Shopify store and know how shoppers actually behave on one. - **Experience using AI shopping assistants or chat agents** as a customer, and a feel for where they tend to break. **Preferred (nice to have — we'll ramp you on the specifics):** - Prior work evaluating, red-teaming, or annotating AI model outputs. - Familiarity with retail operations: catalog and variant structure, inventory, shipping and returns policy. ## What this is not This is not a customer-support role and not an engineering role. You are not fixing the agent — you are judging it, precisely and repeatably, so the team can measure where it falls short.