Talent.com

Program evaluator Jobs in Santa Rosa, CA

Create a job alert for this search

Program evaluator • santa rosa ca

Last updated: 1 day ago

Remote Bilingual Portuguese Generalist Evaluator Expert - AI Trainer ($12-$30 per hour)

MercorSanta Rosa, California, US
Remote
Full-time

Mercor is seeking **native Portuguese speakers from Portugal or Brazil** with exceptional writing skills to contribute to a high-impact AI research project with a leading lab.Freelancers will autho...Show more

Clinic Director I Licensed Occupational Therapist (OT)*Incentive Opportunity

EmpowerMe WellnessSanta Rosa, California, United States
Full-time +1

This isn’t leadership as usual.At EmpowerMe Wellness, our Clinic Directors don’t just manage teams — they lead the heartbeat of care inside our communities.Your Impact = Stronger Teams + Healthier ...Show more

Behavioral Support Worker- Sebastopol ($23 - $27/hr)

Maxim Healthcare ServicesSebastopol, CA, US
Full-time +1

Provides one-to-one behavior intervention services to individual clients as instructed by Clinical Leadership and based on individual treatment plans.Implements the goals/objectives for an individu...Show more

Program Instructional Assistant - Part-Time - Cali Calmcac

WINDSOR UNIFIED SCHOOL DISTRICTWindsor, CA, United States
Part-time

Job Summary: Please see attached job description.Schedule: Monday through Friday; 1:00 pm to 6:00 pm.Requirements / Qualifications: Incomplete applications will not be considered.Fingerprint cleara...Show more

CLASS A RECENT GRADS -NO EXPERIENCE TRUCK DRIVER -CALIFORNIA

10-4 Truck RecruitingSanta Rosa, CA, United States
Full-time

Class A CDL Solo Truck Driver - Recent Graduates OK!.Please read to make sure you qualify :).OTR and regional positions available.Gain 3 months of experience and transfer to local.Must be at least ...Show more

Program Director for Adult Day Program

DungarvinRohnert Park, California, United States
Full-time

Lead daily operations, staffing, scheduling, payroll, budget oversight, and service delivery for a high-needs adult day program.Provide hands-on leadership by being present on the floor, coaching s...Show more

Senior Product Development Program Manager - Aortic operating unit

AVE Medtronic Vascular IncSanta Rosa, California, United States of America
Full-time

We anticipate the application window for this opening will close on - 1 May 2026.At Medtronic you can begin a life-long career of exploration and innovation, while helping champion healthcare acces...Show more

Staff Psychologist

Veterans Affairs, Veterans Health AdministrationSanta Rosa, California, California
Full-time +1

This position is eligible for the Education Debt Reduction Program (EDRP), a student loan payment reimbursement program.You must meet specific individual eligibility requirements in accordance with...Show more

Day Program Manager

Spread Your Wings, LLC.Santa Rosa, CA, US
Full-time
Quick Apply

NEW OFFICE OPENING IN SANTA ROSA, CALIFORNIA COME GROW WITH US!.Adult Community Day Program - Program Manager:.Monday - Friday Full-time benefits include: Company pays 50% Medical plan Company pays...Show more

Santa Rosa Store - Backroom Processor/Warehouse Associate

Salvation Army Western TerritorySanta Rosa, CA, United States
Full-time

Santa Rosa Store - Backroom Processor/Warehouse Associate.Job Category: Thrift Stores - all positions.Requisition Number: SOUTH018472.Location: Santa Rosa, CA 95404, USA.Back Room Processor / Mater...Show more

Become a Luxury Brand Evaluator in Bayreuth (German Speaking)- Apply Now

CXGGraton, CA, United States
Full-time

Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.Join CXG, the global leader in custo...Show more

Remote Bilingual German Generalist Evaluator Expert - AI Trainer ($25-$30 per hour)

MercorSanta Rosa, California, US
Remote
Full-time

Mercor is seeking **native German speakers from Austria, Switzerland, or Germany** with exceptional writing skills to contribute to a high-impact AI research project with a leading lab.Freelancers ...Show more

Remote Bilingual Traditional Chinese Generalist Evaluator Expert - AI Trainer ($25-$30 per hour)

MercorSanta Rosa, California, US
Remote
Full-time

Mercor is seeking **native Traditional Chinese speakers from Hong Kong or Taiwan** with exceptional writing skills to contribute to a high-impact AI research project with a leading lab.Freelancers ...Show more

Remote Bilingual Italian Generalist Evaluator Expert - AI Trainer ($25-$30 per hour)

MercorRohnert Park, California, US
Remote
Full-time

Mercor is seeking **native Italian speakers from Switzerland or Italy** with exceptional writing skills to contribute to a high-impact AI research project with a leading lab.Freelancers will author...Show more

After School Program Coordinator

Boys & Girls Clubs of Sonoma-MarinSanta Rosa, California, United States
Part-time
Quick Apply

We are hiring for Clubs located in Healdsburg, Cloverdale, Geyserville, Santa Rosa, Roseland, Rohnert Park.At Boys & Girls Clubs we do whatever it takes to ensure all kids are on a path towards a G...Show more

Behavior Assistant for Elementary Classes (CEP Program.75 FTE- 6 hours/day) 3 Vacancies

Santa Rosa City School DistrictSanta Rosa, CA, United States
Full-time

Behavior Assistant Team Member.Burbank: #4520 Monroe- #4665, #4666 The Santa Rosa Behavior Department understands that all behavior is communication and serves an underlying need.We support student...Show more

Program Assistant

The Salvation ArmySanta Rosa, CA , US
Full-time

The Salvation Army Mission Statement:.The Salvation Army, an international movement, is an evangelical part of the universal Christian Church.Its message is based on the Bible.Its ministry is motiv...Show more

Phlebotomy - Entry Level Training Program

DreamboundWindsor, California, United States
Full-time

Note : This is an educational program, not a job.Successful completion of the program does not guarantee employment but will equip you with valuable skills for the healthcare job market.Looking to ...Show more

Remote Galician Audio Generalist Evaluator - AI Trainer ($50-$50 per hour)

MercorRohnert Park, California, US
Remote
Full-time

Mercor is seeking a Galician Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab.In this role, you will work on transcription, ann...Show more

People also ask
The highest-paying jobs are:
The top 10 cities are:
Remote Bilingual Portuguese Generalist Evaluator Expert - AI Trainer ($12-$30 per hour)

Remote Bilingual Portuguese Generalist Evaluator Expert - AI Trainer ($12-$30 per hour)

MercorSanta Rosa, California, US
30+ days ago
Job type
  • Full-time
  • Remote
Job description

Mercor is seeking native Portuguese speakers from Portugal or Brazil with exceptional writing skills to contribute to a high-impact AI research project with a leading lab. Freelancers will author Portuguese / English prompt–golden answer pairs that train and evaluate advanced language models.

  • This role is strictly limited to candidates who are native to Portugal or Brazil and have lived in or spent significant time in the country, with deep familiarity with local language usage, tone, and cultural context. This is a short-term, flexible opportunity for professionals who combine language mastery, strong critical thinking, and a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted, culturally grounded Portuguese text while maintaining technical precision in English. * * * ## Job Details ### Multilingual Prompt Design & Optimization : Create detailed prompts in Portuguese and / or English with multiple constraints and instructions, ensuring natural phrasing and real-world relevance for Portuguese-speaking users in Portugal and Brazil contexts. ### Define and Document Evaluation Standards : Establish high-level expectations for correct responses in Portugal and Brazil consumer contexts, and develop comprehensive rubrics that account for linguistic nuance, tone, and cultural conventions specific to these regions. ### Model Testing and Grading (Bilingual) : Run prompts through models and assess preliminary outputs for accuracy, fluency, and cultural fit in Portuguese, comparing results against English where needed. ### Benchmarking & Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor—maintaining consistency and reliability across Portuguese-language benchmarks before integration into official evaluations. * * * ## Minimum Qualifications - Native-level fluency in Portuguese (written), specific to Portugal or Brazil usage, with strong reading / writing ability in English. - Must be native to Portugal or Brazil and have lived in or spent significant time in-country , with deep cultural and linguistic familiarity. - BS or BA from a reputable institution (completed or in progress). - Strong writing and critical thinking skills. - Ability to work independently and meet deadlines. - Significant familiarity with ChatGPT or similar tools for personal decision-making, hobbies, or general interests. - Based in Portugal or Brazil (or able to reliably produce Portugal- or Brazil-specific, culturally accurate Portuguese). * * * ## Preferred Qualifications - Experience in teaching, research, editing, or academic writing. - Experience creating evaluation criteria, rubrics, or grading guidelines. - Familiarity with LLMs, prompting, or model evaluation (helpful but not required). * * * ## Application & Onboarding Process - Complete an AI-led interview (about 15 minutes). - If approved, complete a paid assessment focused on writing and rubric creation - Then, if selected, you will be invited to work on the project. * * * ## More Details About This Role - Expect to contribute at least 20 hours per week. - Expect a commitment of approximately 2–4 months . - You’ll be working in a structured project environment with clear goals and tools.