Talent.com
Mercor
Remote Bilingual Italian Generalist Evaluator Expert - AI Trainer ($25-$30 per hour)Mercor • Springfield, Illinois, US
Remote Bilingual Italian Generalist Evaluator Expert - AI Trainer ($25-$30 per hour)

Remote Bilingual Italian Generalist Evaluator Expert - AI Trainer ($25-$30 per hour)

Mercor • Springfield, Illinois, US
30+ days ago
Salary
$25.00 hourly
Job type
  • Full-time
  • Remote
Job description
Mercor is seeking **native Italian speakers from Switzerland or Italy** with exceptional writing skills to contribute to a high-impact AI research project with a leading lab. Freelancers will author Italian/English prompt–golden answer pairs that train and evaluate advanced language models. **This role is strictly limited to candidates who are native to Switzerland or Italy and have lived in or spent significant time in the country, with deep familiarity with local language usage, tone, and cultural context (including regional distinctions such as Swiss Italian and Italy-specific conventions).** This is a short-term, flexible opportunity for professionals who combine language mastery, strong critical thinking, and a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted, culturally grounded Italian text while maintaining technical precision in English. * * * ## **Job Details** ### **Multilingual Prompt Design & Optimization:** Create detailed prompts in Italian and/or English with multiple constraints and instructions, ensuring natural phrasing and real-world relevance for Italian-speaking users in **Switzerland and Italy** contexts. ### **Define and Document Evaluation Standards:** Establish high-level expectations for correct responses in Switzerland and Italy consumer contexts, and develop comprehensive rubrics that account for linguistic nuance, tone, and cultural conventions specific to these regions. ### **Model Testing and Grading (Bilingual):** Run prompts through models and assess preliminary outputs for accuracy, fluency, and cultural fit in Italian, comparing results against English where neede ### **Benchmarking & Quality Assurance:** Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor—maintaining consistency and reliability across Italian-language benchmarks before integration into official evaluations. * * * ## **Minimum Qualifications** - **Native-level fluency in Italian (written), specific to Switzerland or Italy usage, with strong reading/writing ability in English.** - Must be **native to Switzerland or Italy and have lived in or spent significant time in-country**, with deep cultural and linguistic familiarity. - BS or BA from a reputable institution (completed or in progress). - Strong writing and critical thinking skills. - Ability to work independently and meet deadlines. - Significant familiarity with ChatGPT or similar tools for personal decision-making, hobbies, or general interests. - Based in Switzerland or Italy (or able to reliably produce Switzerland- or Italy-specific, culturally accurate Italian). * * * ## **Preferred Qualifications** - Experience in teaching, research, editing, or academic writing. - Experience creating evaluation criteria, rubrics, or grading guidelines. - Familiarity with LLMs, prompting, or model evaluation (helpful but not required). * * * ## **Application & Onboarding Process** - Complete an AI-led interview (about 15 minutes). - If approved, complete a paid assessment focused on writing and rubric creation - Then, if selected, you will be invited to work on the project. * * * ## **More Details About This Role** - Expect to contribute at least 20 hours per week. - Expect a commitment of approximately **2–4 months**. - You’ll be working in a structured project environment with clear goals and tools. - We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Create a job alert for this search

Remote Bilingual Italian Generalist Evaluator Expert - AI Trainer ($25-$30 per hour) • Springfield, Illinois, US

Similar jobs

Remote Legal Expert - AI Trainer

SuperAnnotateSpringfield, IL, United States
Remote
Full-time

In this hourly, remote contractor role, you will review AI-generated legal analyses and / or generate expert legal content, evaluating reasoning quality and step-by-step issue-spotting while provid... Show more

 • Promoted

Travel Physical Therapist (PT) - $2,625 per week in Litchfield, IL

AlliedTravelCareersLitchfield, IL, US
$2,625.00 weekly
Full-time

AlliedTravelCareers is working with Core Medical Group to find a qualified Physical Therapist (PT) in Litchfield, Illinois, 62015!.Client in IL seeking Physical Therapist: Home Health.We are lookin... Show more

 • Promoted

Test Products from Home – $25-$45/hr + Freebies

OCPALitchfield, Illinois, us
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Investment Analyst - AI Trainer ($50-$60 per hour)

Data AnnotationSpringfield, Illinois, United States
Remote
Full-time +1

DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own&#160... Show more

 • Promoted

Senior AI Engineer - Contract - Remote - 6 months+

Resource 1, Inc.Springfield, IL, United States
Remote
Full-time

Resource 1 is seeking a Senior AI Engineer for a long-term, remote contract with our client in the Healthcare industry.Initial contract duration is 6 months, with expected extensions.This can be do... Show more

 • Promoted

Remote Product Tester – $45/hr + Free Products – Start Now!

OCPALitchfield, Illinois, us
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Work From Home Product Tester – $25-$45/hr – No Experience Needed

OCPALitchfield, Illinois, us
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

REGISTERED BEHAVIOR TECHNICIAN RBT

BrightSpring Health ServicesSherman, Illinois, United States
Part-time

REGISTERED BEHAVIOR TECHNICIAN RBT.SpringHealth Behavioral Health and Integrated Care.SpringHealth Behavioral Health and Integrated Care.Our therapy team executes customized treatment plans that de... Show more

 • Promoted

Travel Physical Therapist (PT) - $2,336 per week in Litchfield, IL

AlliedTravelCareersLitchfield, IL, US
$2,336.00 weekly
Full-time

AlliedTravelCareers is working with Medical Solutions to find a qualified Physical Therapist (PT) in Litchfield, Illinois, 62056!.A facility in Litchfield, IL is seeking its next amazing PT (Physic... Show more

 • Promoted

Work from Home – Product Feedback Support - $25-$45 per hour

GL Litchfield, Illinois
$25.00–$45.00 hourly
Remote
Full-time

We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market. Show more

 • Promoted

Travel Physical Therapist (PT) - $2,219 to $2,419 per week in Litchfield, IL

AlliedTravelCareersLitchfield, IL, US
$2,219.00 weekly
Full-time +1

AlliedTravelCareers is working with Jackson Therapy Partners to find a qualified Physical Therapist (PT) in Litchfield, Illinois, 62056!.Looking for a change of scenery and a chance to help others?... Show more

 • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPALitchfield, Illinois, us
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Customs and Border Protection Officer (CBPO) - Entry Level New Hire Sign-On and Retention Incentives

U.S. Customs and Border ProtectionAthens, IL, US
Full-time

Customs and Border Protection Officer (CBPO) .Customs and Border Protection (CBP) offers those interested in a career in law enforcement an exceptional opportunity to work with an elite team of... Show more

 • Promoted

Physician Assistant for In-home Visits

Signify HealthSherman, Illinois, US
Full-time

Are you interested in working flexible hours, connecting with people one-on-one, and helping them re-engage with their health? At Signify Health, part of CVS Health®, our mission is to build.While ... Show more

 • Promoted

Remote M&A Associate - AI Trainer ($50-$60 per hour)

Data AnnotationSpringfield, Illinois, United States
Remote
Full-time +1

DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own&#160... Show more

 • Promoted

Licensed Clinical Testing Psychologist - Middletown, IL

LifeStance HealthMiddletown, IL, US
Full-time

At LifeStance Health, we believe in a truly healthy society where mental and physical healthcare are unified to make lives better.Our mission is to help people lead healthier, more fulfilling lives... Show more

 • Promoted

Become a Surrogate – Give the Miracle of Life & Earn Up to $115,000 from Home!

Giving Tree SurrogacySherman, IL, US
Full-time +1

We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi... Show more

 • Promoted

Travel Physical Therapist (PT) - $2,515 per week in Litchfield, IL

AlliedTravelCareersLitchfield, IL, US
Full-time

AlliedTravelCareers is working with Cross Country Allied to find a qualified Physical Therapist (PT) in Litchfield, Illinois, 62056!.As a home health physical therapist, you'll provide PT services ... Show more

 • Promoted

Information Technology Professional

US NavyRiverton, IL, US
Full-time

Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more

 • Promoted

Become a Surrogate, give the miracle of life, and earn up to $115,000 from home!

Giving Tree SurrogacySherman, IL, US
Full-time +1

We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi... Show more