Remote Bilingual Italian Generalist Evaluator Expert - AI Trainer ($25-$30 per hour)
Remote Bilingual Italian Generalist Evaluator Expert - AI Trainer ($25-$30 per hour)
Mercor • Keizer, Oregon, US
[job_card.variable_days_ago]
[job_preview.job_type]
[job_card.full_time]
[filters.remote]
[job_card.job_description]
Mercor is seeking native
Italian
speakers with exceptional writing skills to contribute to a high-impact AI research project with a leading lab. Freelancers will author
Italian / English
prompt–golden answer pairs that train and evaluate advanced language models. This is a short-term, flexible opportunity for professionals who combine language mastery, strong critical thinking, and a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted, culturally grounded
Italian
text while maintaining technical precision in English.
##
Job Details
###
Multilingual Prompt Design & Optimization :
Create detailed prompts in Italian and / or English with multiple constraints and instructions, ensuring natural phrasing and real-world relevance for Italian-speaking users. ###
Define and Document Evaluation Standards :
Establish high-level expectations for correct responses in Italian consumer contexts, and develop comprehensive rubrics that account for linguistic nuance, tone, and cultural conventions. ###
Model Testing and Grading (Bilingual) :
Run prompts through models and assess preliminary outputs for accuracy, fluency, and cultural fit in Italian, comparing results against English where needed. ###
Benchmarking & Quality Assurance :
Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor—maintaining consistency and reliability across Italian-language benchmarks before integration into official evaluations.
##
Minimum Qualifications
Native-level fluency in Italian (written) with strong reading / writing ability in English. - BS or BA from a reputable institution (completed or in progress). - Strong writing and critical thinking skills. - Ability to work independently and meet deadlines. - Significant familiarity with ChatGPT or similar tools for personal decision-making, hobbies, or general interests. - Based in
Italy
(or able to reliably produce
Italy-specific
, culturally accurate Italian).
##
Preferred Qualifications
Experience in teaching, research, editing, or academic writing. - Experience creating evaluation criteria, rubrics, or grading guidelines. - Familiarity with LLMs, prompting, or model evaluation (helpful but not required).
##
Application & Onboarding Process
Complete an AI-led interview (about 15 minutes). - Complete a 45-minute written assessment focused on writing and rubric creation. - If selected, you will be invited to work on the project.
##
More Details About This Role
Expect to contribute at least 20 hours per week. - Expect a commitment of around 2+ months. - You’ll be working in a structured project environment with clear goals and tools. - We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
[job_alerts.create_a_job]
Remote Bilingual Italian Generalist Evaluator Expert AI Trainer 2530 per hour • Keizer, Oregon, US
[internal_linking.similar_jobs]
Remote FX & Digital Asset Trader - Albany, OR
Maverick Currencies • Albany, OR, United States
[filters.remote]
[job_card.full_time]
Take your trading to the next level in Albany, OR.Maverick Currencies provides funded accounts and professional development for serious traders.
Maverick Currencies is seeking disciplined traders wh...[show_more]
Looking to trade professionally from Albany, OR? We provide the capital, education, and structure—you bring the discipline and dedication.
Maverick Currencies is seeking disciplined traders who want...[show_more]
Remote Investment Analyst – AI Trainer ($50-$60 / hour)
Data Annotation • Albany, Oregon
[filters.remote]
[job_card.full_time] +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
Cynet Health is seeking an experienced Rad Tech for an exciting Travel Allied job in Albany, OR.Shift : 5x8 hr days Start Date : ASAP Duration : 13 weeks Pay : $2758 / Week.
Ranked #5 Best Travel Nursin...[show_more]
[last_updated.last_updated_30] • [promoted]
Remote Biologist - AI Trainer
SuperAnnotate • Lebanon, Oregon, US
[filters.remote]
[job_card.full_time]
We’re seeking biologists to join our AI training project.In this role, you will review AI-generated responses, evaluate reasoning quality and step-by-step problem-solving, and provide expert feedba...[show_more]
[last_updated.last_updated_variable_days]
Tax Senior, Hybrid
Jobot • Albany, OR, US
[job_card.full_time]
Senior Brand Manager opportunity available with growing e-commerce agency! (San Diego, CA) - send your resume to alicia@jobot.
This Jobot Job is hosted by : Marcus Curiel.Are you a fit? Easy Apply no...[show_more]
Lancesoft is seeking an experienced Rad Tech for an exciting Travel Allied job in Albany, OR.Shift : 5x8 hr days Start Date : ASAP Duration : 13 weeks Pay : $2766 / Week.
LanceSoft’s mission is to estab...[show_more]
[last_updated.last_updated_30] • [promoted]
Travel CT Tech - $2,044 to $2,244 per week in Mcminnville, OR
AlliedTravelCareers • Salem, Oregon, US
[job_card.full_time]
AlliedTravelCareers is working with Titan Medical Group to find a qualified CT Tech in Mcminnville, Oregon, 97128!.Mcminnville, OR, United States.
ARRT(CT) / BCLS / BLS - American Heart Association.Tita...[show_more]
Travel Physical Therapist (PT) - $1,834 to $1,934 per week in Lebanon, OR
AlliedTravelCareers • Lebanon, OR, US
[job_card.full_time] +1
AlliedTravelCareers is working with Converdia Health Staffing to find a qualified Physical Therapist (PT) in Lebanon, Oregon, 97355!.
ConVerdia Health Staffing- Staffing temporary and permanent jobs...[show_more]
Join Maverick Currencies as a funded trader in Albany, OR.Trade forex, metals, and crypto with our capital while keeping up to 90% of your profits.
Maverick Currencies is seeking disciplined traders...[show_more]
Ready to trade professionally from Albany, OR? Maverick Currencies offers the capital, training, and support you need to succeed.
Maverick Currencies is seeking disciplined traders who want to day t...[show_more]
Travel Physical Therapist (PT) - $2,206 to $2,406 per week in Albany, OR
AlliedTravelCareers • Albany, OR, US
[job_card.full_time]
AlliedTravelCareers is working with Ventura MedStaff to find a qualified Physical Therapist (PT) in Albany, Oregon, 97321!.
Are you ready to take your Travel career to the next level? See places yo...[show_more]
In this hourly, remote contractor role, you will review AI-generated English-language responses and / or generate expert language content, evaluating reasoning quality and step-by-step edits while pr...[show_more]
[last_updated.last_updated_variable_days]
Remote Senior C++ Engineer - AI Trainer
SuperAnnotate • Lebanon, Oregon, US
[filters.remote]
[job_card.full_time]
As a Senior C++ Engineer, you will work remotely on an hourly paid basis to review AI-generated C++ code, systems designs, and technical explanations, as well as generate high-quality reference imp...[show_more]
[last_updated.last_updated_variable_days]
Remote Currency Trader - Albany, OR
Maverick Currencies • Albany, OR, United States
[filters.remote]
[job_card.full_time]
Attention Albany, OR traders : Maverick Currencies is looking for dedicated individuals to join our prop trading team with firm-backed capital.
Maverick Currencies is seeking disciplined traders who ...[show_more]
Travel CT Tech - $2,476 to $2,676 per week in Mcminnville, OR
AlliedTravelCareers • Salem, Oregon, US
[job_card.full_time]
AlliedTravelCareers is working with Titan Medical Group to find a qualified CT Tech in Mcminnville, Oregon, 97128!.Mcminnville, OR, United States.
BCLS / BLS - American Heart Association / ARRT(CT).Tita...[show_more]
Remote Financial Advising Expert - AI Trainer ($50-$60 / hour)
Data Annotation • Albany, Oregon
[filters.remote]
[job_card.full_time] +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
Online Survey Participant : Work Remote and Earn Up To $25 Per Survey
Earn Haus • Salem, OR, US
[filters.remote]
[job_card.full_time] +1
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.
You will help influence brand decisions on se...[show_more]