Talent.com
Mercor
Remote AI Session Annotator (English) - AI Trainer ($24-$30 per hour)Mercor • Springfield, Massachusetts, US
No longer accepting applications
Remote AI Session Annotator (English) - AI Trainer ($24-$30 per hour)

Remote AI Session Annotator (English) - AI Trainer ($24-$30 per hour)

Mercor • Springfield, Massachusetts, US
11 days ago
Salary
$24.00–$30.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • About the Role Mercor is hiring English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said against what was actually visible in the video, and score it against a detailed rubric. Your written comments are the deliverable. What you flag as a failure is what gets fixed first. This is judgment work, not volume work. Key Responsibilities - Review recorded sessions in which a user speaks to an AI assistant while their camera streams whatever is in front of them. - Compare the assistant's responses against what was actually visible in the video feed, and identify hallucinated or fabricated visual detail. - Score each session across visual interpretation, accuracy, relevance, response timing, and whether the assistant used spatial and directional language ("to your left", "move your finger up") rather than purely visual description. - Judge whether the assistant appropriately warned the user when its answer could affect their health, physical safety, or financial security, and whether that warning was timely and proportionate. - Write detailed open comments that support every score with concrete evidence from the session. - Capture the conversation turn by turn in the intake form. Required Qualifications - Native or native-level English , spoken and written. - Clear, precise written English; the scoring guide is written in English. - An Android phone with a working camera and microphone. This is mandatory for the project. - Attention to detail and the discipline to apply a rubric consistently, without substituting your own criteria along the way. Preferred Qualifications - Prior data annotation, linguistic QA, content moderation, or AI model evaluation experience. - Training in linguistics, translation or interpreting, - An ear for regional register : recognizing when the assistant's English sounds unnatural or non-native. Additional Information - Start date : Immediate. High volume of work between 26 to 31 Aug is expected. - Content note : some sessions involve situations where a wrong answer would carry real consequences, such as identifying medication, checking whether food has spoiled, crossing a street, or reading bank card details. There is no graphic or violent content, but you will evaluate cases with safety implications, and part of the work is flagging when the assistant failed to warn about the risk. Application Process - Submit your resume or relevant background to get started. - Qualified applicants may be asked to complete a short calibration task on sample sessions, assessed on scoring consistency and the usefulness of written comments. We are not assessing speed.
Create a job alert for this search

Remote AI Session Annotator (English) - AI Trainer ($24-$30 per hour) • Springfield, Massachusetts, US

Similar jobs

Online Remote Work

Online Consumer Panels AmericaNorthampton, Massachusetts, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Northampton, Massachusetts
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPASouthampton, Massachusetts, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Online Consumer Research Participant

GL IncHolyoke, Massachusetts
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Online Market Research Participant

GL IncNorthampton, Massachusetts
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Work – Product Assessments - $25-$45 per hour (No Experience)

Online Consumer Panels AmericaHolyoke, Massachusetts, US
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Online Product Support - No Experience

GLOCPAHolyoke, Massachusetts
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Family Engagement Specialist (Remote Opportunity)

InsideHigherEdAmherst, MA, United States
Remote
Full-time

Job no :529418Work type :Staff Full TimeLocation :UMass Amherst, Connecticut, Maine, New Hampshire, Rhode Island, VermontDepartment :UMDI - TTA Head StartUnion :PSUCategories :Donahue Institute, PS... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaHolyoke, Massachusetts, US
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Licensed School Psychologist - (Hybrid-remote)

K12 CORE - Midwest AtlanticHolyoke, MA, United States
Remote
Full-time

School Psychologist positions require an active School Psychologist license and a graduate degree in School Psychology.Applicants must meet these minimum requirements to be considered.Are you a pas... Show more

 • Promoted

Senior Award Research Administrator (Remote Opportunity)

UMass AmherstAmherst, MA, United States
Remote
Temporary

Job SummaryUnder the direction of the Assistant Director for the Office of Post-Award Management (OPAM), the Senior Administrator reviews, negotiates, and finalizes for acceptance by the Authorized... Show more

 • Promoted

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiNorthampton, MA, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Remote Consumer Research Participant

GL IncNorthampton, Massachusetts
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Consumer Insights Participant

GL IncNorthampton, Massachusetts
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Biology Expert

Micro1Holyoke, Massachusetts, US
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

Senior Director, Business Intelligence & Analytics

UMass Amherst FoundationHadley, MA, United States
Full-time +1

Senior Director Of Bi & Analytics.The Senior Director of BI & Analytics sits within the Advancement Operations division and reports directly to the Associate Vice President of Advancement Operation... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USNorthampton, Massachusetts
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Consumer Research Associate (Remote)

GL IncHolyoke, Massachusetts
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Work from Home - Online Product Support (Entry Level)

GLOCPAHolyoke, Massachusetts
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Work-From-Home Product Advisor - $45 per hour

Great LionHolyoke, Massachusetts
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more