Talent.com
Mercor
Remote AI Session Annotator (English) - AI Trainer ($24-$30 per hour)Mercor • Springfield, Oregon, US
Remote AI Session Annotator (English) - AI Trainer ($24-$30 per hour)

Remote AI Session Annotator (English) - AI Trainer ($24-$30 per hour)

Mercor • Springfield, Oregon, US
2 days ago
Salary
$24.00–$30.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • About the Role Mercor is hiring English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said against what was actually visible in the video, and score it against a detailed rubric. Your written comments are the deliverable. What you flag as a failure is what gets fixed first. This is judgment work, not volume work. Key Responsibilities - Review recorded sessions in which a user speaks to an AI assistant while their camera streams whatever is in front of them. - Compare the assistant's responses against what was actually visible in the video feed, and identify hallucinated or fabricated visual detail. - Score each session across visual interpretation, accuracy, relevance, response timing, and whether the assistant used spatial and directional language ("to your left", "move your finger up") rather than purely visual description. - Judge whether the assistant appropriately warned the user when its answer could affect their health, physical safety, or financial security, and whether that warning was timely and proportionate. - Write detailed open comments that support every score with concrete evidence from the session. - Capture the conversation turn by turn in the intake form. Required Qualifications - Native or native-level English , spoken and written. - Clear, precise written English; the scoring guide is written in English. - An Android phone with a working camera and microphone. This is mandatory for the project. - Attention to detail and the discipline to apply a rubric consistently, without substituting your own criteria along the way. Preferred Qualifications - Prior data annotation, linguistic QA, content moderation, or AI model evaluation experience. - Training in linguistics, translation or interpreting, - An ear for regional register : recognizing when the assistant's English sounds unnatural or non-native. Additional Information - Start date : Immediate. High volume of work between 26 to 31 Aug is expected. - Content note : some sessions involve situations where a wrong answer would carry real consequences, such as identifying medication, checking whether food has spoiled, crossing a street, or reading bank card details. There is no graphic or violent content, but you will evaluate cases with safety implications, and part of the work is flagging when the assistant failed to warn about the risk. Application Process - Submit your resume or relevant background to get started. - Qualified applicants may be asked to complete a short calibration task on sample sessions, assessed on scoring consistency and the usefulness of written comments. We are not assessing speed.
Create a job alert for this search

Remote AI Session Annotator (English) - AI Trainer ($24-$30 per hour) • Springfield, Oregon, US

Similar jobs

County Meter Reader

Meter ReaderCottage Grove, OR
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Caregiver

Arcadia Home Care and StaffingCottage Grove, OR, United States
Full-time +1

Now offering Daily Pay for select positions.We are urgently hiring Home Care Aides - HCAs - in these cities: Cottage Grove, OR - Creswell, OR - Florence, OR - Junction City, OR - Springfield, OR - ... Show more

 • Promoted

School Health Assistant (CMA, CNA I & II) London

South Lane School District 45JCottage Grove, OR, United States
Full-time

School Health Assistant - CMA, CNA I or II working 190 days per school year 20 hours per week.REPORTS TO: Supervisor (Principal) POSITION PURPOSE: The School Health Assistant assists the School Nur... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersEugene, OR
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Consumer Insights Analyst

Earn HausCrawfordsville, Oregon, United States
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USCottage Grove, Oregon
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Pro Tem Instructor (Computer Science) - Open Pool

University of OregonEugene, OR, United States
Full-time

Pro Tem Instructor (Computer Science) - Open PoolJob no: 535374Work type: Faculty - Pro TemporeLocation: Eugene, ORCategories: Instruction, Computer and Information ScienceDepartment: CAS CIS Compu... Show more

 • Promoted

Work From Home

Remote JobsShedd, OR
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more

 • Promoted

Paid Online Survey Participant - No Experience

Clubshop | USCottage Grove, Oregon
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Benefits Representative Remote

American Income Life: AOBrownsville, OR, United States
Remote
Full-time

We are seeking overachievers who excel in building strong working relationships and delivering exceptional client experiences.If you pride yourself on your outstanding self-determination and have a... Show more

 • Promoted

Work From Home

AmazonCottage Grove, OR
Remote
Full-time

Job Title: Work From Home Customer Service Representative.As a Work From Home Customer Service Representative at Amazon, you will be the first point of contact for customers seeking assistance.You ... Show more

 • Promoted

Work From Home Fast & Serious 100% Free - No experience

Clubshop | USCottage Grove, Oregon
Remote
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Market Development Manager, AI Scientific Platform

Thermo FisherEugene, OR, United States
Full-time

As part of the Thermo Fisher Scientific team, you'll discover meaningful work that makes a positive impact on a global scale.Join our colleagues in bringing our Mission to life every single day to ... Show more

 • Promoted

Work from home - Market Research Study

Earn HausPleasant Hill, Oregon, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Certified Medical Assistant or Medical Assistant (Part-Time)

Community Care PartnersCottage Grove, OR, United States
Part-time

Medical Assistant Putting the Personal Care in Healthcare!.Join a supportive team that values your skills, growth, and a healthy team culture.We foster a positive patient-focused environment where... Show more

 • Promoted

CT Technologist

PeaceHealthCottage Grove, OR, US
$46.27 hourly
Full-time

CT Technologist — Per Diem / Relief.PeaceHealth Cottage Grove Medical Center in Cottage Grove, OR.PTO, sick calls, and short‑notice staffing needs.This position is well‑suited for technologists who... Show more

Assist Mngr Trainee Cottage Grove Popeyes

Ambrosia QSRCottage Grove, OR, United States
Full-time

Assist Mngr Trainee Cottage Grove Popeyes.Hourly Position Type Full Time Education Level None Travel Percentage None Category Restaurant - Food Service.The Assistant Manager role at Popeyes support... Show more

 • Promoted

Remote Benefits Advisor (50k-90k per year)

Professional CareersCottage Grove, Oregon
$50,000.00 yearly
Remote
Full-time +1

We're looking for candidates with great customer service skills to fill our Remote Customer Service role!.This role is entirely remote and offers full-time/Part time hours with flexibility.We are r... Show more

Associate Team Leader

H&R BlockCottage Grove, OR, United States
Full-time +1

Our CompanyAt H&R Block, we believe in the power of people helping people.Our defining Purpose is to provide help and inspire confidence in our clients, associates, and communities everywhere.W... Show more

 • Promoted

Earn up to $25 per survey Online Survey Taker (Hiring Immediately)

Earn HausSodaville, OR, United States
Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more