Talent.com
Mercor
Remote AI Session Annotator (Korean) - AI Trainer ($24-$30 per hour)Mercor • Clovis, California, US
Remote AI Session Annotator (Korean) - AI Trainer ($24-$30 per hour)

Remote AI Session Annotator (Korean) - AI Trainer ($24-$30 per hour)

Mercor • Clovis, California, US
4 days ago
Salary
$24.00–$30.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • About the Role Mercor is hiring Korean-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said against what was actually visible in the video, and score it against a detailed rubric. Your written comments are the deliverable. What you flag as a failure is what gets fixed first. This is judgment work, not volume work. Key Responsibilities - Review recorded sessions in which a user speaks to an AI assistant while their camera streams whatever is in front of them. - Compare the assistant's responses against what was actually visible in the video feed, and identify hallucinated or fabricated visual detail. - Score each session across visual interpretation, accuracy, relevance, response timing, and whether the assistant used spatial and directional language ("to your left", "move your finger up") rather than purely visual description. - Judge whether the assistant appropriately warned the user when its answer could affect their health, physical safety, or financial security, and whether that warning was timely and proportionate. - Write detailed open comments that support every score with concrete evidence from the session. - Capture the conversation turn by turn in the intake form. Required Qualifications - Native or native-level Korean , spoken and written. - Clear, precise written Korean. - An Android phone with a working camera and microphone. This is mandatory for the project. - Attention to detail and the discipline to apply a rubric consistently, without substituting your own criteria along the way. - Professional English reading comprehension; the scoring guide is written in English. Preferred Qualifications - Prior data annotation, linguistic QA, content moderation, or AI model evaluation experience. - Training in linguistics, translation or interpreting, - An ear for regional register : recognizing when the assistant's Korean sounds unnatural or non-native. Additional Information - Start date : Immediate. High volume of work between 26 to 31 Aug is expected. - Content note : some sessions involve situations where a wrong answer would carry real consequences, such as identifying medication, checking whether food has spoiled, crossing a street, or reading bank card details. There is no graphic or violent content, but you will evaluate cases with safety implications, and part of the work is flagging when the assistant failed to warn about the risk. Application Process - Submit your resume or relevant background to get started. - Qualified applicants may be asked to complete a short calibration task on sample sessions, assessed on scoring consistency and the usefulness of written comments. We are not assessing speed.
Create a job alert for this search

Remote AI Session Annotator (Korean) - AI Trainer ($24-$30 per hour) • Clovis, California, US

Similar jobs

Content Manager - Remote

TradeJobsWorkForce93711 Fresno, CA, US
Remote
Full-time

Content Manager Job Duties: Manages all content creation, revision, and retention across multiple ... Show more

 • Promoted

Room Attendant FT

Table Mountain CasinoFriant, CA, United States
Full-time

Position Summary:Under general direction from the Housekeeping Supervisor, responsible for cleaning, maintaining, and organizing guest rooms and common areas in hotels or other hospitality settings... Show more

 • Promoted

Native American Program Mentor

Sierra UnifiedPrather, CA, United States
Full-time

Job SummarySPECIAL DETAILS: Position # 2191 8 hours per day, 200 duty days This position requires a Bachelor's degree in a related field including but not limited to Counseling, Psychology, Educati... Show more

 • Promoted

Neurobiologist

TradeJobsWorkForce93711 Fresno, CA, US
Full-time

Neuorbiologist Job Duties: Completes neurobiological studies by conducting tests, examina... Show more

 • Promoted

AMFT/ACSW Part Time (Fully Remote) - CA

Love Resilience Counseling IncFriant, CA, United States
Remote
Part-time

Job Description:Job Title:Associate Marriage and Family Therapist (AMFT)Location:California, RemoteEmployment Type:Part-TimeReports To:Clinical Supervisor / Program ManagerRole Summary:We are seeki... Show more

 • Promoted

Paid Online Survey Participant - No Experience

Clubshop | USFort Washington, California
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Mental Health & Addiction Counsellor II - Remote FT

EHN CanadaFriant, CA, United States
Remote
Full-time

EHN Canada is the nation's largest private network of industry-leading mental health, trauma, and addiction treatment facilities, each with a passion for providing quality treatment for Canadians.W... Show more

 • Promoted

Lateral Partner - National Defense Law Firm (Remote Flexibility)

Incendia PartnersFriant, CA, United States
Remote
Full-time

Lateral Partner - National Defense Law Firm (Remote Flexibility)Location :California, New York, New Jersey, or Florida (Remote Flexible) - Active law license in good standing in any U.CA, NY, NJ, o... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersPrather, CA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

American Airlines Reservation Agent (Remote)

TradeJobsWorkforce93720 Fresno, CA, US
Remote
Full-time

Make an impact in the role of American Airlines Reservation Agent (Remote) to book flights, modify reservations, and assist travelers remotely.Stay adaptable to meet changing priorities and busines... Show more

 • Promoted

County Meter Reader

Meter ReaderFriant, CA
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Workers Comp Attorney Fully Remote

New Day Executive SearchFriant, CA, United States
Remote
Full-time

Workers Comp Attorney/h2pCalifornia law group seeks dynamic, experienced associates with workers compensation.Work remotely and be part of an innovative legal team! You will work closely with their... Show more