Talent.com
Mercor
Remote AI Session Annotator (Korean) - AI Trainer ($24-$30 per hour)Mercor • Fort Collins, Colorado, US
Remote AI Session Annotator (Korean) - AI Trainer ($24-$30 per hour)

Remote AI Session Annotator (Korean) - AI Trainer ($24-$30 per hour)

Mercor • Fort Collins, Colorado, US
6 days ago
Salary
$24.00–$30.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • About the Role Mercor is hiring Korean-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said against what was actually visible in the video, and score it against a detailed rubric. Your written comments are the deliverable. What you flag as a failure is what gets fixed first. This is judgment work, not volume work. Key Responsibilities - Review recorded sessions in which a user speaks to an AI assistant while their camera streams whatever is in front of them. - Compare the assistant's responses against what was actually visible in the video feed, and identify hallucinated or fabricated visual detail. - Score each session across visual interpretation, accuracy, relevance, response timing, and whether the assistant used spatial and directional language ("to your left", "move your finger up") rather than purely visual description. - Judge whether the assistant appropriately warned the user when its answer could affect their health, physical safety, or financial security, and whether that warning was timely and proportionate. - Write detailed open comments that support every score with concrete evidence from the session. - Capture the conversation turn by turn in the intake form. Required Qualifications - Native or native-level Korean , spoken and written. - Clear, precise written Korean. - An Android phone with a working camera and microphone. This is mandatory for the project. - Attention to detail and the discipline to apply a rubric consistently, without substituting your own criteria along the way. - Professional English reading comprehension; the scoring guide is written in English. Preferred Qualifications - Prior data annotation, linguistic QA, content moderation, or AI model evaluation experience. - Training in linguistics, translation or interpreting, - An ear for regional register : recognizing when the assistant's Korean sounds unnatural or non-native. Additional Information - Start date : Immediate. High volume of work between 26 to 31 Aug is expected. - Content note : some sessions involve situations where a wrong answer would carry real consequences, such as identifying medication, checking whether food has spoiled, crossing a street, or reading bank card details. There is no graphic or violent content, but you will evaluate cases with safety implications, and part of the work is flagging when the assistant failed to warn about the risk. Application Process - Submit your resume or relevant background to get started. - Qualified applicants may be asked to complete a short calibration task on sample sessions, assessed on scoring consistency and the usefulness of written comments. We are not assessing speed.
Create a job alert for this search

Remote AI Session Annotator (Korean) - AI Trainer ($24-$30 per hour) • Fort Collins, Colorado, US

Similar jobs

Sr. Product Manager, HPC and AI Software

Hewlett Packard Enterprise Development LPFort Collins, CO, United States
Full-time

Product Manager, HPC and AI Software.This role has been designed as "Onsite" with an expectation that you will primarily work from an HPE office.Hewlett Packard Enterprise is the global edge-to-clo... Show more

 • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPAWarren AFB, Wyoming, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Product Tester (Work From Home) – Keep Free Products + Weekly Pay

OCPAWarren AFB, Wyoming, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Biology Expert

Micro1Severance, Colorado, US
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

In-Home Product Tester – No Fees, No Experience, $25-$45/hr

OCPAWarren AFB, Wyoming, us
$25.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Test Products from Home – $25-$45/hr + Freebies

OCPAWarren AFB, Wyoming, us
$25.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Nurse Practitioner or Physician Assistant - Cheyenne WY

MRG ExamsFe Warren Afb, WY, United States
Part-time

Nurse Practitioner (NP) or Physician Assistant (PA) “ Veteran Disability Assessments We are seeking a dedicated Nurse Practitioner (NP) or Physician Assistant (PA) to join ... Show more

 • Promoted

Paid Online Survey Participant - No Experience

Clubshop | USWarren AFB, Wyoming
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Consumer Research Associate (Remote)

GL IncFort Collins, Colorado
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersFort Collins, CO
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Remote Sales Agent

The Hirsh AgencyWarren Air Force Base, Wyoming, United States
Remote
Full-time

How about TODAY being the day you take back your life and secure your future? .The finance industry makes more millionaires than any other industry in the World!.My name is Beau, founder and owner ... Show more

Part Time - Work from Home - Online Product Tester - No experience ($25-$45 per hour)

OCPAWarren AFB, Wyoming, us
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Work From Home Product Tester – $25-$45/hr – No Experience Needed

OCPAWarren AFB, Wyoming, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Store Associate

US Department of WarFe Warren Afb, WY, United States
Full-time

Assisting customers by answering questions such as item price or location, and handling bulky/heavy items.Operating an electronic checkout system to record unit price, total customer purchase, and ... Show more

 • Promoted

Hiring Now - Work from Home - No Experience

OCPAWarren AFB, Wyoming, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Work from home - Market Research Study

Earn HausCarr, Colorado, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Get Paid to Test Products at Home – Flexible Hours, Weekly Pay

OCPAWarren AFB, Wyoming, us
$25.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Catholic Religious Education (RE) Coordinator

Ladgov CorporationFe Warren Afb, WY, United States
Part-time

Catholic Religious Education (RE) Coordinator.Warren Air Force Base, Wyoming Employment Type: Contract / Part-Time (Approximately 25 hours per week) Key Tasks / Responsibilities:.Manage and coordin... Show more

 • Promoted

Remote Consumer Research Participant

GL IncSeverance, Colorado
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Consumer Insights Analyst

Earn HausCarr, Colorado, United States
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more