Talent.com
Mercor
Remote Russian Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 perMercor • High Point, North Carolina, US
Remote Russian Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 per

Remote Russian Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 per

Mercor • High Point, North Carolina, US
14 days ago
Salary
$50.00 hourly
Job type
  • Full-time
  • Remote
Job description
Mercor is seeking a Russian Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Russian and English and are **based in the San Francisco Bay Area**, enabling occasional in-person collaboration if required. ## Job Responsibilities ### Transcribe and Optimise Audio & Video - Listen to, analyse, and transcribe audio and video content in Russian, following detailed constraints and instructions. - Produce high-quality written outputs in Russian, with supporting work in English when required. - Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. - Capture nuances such as tone, intent, formal vs. informal register, regional expressions, dialectal variations, and contemporary Russian usage where relevant. ### Define and Document Evaluation Standards - Establish clear expectations for correct and high-quality responses in general consumer audio contexts. - Develop detailed evaluation rubrics and grading guidelines in Russian and English. - Document standards to ensure consistency across reviewers and model evaluations. - Identify linguistic nuances, grammatical complexities, colloquialisms, and edge cases specific to Russian. ### Conduct Model Testing and Grading - Run prompts through language models and assess generated outputs. - Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity. - Provide structured feedback to improve model performance in Russian audio tasks. ### Support Benchmarking and Quality Assurance - Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar. - Maintain consistency and reliability before datasets are integrated into official benchmarks. - Collaborate with project leads to resolve ambiguities and improve task design. ## Minimum Qualifications - Strong writing, editing, and critical thinking skills. - Ability to work independently, manage time effectively, and meet deadlines. - Native or near-native fluency in Russian (spoken and written) and professional fluency in English. - Strong familiarity with spoken Russian, regional vocabulary, dialects, and contemporary language usage. - Ability to accurately transcribe and analyse Russian audio content across general consumer contexts. - **Must be based in the San Francisco Bay Area.** - Available to commit 10–20 hours per week. ## Preferred Qualifications - College students or recent graduates. - Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines. - Prior experience with transcription, annotation, localisation, evaluation, or research workflows in Russian. - Familiarity with regional variations of Russian and contemporary digital language usage. - Interest in AI, language models, or applied research environments. ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes). - If selected, you will be onboarded and invited to begin project work.
Create a job alert for this search

Remote Russian Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 per hour) • High Point, North Carolina, US

Similar jobs

Remote Product Tester - Flexible Studies

BuzzTestersSummerfield, NC
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Work-From-Home Product Beta Tester - $45 per hour

Great LionSummerfield, North Carolina
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

SPEECH LANGUAGE PATHOLOGIST (SLP) - SUMMERSTONE HEALTH AND REHAB CENTER

LibertyHealth SystemKernersville, NC, United States
Full-time

SPEECH LANGUAGE PATHOLOGIST (SLP) - SUMMERSTONE HEALTH AND REHAB CENTERConsidering making an application for this job Check all the details in this job description, and then click on Apply.Liberty ... Show more

 • Promoted

WFH - Product Assessments - $25-$45 per hour (No Experience)

Online Consumer Panels AmericaSummerfield, North Carolina, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Work-From-Home Online Product Tester - $45 per hour

Online Consumer Panels AmericaSummerfield, North Carolina, US
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Work – Product Assessments - $25-$45 per hour (No Experience)

Online Consumer Panels AmericaSummerfield, North Carolina, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

On-Site Vacancy Assessment Evaluator

FAR InspectionsHigh Point, NC, United States
Full-time

Residential Mortgage Inspector.FAR Inspections is actively seeking a reliable independent contractor to perform residential mortgage inspections in Randolph County, North Carolina and surrounding c... Show more

 • Promoted

Work from home - Market Research Study

Earn HausSandy Ridge, North Carolina, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Work-From-Home Product Advisor - $45 per hour

Great LionHigh Point, North Carolina
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaKernersville, North Carolina, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

MRI Technologist

Novant HealthThomasville, NC, United States
Full-time

What We Offer:MRI Technologist are eligible for a sign-on bonus up to $1,000 (PRN New Hires)Magnetic Resonance Imaging (MRI) TechnologistForsyth Medical CenterSchedule: PRNNovant Health Job ID: 140... Show more

 • Promoted

Earn up to $400 per Day by Playing Games and TakingSurveys

Freecash.comKernersville, North Carolina, United States
Full-time

Since its launch 6 years ago, over 60MN users have earned and withdrawn over $250MN! The platform is rated 4.TrustPilot with over 230k+ reviews, establishing Freecash as one of the highest-rated op... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USArchdale, North Carolina
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

Clinical Fellowship / Pediatric SLP

Express Communication TherapyHigh Point, NC, United States
Full-time

Express Communication Therapy is seeking a motivated and compassionate Clinical Fellow Speech-Language Pathologist (CFY-SLP) and Speech Language Patholigist to join our growing pediatric private pr... Show more

 • Promoted

Online Remote Work

Online Consumer Panels AmericaSummerfield, North Carolina, US
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Online Product Tester

Online Consumer Panels AmericaSummerfield, North Carolina, US
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Summerfield, North Carolina
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Global Sourcing Specialist-Senior

Flexsteel IndustriesHigh Point, NC, United States
Full-time

Senior Global Sourcing Specialist.As a Senior Global Sourcing Specialist, you will play a critical role in ensuring our products are supported by a resilient, high-performing supply base.Serve as t... Show more

 • Promoted

Online Work-From-Home - $45 per hour - No Experience

Online Consumer Panels AmericaSummerfield, North Carolina, US
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Consumer Insights Analyst

Earn HausSandy Ridge, North Carolina, United States
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more