Talent.com
Mercor
Remote Russian Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 perMercor • Lenexa, Kansas, US
Remote Russian Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 per

Remote Russian Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 per

Mercor • Lenexa, Kansas, US
13 days ago
Salary
$50.00 hourly
Job type
  • Full-time
  • Remote
Job description
Mercor is seeking a Russian Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Russian and English and are **based in the San Francisco Bay Area**, enabling occasional in-person collaboration if required. ## Job Responsibilities ### Transcribe and Optimise Audio & Video - Listen to, analyse, and transcribe audio and video content in Russian, following detailed constraints and instructions. - Produce high-quality written outputs in Russian, with supporting work in English when required. - Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. - Capture nuances such as tone, intent, formal vs. informal register, regional expressions, dialectal variations, and contemporary Russian usage where relevant. ### Define and Document Evaluation Standards - Establish clear expectations for correct and high-quality responses in general consumer audio contexts. - Develop detailed evaluation rubrics and grading guidelines in Russian and English. - Document standards to ensure consistency across reviewers and model evaluations. - Identify linguistic nuances, grammatical complexities, colloquialisms, and edge cases specific to Russian. ### Conduct Model Testing and Grading - Run prompts through language models and assess generated outputs. - Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity. - Provide structured feedback to improve model performance in Russian audio tasks. ### Support Benchmarking and Quality Assurance - Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar. - Maintain consistency and reliability before datasets are integrated into official benchmarks. - Collaborate with project leads to resolve ambiguities and improve task design. ## Minimum Qualifications - Strong writing, editing, and critical thinking skills. - Ability to work independently, manage time effectively, and meet deadlines. - Native or near-native fluency in Russian (spoken and written) and professional fluency in English. - Strong familiarity with spoken Russian, regional vocabulary, dialects, and contemporary language usage. - Ability to accurately transcribe and analyse Russian audio content across general consumer contexts. - **Must be based in the San Francisco Bay Area.** - Available to commit 10–20 hours per week. ## Preferred Qualifications - College students or recent graduates. - Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines. - Prior experience with transcription, annotation, localisation, evaluation, or research workflows in Russian. - Familiarity with regional variations of Russian and contemporary digital language usage. - Interest in AI, language models, or applied research environments. ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes). - If selected, you will be onboarded and invited to begin project work.
Create a job alert for this search

Remote Russian Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 per hour) • Lenexa, Kansas, US

Similar jobs

Remote Expert Contributor - Language Specialist

Arise Virtual SolutionsKansas City, Kansas
Remote
Full-time

Expert Contributor - Language Specialist.Must be fluent in one of the following languages:.Bengali, Thai, Korean, Vietnamese or Chinese.Your expertise teaches tomorrow's AI.HALO by Arise connects s... Show more

 • Promoted

Audiologist

TradeJobsWorkForce64151 Kansas City, MO, US
Full-time

Administer hearing tests and examine patients to collect information on type and degree of impairment, using specialized instruments and electronic equipment.Examine patients to assess general phys... Show more

 • Promoted

Work-From-Home Product Advisor - $45 per hour

Great LionBelton, Missouri
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaBelton, Missouri, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Amazon Robotics Technician

TradeJobsWorkforce64150 Riverside, MO, US
Full-time

Take the next step as our new Amazon Robotics Technician to perform daily responsibilities with dedication.Work with your team to maintain efficiency and service quality.Stay adaptable in a dynamic... Show more

 • Promoted

Market Research Analyst, Construction

ARCO Construction Co.Riverside, MO, United States
Full-time

Research target industries, owners, developers, and geographies to proactively identify upcoming construction projects, companies preparing for expansion, and adjacent opportunities that align with... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncBelton, Missouri
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Online Product Support - No Experience

GLOCPABelton, Missouri
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Sales Specialist

Home Depot (Retail)Belton, MO, United States
Full-time

Sales Specialists help customers bring their project ideas to life by offering a range of product options, providing samples, and recommending solutionsincluding installation and related services.S... Show more

 • Promoted

Remote Physics Expert (PhD) - $100+ per hour

Turing Spring Hill, Kansas
Remote
Full-time
Quick Apply

Remote contract for PhDs in Physics, Applied Physics, or related fields.Work on cutting-edge projects with top AI labs while earning $100+/hour, fully remote, with flexible weekly hours.Help fine-t... Show more

 • Promoted

Remote Recruiter (m / w / d)

Turnover Recruitment GmbHPlatte City, MO, United States
Remote

Turnover Agency - Spezialisiert auf SaaS, Personal Brands & E-Commerce und KI? Deine Rolle als Recruiter (m / w / d)Du wei t, wie Candidate Journey, Talent Sourcing und Conversion im Recruiting... Show more

 • Promoted

Work From Home - Product Specialist - $45 per hour

GL1Belton, Missouri
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersBucyrus, KS
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Remote Data Entry - Product Support - $45 per hour

GL Inc.Belton, Missouri
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Records Processor

TradeJobsWorkforce64150 Riverside, MO, US
Remote
Full-time

As a Remote Records Processor, you will be responsible for inputting and maintaining data accurately from home, including: input data accurately into company systems from home.Duties and responsibi... Show more

 • Promoted

Remote Physics Expert

Micro1Spring Hill, Kansas, US
Remote
Full-time

AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more

 • Promoted

BPD Sales Product Specialist - MRO

BunzlRiverside, MO, United States
Full-time

BPD Sales Product Specialist - MRO.At Bunzl, we know that our employees are our number one asset.We seek to recruit and retain the right people who are passionate about our business, and we provide... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USBelton, Missouri
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more