Mercor is seeking a Hindi Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Hindi and English and are **based in the San Francisco Bay Area**, enabling occasional in-person collaboration if required. ## Job Responsibilities ### Transcribe and Optimise Audio & Video - Listen to, analyse, and transcribe audio and video content in Hindi, following detailed constraints and instructions. - Produce high-quality written outputs in Hindi, with supporting work in English when required. - Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. - Capture nuances such as tone, intent, formal vs. informal register, regional expressions, dialectal variations, and contemporary Hindi usage where relevant. ### Define and Document Evaluation Standards - Establish clear expectations for correct and high-quality responses in general consumer audio contexts. - Develop detailed evaluation rubrics and grading guidelines in Hindi and English. - Document standards to ensure consistency across reviewers and model evaluations. - Identify linguistic nuances, grammatical complexities, colloquialisms, code-switching patterns, and edge cases specific to Hindi. ### Conduct Model Testing and Grading - Run prompts through language models and assess generated outputs. - Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity. - Provide structured feedback to improve model performance in Hindi audio tasks. ### Support Benchmarking and Quality Assurance - Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar. - Maintain consistency and reliability before datasets are integrated into official benchmarks. - Collaborate with project leads to resolve ambiguities and improve task design. ## Minimum Qualifications - Strong writing, editing, and critical thinking skills. - Ability to work independently, manage time effectively, and meet deadlines. - Native or near-native fluency in Hindi (spoken and written) and professional fluency in English. - Strong familiarity with spoken Hindi, regional vocabulary, dialects, and contemporary language usage. - Ability to accurately transcribe and analyse Hindi audio content across general consumer contexts. - **Must be based in the San Francisco Bay Area.** - Available to commit 10–20 hours per week. ## Preferred Qualifications - College students or recent graduates. - Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines. - Prior experience with transcription, annotation, localisation, evaluation, or research workflows in Hindi. - Familiarity with Hindi-English code-switching (Hinglish) and regional language variation. - Interest in AI, language models, or applied research environments. ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes). - If selected, you will be onboarded and invited to begin project work.
Remote Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 per hour) • Spokane Valley, Washington, US
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
The Sei Foundation is seeking an innovative and strategic Head of Artificial Intelligence to spearhead the growth and integration of AI-focused applications within the Sei blockchain ecosystem.This... Show more
Job Description for Paraeducator - CI/CMI, AI, BI Classified Salary Schedule CVSD's classified positions come with more than just a paycheck! In addition to competitive hourly rates, we provide a p... Show more
AlliedTravelCareers is working with Delta Healthcare Providers to find a qualified Physical Therapist (PT) in Deer Park, Washington, 99006!.Setting: Outpatient, Orthopedics, Neurology, Aquatics.Com... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Admissions Advisor (Remote)ApplyBovard CollegeLos Angeles, CaliforniaUSC Bovard College provides innovative online graduate programs to support individuals during key academic and career transition... Show more
Coding Quality Auditor Remote GA, FL, NC, NH Residents ONLYOverviewFull Time - Remote Position.This position reports to the Manager of Coding / CDI and is responsible for ongoing quality review and... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
A global security solutions provider is seeking a customer-oriented professional for application and configuration support.This role involves troubleshooting video management and access control sys... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
A leading entertainment service is seeking a Lead Producer to oversee game development projects.This role requires over 13 years of experience in video game production and strong leadership skills.... Show more
Synergisticit Job Market AwarenessSynergisticIT is aware that the job market is challenging due to almost 600,000 tech layoffs within the past 2 years due to which the job market is flooded with th... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
A leading media and marketing firm is seeking a Global Programmatic Media Manager to plan, activate, and manage programmatic media buys while ensuring alignment with client goals.Ideal candidates p... Show more
Be among the first 25 applicantsTutor Me Education is reshaping how students learn.We are looking for teachers and tutors with special education experience to provide 1 :1 or group instruction to s... Show more
Work 100% remotely set your own schedule and earn additional income while making a real difference in mens health and lives.Hone is one of the fastest-growing health companies in the United States ... Show more
