Mercor is seeking a Hindi Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Hindi and English and are **based in the San Francisco Bay Area**, enabling occasional in-person collaboration if required. ## Job Responsibilities ### Transcribe and Optimise Audio & Video - Listen to, analyse, and transcribe audio and video content in Hindi, following detailed constraints and instructions. - Produce high-quality written outputs in Hindi, with supporting work in English when required. - Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. - Capture nuances such as tone, intent, formal vs. informal register, regional expressions, dialectal variations, and contemporary Hindi usage where relevant. ### Define and Document Evaluation Standards - Establish clear expectations for correct and high-quality responses in general consumer audio contexts. - Develop detailed evaluation rubrics and grading guidelines in Hindi and English. - Document standards to ensure consistency across reviewers and model evaluations. - Identify linguistic nuances, grammatical complexities, colloquialisms, code-switching patterns, and edge cases specific to Hindi. ### Conduct Model Testing and Grading - Run prompts through language models and assess generated outputs. - Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity. - Provide structured feedback to improve model performance in Hindi audio tasks. ### Support Benchmarking and Quality Assurance - Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar. - Maintain consistency and reliability before datasets are integrated into official benchmarks. - Collaborate with project leads to resolve ambiguities and improve task design. ## Minimum Qualifications - Strong writing, editing, and critical thinking skills. - Ability to work independently, manage time effectively, and meet deadlines. - Native or near-native fluency in Hindi (spoken and written) and professional fluency in English. - Strong familiarity with spoken Hindi, regional vocabulary, dialects, and contemporary language usage. - Ability to accurately transcribe and analyse Hindi audio content across general consumer contexts. - **Must be based in the San Francisco Bay Area.** - Available to commit 10–20 hours per week. ## Preferred Qualifications - College students or recent graduates. - Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines. - Prior experience with transcription, annotation, localisation, evaluation, or research workflows in Hindi. - Familiarity with Hindi-English code-switching (Hinglish) and regional language variation. - Interest in AI, language models, or applied research environments. ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes). - If selected, you will be onboarded and invited to begin project work.
Remote Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) - AI Trainer ($50-$50 per hour) • Springfield, Missouri, US
CoxHealth is seeking a BC/BE otolaryngologist to join our respected team and embark on a fulfilling career path with exceptional benefits.We offer a starting salary guarantee of $500,000, along wit... Show more
Phoenix Physical Therapist Assistant.Physical Therapist Assistants carry out various elements of patient care, gathering relevant information about the treatment administered, and collaborating wit... Show more
Project Specialist, Utility Water Distribution.Bolivar, MO, US, 65613 Algonquin Power & Utilities Corp.AQN), parent company of Liberty, is a diversified international generation, transmission, and ... Show more
We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more
About Join a talented team of individuals who serve this country by caring for our Nation's heroes! Clay Consulting is hiring experienced Audiologists to perform one-time, in-person Audiology Exami... Show more
Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more
Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more
Job ID:11460Practice DetailsSeeking a Pediatrician to join an established Pediatrics group in Bolivar, MO!The ideal candidate will want to have a busy outpatient practice and be able to cover Newbo... Show more
Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more
Promise Care Center Job Opportunity.Are you looking for a rewarding career in healthcare? Promise Care Center is the place for you! Our organization is family-owned and proud to carry on a legacy o... Show more
Residential Mortgage Inspector.FAR Inspections is actively seeking a reliable independent contractor to perform residential mortgage inspections in Polk County, Missouri and surrounding communities... Show more
Position Type:Student Support Services/Visually ImpairedDate Posted:6/26/2025Location:Highlandville Elementary SchoolDate Available:08/20/2025Position Descriptions: The Teacher of the Visually Impa... Show more
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.Join CXG, the global leader in custo... Show more
We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more
Mon - Fri, 9-5 Competitive Salary Bonus Incentive Full Benefits Amazing Team & Culture! This Jobot Job is hosted by:Courtney Labonte Are you a fit? Easy Apply now by clicking the Apply Now butt... Show more
Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more
Are you looking for a relationship-based practice where you can really impact your patients and the community? An independent, locally owned healthcare system is seeking to add a BC/BE Neurologist ... Show more
Join our team of online survey participants who play a crucial role in shaping products and services for Fortune 500 brands! If you're a motivated individual seeking flexible hours and the chance t... Show more
REMOTE POSITIONCardiothoracic Coding TechnicianCitizens Memorial Hospital (CMH) in Bolivar, MO is hiring a Certified Cardiothoracic Coding Technician to join our team in the Clinic Coding Departmen... Show more
Work 100% remotely, set your own schedule, and earn additional income while making a real difference in men's health and lives.Hone is one of the fastest-growing health companies in the United Stat... Show more
