Mercor is seeking a Bengali Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models.
This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Bengali and English and enjoy translating complex audio and visual information into precise, well-structured text. * * * ## Job Responsibilities ### Transcribe and Optimize Audio & Video - Listen to, analyze, and transcribe audio and video content in Bengali , following detailed constraints and instructions. - Produce high-quality written outputs in Bengali, with supporting work in English when required. - Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. - Capture nuances such as tone, intent, and regional language variations where relevant. * * * ### Define and Document Evaluation Standards - Establish clear expectations for correct and high-quality responses in general consumer audio contexts. - Develop detailed evaluation rubrics and grading guidelines in Bengali and English . - Document standards to ensure consistency across reviewers and model evaluations. - Identify edge cases, ambiguities, and linguistic complexities specific to Bengali. * * * ### Conduct Model Testing and Grading - Run prompts through language models and assess generated outputs. - Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity. - Provide structured feedback to improve model performance in Bengali audio tasks. * * * ### Support Benchmarking and Quality Assurance - Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar. - Maintain consistency and reliability before datasets are integrated into official benchmarks. - Collaborate with project leads to resolve ambiguities and improve task design. * * * ## Minimum Qualifications - Strong writing, editing, and critical thinking skills. - Ability to work independently, manage time effectively, and meet deadlines. - Native or near-native fluency in Bengali (spoken and written) and professional fluency in English. - Ability to accurately transcribe and analyze Bengali audio content across general consumer contexts. - Available to commit 10–20 hours per week . * * * ## Preferred Qualifications - College students or recent graduates. - Background in linguistics, humanities, social sciences, journalism, or technical disciplines. - Prior experience with transcription, annotation, localization, evaluation, or research workflows in Bengali. - Familiarity with dialectal variations, regional speech patterns, and contemporary usage in Bengali. - Interest in AI, language models, or applied research environments. * * * ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes). - If selected, you will be onboarded and invited to begin project work. * * * ## Additional Role Details - Work in a structured, goal-oriented project environment with clear tooling, guidelines, and support. - Gain hands-on exposure to real-world AI research and evaluation workflows. - Contribute directly to benchmarking and improving advanced multilingual language models.
Remote Bengali Generalist Evaluator Expert - AI Trainer ($50-$50 per hour) • Lubbock, Texas, US
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet...Show more
AI labs train foundational models and enterprises build AI agents.We provide frontier evaluations and reinforcement learning environments used to improve LLM capabilities, as well as contextual eva...Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet...Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
Lubbock Online Student Advocate - Remote 43683BR TTU Online Business Operations Position Description The Online Student Advocate will provide comprehensive, personalized support to online students,...Show more
We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi...Show more
Compensation: $45–$90 per completed task.The Consumer Insights Division of our organization is expanding its nationwide research team.We are seeking dependable individuals to support ongoing studie...Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet...Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet...Show more
Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more
Econometric Data Analyst (Stata SE).AI labs train foundational models and enterprises build AI agents.We provide frontier evaluations and reinforcement learning environments used to improve LLM cap...Show more
We are looking for extraordinary women who feel called to help bring a family to life.As a gestational carrier with My Donor Connection, you will walk alongside intended parents who have prayed, ho...Show more
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support...Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet...Show more
Applied Everywhere? Still No Interviews or Offers? Get Hired with a Process! Many job seekers assume the tech market has shut down, but the truth is companies are still hiring — they’re just being ...Show more
Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more
