Talent.com
Mercor
Remote English (Australia) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)Mercor • Oakland, California, US
No longer accepting applications
Remote English (Australia) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)

Remote English (Australia) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)

Mercor • Oakland, California, US
30+ days ago
Salary
$50.00 hourly
Job type
  • Full-time
  • Remote
Job description
Mercor is seeking an English (Australia) Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Australian English and enjoy translating complex audio and visual information into precise, well-structured text. ## Job Responsibilities ### Transcribe and Optimize Audio & Video - Listen to, analyze, and transcribe audio and video content in English (Australia), following detailed constraints and instructions. - Produce high-quality written outputs in English, with supporting work in English when required. - Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. - Capture nuances such as tone, intent, formal vs. informal register, regional expressions, slang, and contemporary Australian English usage where relevant. ### Define and Document Evaluation Standards - Establish clear expectations for correct and high-quality responses in general consumer audio contexts. - Develop detailed evaluation rubrics and grading guidelines in English. - Document standards to ensure consistency across reviewers and model evaluations. - Identify linguistic nuances, grammatical patterns, colloquialisms, cultural references, and edge cases specific to Australian English. ### Conduct Model Testing and Grading - Run prompts through language models and assess generated outputs. - Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity. - Provide structured feedback to improve model performance in Australian English audio tasks. ### Support Benchmarking and Quality Assurance - Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar. - Maintain consistency and reliability before datasets are integrated into official benchmarks. - Collaborate with project leads to resolve ambiguities and improve task design. ## Minimum Qualifications - Strong writing, editing, and critical thinking skills. - Ability to work independently, manage time effectively, and meet deadlines. - Native or near-native fluency in English (Australia) (spoken and written). - Strong familiarity with Australian English, regional vocabulary, accents, slang, and contemporary language usage. - Ability to accurately transcribe and analyze English audio content across general consumer contexts. - Available to commit 10–20 hours per week. ## Preferred Qualifications - College students or recent graduates. - Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines. - Prior experience with transcription, annotation, localization, evaluation, or research workflows in English. - Familiarity with differences between Australian English, New Zealand English, and other major English varieties. - Interest in AI, language models, or applied research environments. ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes). - If selected, you will be onboarded and invited to begin project work.
Create a job alert for this search

Remote English (Australia) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour) • Oakland, California, US

Similar jobs

Applied AI Technical Evangelist, Startup Ecosystem

AnthropicSan Francisco, CA, United States
Full-time

Applied AI Technical Evangelist, Startup Ecosystem.Anthropic's mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for soci... Show more

 • Promoted

Market Research Expert - Evaluator

MercorSan Francisco, California, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Market research / competitive intelligence Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, ... Show more

Tailored Management is hiring: Remote- Software Engineer - AI Multimedia Generat

Tailored ManagementMenlo Park, CA, United States
Remote
Full-time

Job Title :Software Engineer - AI Multimedia Generation Product EvaluatorLocation :RemoteDuration :4Months (Possibility of Extension)Pay Rate :$70-$74 / hr on W2About the Team :The Multimedia Gener... Show more

 • Promoted

AI Developer Productivity Engineer

ZooxSan Mateo, CA, United States
Full-time

Zoox Engineer PositionZoox is developing state-of-the-art autonomous vehicle software for our purpose-built vehicle.We believe that developing the end-to-end product will get us to market faster an... Show more

 • Promoted

User Research Expert - Evaluator

MercorSan Francisco, California, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.User/customer research and feedback synthesis Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factua... Show more

Remote Product Tester - Flexible Studies

BuzzTestersHalf Moon Bay, CA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Engagement Manager - AI Agents

Observe.AIRedwood City, CA, United States
Full-time

Engagement Manager - AI Agents.AI is the AI Agents platform for customer experience, designed to help organizations deliver faster, smarter, and more efficient customer service at scale.The platfor... Show more

 • Promoted

Senior Applied AI Engineer (Multimodal Perception & Reasoning)

Volt AiSan Francisco, CA, United States
Full-time

Senior Applied AI & Machine Learning EngineerVOLT is building the next generation of AI perception systems for the physical world, focused on safety, security, and real-time risk detection.We a... Show more

 • Promoted

Work from home - Market Research Study

Earn HausLoma Mar, California, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Senior/Staff Machine Learning Engineer

DexterityRedwood City, CA, United States
Full-time

Senior/Staff Machine Learning EngineerAt Dexterity, we believe robots can positively transform the world.Our breakthrough technology frees people to do the creative, inspiring, problem-solving jobs... Show more

 • Promoted

AI Data Evaluator & Writer -- Remote & Flexible

Quality Talent GroupBurlingame, CA, United States
Remote
Full-time

A leading AI technology firm is seeking individuals to join their team for a flexible, remote role involving the creation of natural data for AI models.Candidates with a Bachelor's degree or curren... Show more

 • Promoted

Media Evaluator - Communications Expert

MercorSan Francisco, California, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Media / journalism / communications Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthet... Show more

Forward Deployed Engineer - AI & Product (US Remote)

IKR EnterprisesSan Francisco, CA, United States
Remote
Full-time

Job OverviewAs a Forward Deployed Engineer, you will play a key role in deploying AI systems for real-world customer environments.Customer Collaboration :Work directly with clients to understand wo... Show more

 • Promoted

AI Trainer for German (Austria) Writers / Speakers (Freelance, Remote)

AlignerrSan Francisco, CA, United States
Remote
Full-time

Overview AI Trainer for German (Austria) Writers / Speakers (Freelance, Remote) at Alignerr.AI models by creating high-quality data in their field of expertise to build the future of Generative AI.... Show more

 • Promoted

DevOps Engineer - AI Model Evaluator - AI Trainer

MercorSan Francisco, California, United States
$85.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Show more

iOS Engineer - AI Model Evaluator

MercorSan Francisco, California, United States
$85.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.OS Engineer (Coding Agent Experience).Review model-generated mobile application code for correctness, quality, maintainability, and performance... Show more

Bilingual Language Model Evaluator

MercorSan Francisco, California, United States
$15.00–$20.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Generalist - English & Urdu.Conduct fact-checking using trusted public sources and external.Generate high-quality human evaluation data by ... Show more

Spanish Audio Evaluator - Expert

MercorSan Francisco, California, United States
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Spanish (Spain) Audio Generalist Evaluator Expert.Transcribe and optimize audio and video content in.Develop evaluation rubrics and grading gui... Show more

DevOps Engineer - AI Model Evaluator

MercorSan Francisco, California, United States
$85.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Show more

Remote AI Engineer & Machine Learning Researcher (Inference) - Speechify Inc. Speechify Inc #1 [...]

WorkinvirtualRedwood City, CA, United States
Remote
Full-time

About SpeechifySpeechify is one of the world's leadingAI-powered text-to-speech platforms , helping over50 million userstransform reading into listening.From PDFs, eBooks, Google Docs, and news art... Show more