Talent.com
Mercor
Remote English (New Zealand) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)Mercor • Vallejo, California, US
No longer accepting applications
Remote English (New Zealand) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)

Remote English (New Zealand) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)

Mercor • Vallejo, California, US
30+ days ago
Salary
$50.00 hourly
Job type
  • Full-time
  • Remote
Job description
Mercor is seeking an English (New Zealand) Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in New Zealand English and enjoy translating complex audio and visual information into precise, well-structured text. ## Job Responsibilities ### Transcribe and Optimise Audio & Video - Listen to, analyse, and transcribe audio and video content in English (New Zealand), following detailed constraints and instructions. - Produce high-quality written outputs in English, with supporting work in English when required. - Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. - Capture nuances such as tone, intent, formal vs. informal register, regional expressions, Māori loanwords, and contemporary New Zealand English usage where relevant. ### Define and Document Evaluation Standards - Establish clear expectations for correct and high-quality responses in general consumer audio contexts. - Develop detailed evaluation rubrics and grading guidelines in English. - Document standards to ensure consistency across reviewers and model evaluations. - Identify linguistic nuances, grammatical patterns, colloquialisms, cultural references, and edge cases specific to New Zealand English. ### Conduct Model Testing and Grading - Run prompts through language models and assess generated outputs. - Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity. - Provide structured feedback to improve model performance in New Zealand English audio tasks. ### Support Benchmarking and Quality Assurance - Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar. - Maintain consistency and reliability before datasets are integrated into official benchmarks. - Collaborate with project leads to resolve ambiguities and improve task design. ## Minimum Qualifications - Strong writing, editing, and critical thinking skills. - Ability to work independently, manage time effectively, and meet deadlines. - Native or near-native fluency in English (New Zealand) (spoken and written). - Strong familiarity with New Zealand English, regional vocabulary, accents, Māori influences, and contemporary language usage. - Ability to accurately transcribe and analyse English audio content across general consumer contexts. - Available to commit 10–20 hours per week. ## Preferred Qualifications - College students or recent graduates. - Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines. - Prior experience with transcription, annotation, localisation, evaluation, or research workflows in English. - Familiarity with differences between New Zealand English, Australian English, and other major English varieties. - Interest in AI, language models, or applied research environments. ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes). - If selected, you will be onboarded and invited to begin project work.
Create a job alert for this search

Remote English (New Zealand) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour) • Vallejo, California, US

Similar jobs

Earn up to $400 per Day by Playing Games and TakingSurveys

Freecash.comNapa, California, United States
Full-time

Since its launch 6 years ago, over 60MN users have earned and withdrawn over $250MN! The platform is rated 4.TrustPilot with over 230k+ reviews, establishing Freecash as one of the highest-rated op... Show more

 • Promoted

Work from home - Market Research Study

Earn HausEl Verano, California, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

AI Developer Productivity Engineer

ZooxSan Mateo, CA, United States
Full-time

Zoox Engineer PositionZoox is developing state-of-the-art autonomous vehicle software for our purpose-built vehicle.We believe that developing the end-to-end product will get us to market faster an... Show more

 • Promoted

Senior Platform Engineer - US Remote

Qsic Pty LtdSan Francisco, CA, United States
Remote
Full-time

About QSIC QSIC is reinventing in-store audio.We use Audio, Intelligence (AI) and Creativity to redefine the value of in-store audio and drive growth for retailers and brands.Our story began in Aus... Show more

 • Promoted

User Research Expert - Evaluator

MercorSan Francisco, California, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.User/customer research and feedback synthesis Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factua... Show more

AI Video Intelligence Engineer - Remote

Spot AI, Inc.San Francisco, CA, United States
Remote
Full-time

A leading Video AI company in San Francisco seeks an AI Engineer to design and implement innovative features that transform video data into actionable insights.Candidates should possess strong expe... Show more

 • Promoted

Applied AI Engineer

SalientSan Francisco, CA, United States
Full-time

Applied Ai EngineerWe're hiring an Applied AI Engineer to design, build, and scale the systems that power our next-generation voice AI platform.You'll work across the stack - from LLM fine-tuning a... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersNapa, CA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Remote Lawyers - AI Trainer ($90-$150 per hour)

MercorOakland, CA, United States
Remote
Full-time

About the RoleMercor is seeking experienced Lawyers to support a leading AI lab in advancing research and infrastructure for next-generation machine learning systems.This engagement focuses on diag... Show more

 • Promoted

Media Evaluator - Communications Expert

MercorSan Francisco, California, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Media / journalism / communications Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthet... Show more

AI Data Evaluator & Writer -- Remote & Flexible

Quality Talent GroupBurlingame, CA, United States
Remote
Full-time

A leading AI technology firm is seeking individuals to join their team for a flexible, remote role involving the creation of natural data for AI models.Candidates with a Bachelor's degree or curren... Show more

 • Promoted

Senior HR Advisor - New Zealand / Remote Operations Remote (New Zealand)

RipplingSan Francisco, CA, United States
Remote
Full-time

Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and co... Show more

 • Promoted

Forward Deployed Engineer - AI & Product (US Remote)

IKR EnterprisesSan Francisco, CA, United States
Remote
Full-time

Job OverviewAs a Forward Deployed Engineer, you will play a key role in deploying AI systems for real-world customer environments.Customer Collaboration :Work directly with clients to understand wo... Show more

 • Promoted

iOS Engineer - AI Model Evaluator

MercorSan Francisco, California, United States
$85.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.OS Engineer (Coding Agent Experience).Review model-generated mobile application code for correctness, quality, maintainability, and performance... Show more

Remote Solutions Engineer -- AI Video Platforms

TwelveLabsSan Francisco, CA, United States
Remote
Full-time

A video AI technology company in San Francisco seeks a Solutions Engineer to lead technical discovery with prospects and demonstrate the business value of innovative video understanding APIs.This r... Show more

 • Promoted

Bilingual Language Model Evaluator

MercorSan Francisco, California, United States
$15.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Generalist - English & Urdu.Conduct fact-checking using trusted public sources and external.Generate high-quality human evaluation data by ... Show more

Need - Consumer Insights Researcher IV - Remote

Pride GlobalBurlingame, CA, United States
Remote
Full-time

Consumer Insights Researcher IV.Our client, a (Tech industry), is looking to hire a (Consumer Insights Researcher IV) in (Remote, Bay Area).Pay Rate Range:, depending on experience.Plan and execute... Show more

 • Promoted

Spanish Audio Evaluator - Expert

MercorSan Francisco, California, United States
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Spanish (Spain) Audio Generalist Evaluator Expert.Transcribe and optimize audio and video content in.Develop evaluation rubrics and grading gui... Show more

DevOps Engineer - AI Model Evaluator

MercorSan Francisco, California, United States
$85.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Show more

Senior Software Engineer - Retail Media - US Remote

QSICSan Francisco, CA, United States
Remote
Full-time

About QSICQSIC is reinventing in-store audio.We use Audio, Intelligence (AI) and Creativity to redefine the value of in-store audio and drive growth for retailers and brands.Our story began in Aust... Show more