Talent.com
Mercor
Remote English (Australia) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)Mercor • Gresham, Oregon, US
Remote English (Australia) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)

Remote English (Australia) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)

Mercor • Gresham, Oregon, US
26 days ago
Salary
$50.00 hourly
Job type
  • Full-time
  • Remote
Job description
Mercor is seeking an English (Australia) Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Australian English and enjoy translating complex audio and visual information into precise, well-structured text. ## Job Responsibilities ### Transcribe and Optimize Audio & Video - Listen to, analyze, and transcribe audio and video content in English (Australia), following detailed constraints and instructions. - Produce high-quality written outputs in English, with supporting work in English when required. - Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. - Capture nuances such as tone, intent, formal vs. informal register, regional expressions, slang, and contemporary Australian English usage where relevant. ### Define and Document Evaluation Standards - Establish clear expectations for correct and high-quality responses in general consumer audio contexts. - Develop detailed evaluation rubrics and grading guidelines in English. - Document standards to ensure consistency across reviewers and model evaluations. - Identify linguistic nuances, grammatical patterns, colloquialisms, cultural references, and edge cases specific to Australian English. ### Conduct Model Testing and Grading - Run prompts through language models and assess generated outputs. - Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity. - Provide structured feedback to improve model performance in Australian English audio tasks. ### Support Benchmarking and Quality Assurance - Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar. - Maintain consistency and reliability before datasets are integrated into official benchmarks. - Collaborate with project leads to resolve ambiguities and improve task design. ## Minimum Qualifications - Strong writing, editing, and critical thinking skills. - Ability to work independently, manage time effectively, and meet deadlines. - Native or near-native fluency in English (Australia) (spoken and written). - Strong familiarity with Australian English, regional vocabulary, accents, slang, and contemporary language usage. - Ability to accurately transcribe and analyze English audio content across general consumer contexts. - Available to commit 10–20 hours per week. ## Preferred Qualifications - College students or recent graduates. - Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines. - Prior experience with transcription, annotation, localization, evaluation, or research workflows in English. - Familiarity with differences between Australian English, New Zealand English, and other major English varieties. - Interest in AI, language models, or applied research environments. ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes). - If selected, you will be onboarded and invited to begin project work.
Create a job alert for this search

Remote English (Australia) Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour) • Gresham, Oregon, US

Similar jobs

Remote M&A Associate - AI Trainer ($50-$60 per hour)

Data AnnotationSandy, Oregon
$50.00 hourly
Remote
Full-time

DataAnnotation is committed to creating high-quality AI.Enjoy the flexibility of remote work and the freedom to set your own schedule.This is an opportunity to work with us as an independent contra... Show more

 • Promoted

Remote Online Survey Taker – Earn Up to $25 Per Survey

Earn HausCamas, WA, US
Remote
Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more

 • Promoted

Restaurant Delivery - Be Your Own Boss

DoorDashDamascus, OR, United States

DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a var... Show more

 • Promoted

English Private Tutoring Jobs Gresham

SuperprofGresham, Oregon, US
Full-time +1

Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup... Show more

 • Promoted

Physics Private Tutoring Jobs Gresham

SuperprofGresham, Oregon, US
Full-time +1

Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup... Show more

 • Promoted

Become a Surrogate, give the miracle of life, and earn up to $115,000 from home!

Giving Tree SurrogacyAmboy, WA, US
Full-time +1

We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi... Show more

 • Promoted

Angiography Technologist - Mount Hood

Legacy HealthGresham, Oregon, US
Full-time

Every member of the Legacy community shares a common goal: providing the best possible care in the most compassionate environment.In this position, you will perform fluoroscopy and image acquisitio... Show more

 • Promoted

Remote Benefits Advisor (50k-90k per year)

Professional CareersDamascus, Oregon
$50,000.00 yearly
Remote
Full-time +1

We're looking for candidates with great customer service skills to fill our Remote Customer Service role!.This role is entirely remote and offers full-time/Part time hours with flexibility.We are r... Show more

Online Survey Taker. Earn up to $25 per survey. - Remote

Earn HausCamas, WA, US
Remote
Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more

 • Promoted

Help Create a Family — Become a Surrogate with Roots

Roots SurrogacyEagle Creek, OR, US
Full-time

There are families out there who would give anything to hold their baby — and you could be the reason they do.At Roots Surrogacy, we work with incredible women who feel called to do something meani... Show more

 • Promoted

Remote Investment Analyst - AI Trainer ($50-$60 per hour)

Data AnnotationDamascus, Oregon
$50.00 hourly
Remote
Full-time

DataAnnotation is committed to creating high-quality AI.Enjoy the flexibility of remote work and the freedom to set your own schedule.This is an opportunity to work with us as an independent contra... Show more

 • Promoted

Remote Product Tester - $25-45 per hour

Online Consumer Panels AmericaGresham, Oregon, US
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Crypto Quantitative Analyst (Hanoi-Remote)

Token MetricsBoring, OR, United States
Remote
Full-time

Token Metrics provides AI-based cryptocurrency ratings and price predictions.Our customers leverage our professional analysts, analytics, and artificial intelligence to make profitable crypto inves... Show more

 • Promoted

Remote Product Tester – $45/hr + Free Products – Start Now!

OCPACougar, Washington, us
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Make Miracles Happen: Become a Surrogate & Earn Up to $115,000 from Home!

Giving Tree SurrogacyYacolt, WA, US
Full-time +1

We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi... Show more

 • Promoted

Biology Private Tutoring Jobs Gresham

SuperprofGresham, Oregon, US
Full-time +1

Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup... Show more

 • Promoted

Technical Recruiter (Remote)

RM Staffing B.V.Gresham, TX, US
Remote
Full-time

Reboot Monkey is a global datacenter services provider headquartered in Haarlem, Netherlands, operating.We deliver colocation, IP transit, smart hands, remote hands, and managed datacenter services... Show more

Drive with DoorDash - Choose your own hours

DoorDashDamascus, OR, United States

DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a var... Show more

 • Promoted

Remote Corporate Development Associate - AI Trainer ($50-$60 per hour)

Data AnnotationSandy, Oregon
$50.00 hourly
Remote
Full-time

DataAnnotation is committed to creating high-quality AI.Enjoy the flexibility of remote work and the freedom to set your own schedule.This is an opportunity to work with us as an independent contra... Show more

 • Promoted

A Calling Like No Other

U.S. Marine CorpsAmboy, WA, US
Full-time

Those who put others before themselves.Who can rise up in the face of danger.This country we call home has been our haven of safety for 250 years.And it's up to us to keep it that way.There's a goo... Show more