Talent.com
Mercor
Design Evaluation Expert - GraphicMercor • New York, New York, United States
Design Evaluation Expert - Graphic

Design Evaluation Expert - Graphic

Mercor • New York, New York, United States
19 hours ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
  • Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
  • Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.
  • Collaborate asynchronously and work independently to meet deadlines and improve AI model performance.

Qualifications

Must-Have

  • 5+ years of professional experience in graphic, brand, or visual design.
  • Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
  • Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
  • Exceptionally strong written communication skills.
  • Detail-oriented and consistent, with comfort in having your judgment reviewed.

Preferred

  • Prior experience with AI training, evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume, portfolio, or relevant professional background to get started.
  • Qualified applicants may be asked to complete a brief assessment or submit additional information.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Design Evaluation Expert - Graphic • New York, New York, United States

Similar jobs

Remote | Senior Marketing Strategy & AI Evaluation Specialist $55$75/hour

24-MAG LLCNew York, NY, United States
Remote
Full-time

Specialised Full-Time Consulting Opportunity.We are sharing a specialised full-time consulting opportunity for US-based senior marketing professionals with deep experience in brand strategy, growth... Show more

 • Promoted

Lead Designer

MGE CompaniesNew York, NY, United States
Full-time

Lead Designer of Technology Solutions.The Lead Designer of Technology Solutions (IT Infrastructure, Integrated Security and Audiovisual technologies) is a trusted senior member and manager, working... Show more

 • Promoted

Principal UX Researcher & Design Strategist (Remote) Job at Maidservices in New

MaidservicesNew York City, NY, United States
Remote
Full-time +1

A leading home services company is seeking a Principal UX Researcher / Design Strategist to lead qualitative research initiatives.This contract role, remote and part-time or full-time, requires ext... Show more

 • Promoted

Remote Macroeconomic Modeling Specialist (EViews)

Micro1Mount Vernon, New York, US
$35.00 hourly
Remote
Full-time

Macroeconomic Modeling Specialist (EViews).AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance... Show more

 • Promoted

Senior Design Sourcer

BrexNew York, NY, United States
Full-time

Brex is the AI-powered spend platform.We help companies spend with confidence with integrated corporate cards, banking, and global payments, plus intuitive software for travel and expenses.Tens of ... Show more

 • Promoted

L&D Evaluator - Training Expert

MercorNew York, New York, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Training / onboarding / L&D Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, ... Show more

Design Build Leader - Environmental Consulting (Remote)

Woodard & CurranBronx, NY, United States
Remote
Full-time

Woodard & Curran is a national engineering, science, and operations firm with a simple vision for clean water, a safe environment, healthy communities, and happy people.As an employee-owned com... Show more

 • Promoted

Innovator: Youth Solutions Designer (Remote)

Mentor A PromiseNew York City, NY, United States
Remote
Full-time

A nonprofit organization is seeking Innovators - Youth Solutions Designers to collaboratively develop solutions for youth experiencing housing instability.This volunteer role involves creative prob... Show more

 • Promoted

Work Design Architect

UpsideNew York, NY, United States
Full-time

We created Upside to transform brick-and-mortar commerce.Our technology uses the sophistication of online retailprofit measurement, attribution, and incrementalityto provide users with more value o... Show more

 • Promoted

Design Studio Manager

Lutron ElectronicsNew York, NY, United States
Full-time

Lutron is seeking a dynamic Design Studio Manager to lead the Communications team in our New York City office location.As Design Studio Manager, you will provide operational leadership and team man... Show more

 • Promoted

Design Technology Assistant

KPFNew York, NY, United States
Full-time

Design Technology Assistant for Design Technology / Sustainability.KPF, a global architecture practice headquartered in New York City, is seeking a Design Technology Assistant for Design Technology... Show more

 • Promoted

Process Design Specialist

Macy'sNew York, NY, United States
Full-time

Macy's is more than just a store.One that's captured the hearts and minds of America for more than 160 years.A story about innovations and traditionsabout inspiring stores and irresistible products... Show more

 • Promoted

Remote | AI Evaluation Guidelines & Rubric Specialist — $40–$60/hour

24-MAGNew York, New York, United States
$40.00–$60.00 hourly
Remote
Full-time
Quick Apply

We are sharing a specialised full-time consulting opportunity for US-based linguists, instructional designers, and technical writers experienced in developing clear evaluation guidelines, structure... Show more

Design Coordinator (Health + Education&Science)

HDRNew York, NY, United States
Full-time

At HDR, our employee-owners are fully engaged in creating a welcoming environment where each of us is valued and respected, a place where everyone is empowered to bring their authentic selves and n... Show more

 • Promoted

Design Operations Manager

Something Special StudiosNew York, NY, United States
Full-time

The Design Operations Manager is responsible for the day-to-day operational management of our Spatial Design and Visual Design teams.The role is a key partner to the Spatial Design and Graphic Desi... Show more

 • Promoted

Design Director: Product Imagery & Brand Visualization - Remote

SkillNew York City, NY, United States
Remote
Full-time

A leading design consultancy is seeking a Design Director to enhance product presentation and brand fidelity.This full-time role focuses on managing brand design from concept to delivery, ensuring ... Show more

 • Promoted

Data Viz & Graphic Design Specialist -- Remote (Sports)

National Basketball Association (NBA)New York City, NY, United States
Remote
Full-time

A leading sports organization in New York is seeking a Project Employee for Data Visualization & Graphic Design.This role involves designing data-driven visuals that tell the WNBA's stories.Can... Show more

 • Promoted

Senior Designer - (virtual / remote) Job at Manière De Voir in New York

Manière De VoirNew York City, NY, United States
Remote
Full-time

Role :Technical Designer Location :New York City (Central)Role Summary :We are seeking an experienced Garment Technologist to join our team based in New York City, USA.The ideal candidate will poss... Show more

 • Promoted

Design Director (Digital Experience & AI)

Creative People Inc.New York, NY, United States
Full-time

Design Director (Digital Experience & AI).Location: NYC - hybrid, 3x a week.Company: global digital transformation agency and IT consulting firm partnering with companies to build custom digital pr... Show more

 • Promoted

Givebutter is hiring: Remote Creative Director - Brand & Design Leadership in Ne

GivebutterNew York City, NY, United States
Remote
Full-time

A nonprofit fundraising platform is seeking a Creative Director to lead visual language evolution and direct a growing design team.This hands-on leadership role requires 8years of experience and th... Show more