Talent.com
Mercor
Design Evaluation Expert - GraphicMercor • New York, New York, United States
Design Evaluation Expert - Graphic

Design Evaluation Expert - Graphic

Mercor • New York, New York, United States
16 hours ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
  • Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
  • Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.
  • Collaborate asynchronously and work independently to meet deadlines and improve AI model performance.

Qualifications

Must-Have

  • 5+ years of professional experience in graphic, brand, or visual design.
  • Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
  • Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
  • Exceptionally strong written communication skills.
  • Detail-oriented and consistent, with comfort in having your judgment reviewed.

Preferred

  • Prior experience with AI training, evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume, portfolio, or relevant professional background to get started.
  • Qualified applicants may be asked to complete a brief assessment or submit additional information.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Design Evaluation Expert - Graphic • New York, New York, United States

Similar jobs

Remote | Senior Marketing Strategy & AI Evaluation Specialist $55$75/hour

24-MAG LLCNew York, NY, United States
Remote
Full-time

Specialised Full-Time Consulting Opportunity.We are sharing a specialised full-time consulting opportunity for US-based senior marketing professionals with deep experience in brand strategy, growth... Show more

 • Promoted

Principal UX Researcher & Design Strategist (Remote) Job at Maidservices in New

MaidservicesNew York City, NY, United States
Remote
Full-time +1

A leading home services company is seeking a Principal UX Researcher / Design Strategist to lead qualitative research initiatives.This contract role, remote and part-time or full-time, requires ext... Show more

 • Promoted

Assistant Design Manager

DragadosRockaway Park, NY, United States
Full-time

Reviews and evaluates design drawings for alternative build pursuits or active projects to ensure feasible constructability, cost efficiency and design optimization.Engages Technical Services, cons... Show more

 • Promoted

L&D Evaluator - Training Expert

MercorNew York, New York, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Training / onboarding / L&D Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, ... Show more

Design Build Leader - Environmental Consulting (Remote)

Woodard & CurranBronx, NY, United States
Remote
Full-time

Woodard & Curran is a national engineering, science, and operations firm with a simple vision for clean water, a safe environment, healthy communities, and happy people.As an employee-owned com... Show more

 • Promoted

Innovator: Youth Solutions Designer (Remote)

Mentor A PromiseNew York City, NY, United States
Remote
Full-time

A nonprofit organization is seeking Innovators - Youth Solutions Designers to collaboratively develop solutions for youth experiencing housing instability.This volunteer role involves creative prob... Show more

 • Promoted

Remote Macroeconomic Modeling Specialist (EViews)

Micro1Garfield, New Jersey, US
$35.00 hourly
Remote
Full-time

Macroeconomic Modeling Specialist (EViews).AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance... Show more

 • Promoted

Work Design Architect

UpsideNew York, NY, United States
Full-time

We created Upside to transform brick-and-mortar commerce.Our technology uses the sophistication of online retailprofit measurement, attribution, and incrementalityto provide users with more value o... Show more

 • Promoted

Design Studio Manager

Lutron ElectronicsNew York, NY, United States
Full-time

Lutron is seeking a dynamic Design Studio Manager to lead the Communications team in our New York City office location.As Design Studio Manager, you will provide operational leadership and team man... Show more

 • Promoted

Design Technology Assistant

KPFNew York, NY, United States
Full-time

Design Technology Assistant for Design Technology / Sustainability.KPF, a global architecture practice headquartered in New York City, is seeking a Design Technology Assistant for Design Technology... Show more

 • Promoted

Process Design Specialist

Macy'sNew York, NY, United States
Full-time

Macy's is more than just a store.One that's captured the hearts and minds of America for more than 160 years.A story about innovations and traditionsabout inspiring stores and irresistible products... Show more

 • Promoted

Remote | AI Evaluation Guidelines & Rubric Specialist — $40–$60/hour

24-MAGNew York, New York, United States
$40.00–$60.00 hourly
Remote
Full-time
Quick Apply

We are sharing a specialised full-time consulting opportunity for US-based linguists, instructional designers, and technical writers experienced in developing clear evaluation guidelines, structure... Show more

Creative Lead (Graphic Design) - Remote Job at Swish Breaks in New York

Swish BreaksNew York City, NY, United States
Remote
Full-time

Graphic Designer &##Job Type :Full Time Swish Breaks is the premier destination for live sports card breaks, collectibles, and culture.Our high-energy shows, curated products, and passionate co... Show more

 • Promoted

Design Operations Manager

Something Special StudiosNew York, NY, United States
Full-time

The Design Operations Manager is responsible for the day-to-day operational management of our Spatial Design and Visual Design teams.The role is a key partner to the Spatial Design and Graphic Desi... Show more

 • Promoted

Design Director: Product Imagery & Brand Visualization - Remote

SkillNew York City, NY, United States
Remote
Full-time

A leading design consultancy is seeking a Design Director to enhance product presentation and brand fidelity.This full-time role focuses on managing brand design from concept to delivery, ensuring ... Show more

 • Promoted

Data Viz & Graphic Design Specialist -- Remote (Sports)

National Basketball Association (NBA)New York City, NY, United States
Remote
Full-time

A leading sports organization in New York is seeking a Project Employee for Data Visualization & Graphic Design.This role involves designing data-driven visuals that tell the WNBA's stories.Can... Show more

 • Promoted

Senior Designer - (virtual / remote) Job at Manière De Voir in New York

Manière De VoirNew York City, NY, United States
Remote
Full-time

Role :Technical Designer Location :New York City (Central)Role Summary :We are seeking an experienced Garment Technologist to join our team based in New York City, USA.The ideal candidate will poss... Show more

 • Promoted

Givebutter is hiring: Remote Creative Director - Brand & Design Leadership in Ne

GivebutterNew York City, NY, United States
Remote
Full-time

A nonprofit fundraising platform is seeking a Creative Director to lead visual language evolution and direct a growing design team.This hands-on leadership role requires 8years of experience and th... Show more

 • Promoted

UX Design Lead - Remote Contract to Hire

Coa Solutions LLCNew York City, NY, United States
Remote
Temporary

Coa Solutions is committed to transforming government services for the betterment of the customers and taxpayers we serve.We sit at the intersection of delivering human centered, and accessible and... Show more

 • Promoted

Senior Design Recruiter

BrexNew York, NY, United States
Full-time

Recruiting is where every career at Brex begins.We're the first point of connection for future builders and leaders, helping candidates see what's possible.We partner with leaders across the compan... Show more