Talent.com
Trust & Safety Content Annotation Analyst
Trust & Safety Content Annotation AnalystDiscord • San Francisco, CA, United States
Trust & Safety Content Annotation Analyst

Trust & Safety Content Annotation Analyst

Discord • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : play video games. Over 90% of our users play games, spending a combined 1.5 billion hours playing thousands of unique titles on Discord each month. Discord plays a uniquely important role in the future of gaming. We are focused on making it easier and more fun for people to talk and hang out before, during, and after playing games.

Discord seeks a Trust & Safety Content Annotation Analyst to strengthen our content moderation systems to more accurately and effectively enforce our Community Guidelines at scale. Reporting to our Core Initiatives team, you'll annotate user-reported content to train machine learning models that detect harmful behavior. This role requires flexibility across diverse policy domains, so the ideal candidate balances analytical precision with good judgment and a calm demeanor, even when handling sensitive or potentially distressing content. You'll apply operational rigor to audit ML outputs, investigate the root causes of policy interpretation errors, and communicate your findings to stakeholders across Trust & Safety. Through this work, you'll expand knowledge of policy areas and safety processes while aiding responsible, large-scale user protection.

This position is temporary.

What you’ll be doing

  • Annotate user‑reported content with precision and consistency to build high‑quality training datasets that capture the nuance ML models need to make accurate decisions.
  • Quickly align with internal interpretations to apply policy judgments across multiple harm categories, including social engineering, threats, graphic content, teen safety, and harassment.
  • Work with policy teams to navigate edge cases and ambiguous content, ensuring your annotations reflect current Community Guidelines and platform context.
  • Audit ML model decisions to spot misclassification patterns, then investigate why automated and human judgments diverge.
  • Partner with ML engineers and policy stakeholders to share insights on model performance, propose new annotation frameworks, and flag content categories requiring stronger detection.

What you should have

  • 2+ years of experience in trust & safety or policy work in a social online platform environment.
  • A track record of strong judgment and adaptability across a broad range of trust & safety harm types which we enforce via our Community Guidelines.
  • Ability to focus within structured policy taxonomies and annotation frameworks while maintaining consistency : you’ll be reviewing a lot of content, and experience with deep focus to quickly get through a backlog will be crucial.
  • A calm, resilient demeanor when handling sensitive or potentially distressing content.
  • A strong curiosity around online culture and communication, and the nuances surrounding online speech.
  • Strong communication skills to effectively document annotation rationales and convey findings and recommendations to a wide range of stakeholders, such as policy, quality assurance, and machine learning engineers.
  • The ability to go between specific annotation decisions and broad operational trends, evidenced by previous exposure to quality assurance, root cause analysis, process improvement, or operational excellence initiatives.
  • Bonus points

  • Hands‑on experience with data annotation or dataset creation for machine learning applications.
  • Familiarity with prompt engineering and ongoing iteration on LLMs.
  • Familiarity with Discord or similar community‑based platforms as a user or moderator.
  • Experience working on globally distributed, hybrid work teams.
  • Candidates must reside in or be willing to relocate to the San Francisco Bay Area (Alameda, Contra Costa, Marin, Napa, San Francisco, San Mateo, Santa Clara, Solano, and Sonoma counties).

    The US hourly rate range for this full‑time position is $51.92 to $58.40 + benefits. Our salary ranges are determined by role and level. Within the range, individual pay is determined by additional factors, including job‑related skills, experience, and relevant education or training. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include benefits.

    Why Discord?

    Discord plays a uniquely important role in the future of gaming. We’re a multiplatform, multigenerational and multiplayer platform that helps people deepen their friendships around games and shared interests. We believe games give us a way to have fun with our favorite people, whether listening to music together or grinding in competitive matches for diamond rank. Join us in our mission! Your future is just a click away!

    Discord is committed to inclusion and providing reasonable accommodations during the interview process. We want you to feel set up for success, so if you are in need of reasonable accommodations, please let your recruiter know.

    Please see our Applicant and Candidate Privacy Policy for details regarding Discord’s collection and usage of personal information relating to the application and recruitment process by clicking HERE.

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Analyst Safety • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    Contract Research Associate (In Vivo)

    Contract Research Associate (In Vivo)

    5AM Ventures • Berkeley, CA, US
    [job_card.full_time]
    We are looking for dedicated professionals who thrive on tackling complex challenges and are committed to improving the lives of patients. If you value innovation, collaboration, and integrity, and ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Board Certified Behavior Analyst (BCBA)

    Board Certified Behavior Analyst (BCBA)

    BURNETT THERAPEUTIC SERVICES INC • Vallejo, CA, US
    [job_card.full_time] +1
    Sign-on Bonus and Monthly Bonuses Available!.Job Type : Part-time, full-time.Vallejo, Fairfield, Vacaville, Dixon, Suisun City, Benicia. Work Setting : Hybrid (includes in-home hours and some remote)....[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    BCBA (Board Certified Behavior Analyst)

    BCBA (Board Certified Behavior Analyst)

    ABA SHINE • El Cerrito, CA, US
    [job_card.full_time] +1
    Board Certified Behavior Analyst (BCBA) -.ABA SHINE is seeking a passionate and experienced Board-Certified Behavior Analyst (BCBA) to join our team, specializing in early intervention services for...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Compliance Test EngineerCompliance & Certification • Berkeley, CA • Full time

    Compliance Test EngineerCompliance & Certification • Berkeley, CA • Full time

    Form Energy • Berkeley, CA, United States
    [job_card.full_time]
    Are you ready to build America's energy future? Form Energy is an American manufacturing and energy technology company.We're revolutionizing energy storage with cost-effective, multi-day technology...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Board Certified Behavior Analyst

    Board Certified Behavior Analyst

    Steps Therapy Inc • San Francisco, CA, US
    [job_card.full_time] +1
    Steps Therapy specializes in providing comprehensive programs to enhance a child’s independence.By combining highly-trained behavior therapists, transparent data collection, and developmental...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Epic Clarity Data Analyst

    Epic Clarity Data Analyst

    Habitat Health • San Francisco, CA, US
    [job_card.full_time]
    At Habitat Health, we envision a world where older adults experience an independent and joyful aging journey in the comfort of their homes, enabled by access to comprehensive health care.Habitat He...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Board Certified Behavior Analyst (BCBA)

    Board Certified Behavior Analyst (BCBA)

    Kyo • Redwood City, CA, US
    [job_card.full_time]
    Kyo is a leading provider of child-centric Applied Behavior Analysis (ABA), serving thousands of children and teens across 11 states. Every day, we seek to achieve the unachievable for our clients.K...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Digital Forensic Analyst

    Digital Forensic Analyst

    Contact Discovery Services LLC • San Francisco, CA, US
    [job_card.full_time]
    Contact Discovery Services - Washington, DC.A leading eDiscovery technology and consulting firm headquartered in Washington, DC is looking for a qualified and experienced Digital Forensic Analyst.W...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Content and News Curation Specialist

    Content and News Curation Specialist

    Public Health Institute • Berkeley, CA, United States
    [job_card.part_time]
    If you are a current and active PHI employee, do not use this site to apply for positions.Berkeley, CA;Work From Home - USA.[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Analyst

    Data Analyst

    SteerBridge • Miramar, CA, US
    [job_card.full_time]
    SteerBridge Strategies is a CVE-Verified Service-Disabled, Veteran-Owned Small Business (SDVOSB) delivering a broad spectrum of professional services to the U. Backed by decades of hands-on experien...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Compliance Analyst

    Senior Compliance Analyst

    Applied Underwriters • Foster City, CA, US
    [job_card.full_time]
    Embark on a rewarding career journey at Applied Underwriters, where employees have been at the heart of our success story for more than 30 years. Headquartered in Omaha, NE, our company thrives on i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Analyst, Technology, Media, and Telecommunications Practice

    Analyst, Technology, Media, and Telecommunications Practice

    Spencer Stuart • San Francisco, CA, United States
    [job_card.full_time] +2
    Spencer Stuart is an equal opportunity and affirmative action employer F / M / Disability / Vet / Sexual Orientation / Gender Identity. Spencer Stuart seeks to recruit an.Analysts play a critical and visible ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Workforce Management Data Analyst

    Senior Workforce Management Data Analyst

    Omada Health • South San Francisco, CA, United States
    [job_card.full_time]
    Omada Health is on a mission to inspire and engage people in lifelong health, one step at a time.Care Delivery's Capacity & Analytics team is responsible for care team capacity modeling, care team ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Analyst (Foster City or Oakland)

    Data Analyst (Foster City or Oakland)

    MidPen Housing • Foster City, CA, US
    [job_card.full_time]
    At MidPen, we build communities that change lives.Since 1970, we have been committed to our mission : to provide safe, affordable housing of high quality to those in need. establish stability and op...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Data Scientist / Analyst

    Senior Data Scientist / Analyst

    NimbleRx • Redwood City, CA, US
    [job_card.full_time]
    We are starting by building the largest, most loved pharmacy business in the world.We are a fast-growing, technology-first startup driven by perfecting the patient and pharmacist experience.Nimble ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Engineer, AI Evaluation & Reliability (Agentic AI)

    Senior Engineer, AI Evaluation & Reliability (Agentic AI)

    Anomali • Redwood City, CA, US
    [job_card.full_time]
    Anomali is headquartered in Silicon Valley and is the Leading AI-Powered Security Operations Platform that is modernizing security operations. At the center of it is an omnipresent, intelligent, and...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Clinical Evidence Director

    Clinical Evidence Director

    MyOme • Menlo Park, CA, US
    [job_card.full_time]
    MyOme's mission is to provide clinically actionable genetic information to patients throughout their lives.We combine clinical-grade whole genome sequencing, advanced AI methods for genome inte...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Hybrid-Remote Board Certified Behavior Analyst (BCBA)

    Hybrid-Remote Board Certified Behavior Analyst (BCBA)

    Sunrise ABA • Richmond, CA, US
    [filters.remote]
    [job_card.full_time] +1
    Shine with us at Sunrise ABA! At Sunrise, our commitment to ethical treatment is the heartbeat of our mission.Sunrise ABA opened it's doors 2021 with sights to provide ethical care while embrac...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]