Talent.com
Trust & Safety Content Annotation Analyst
Trust & Safety Content Annotation AnalystDiscord • San Francisco, CA, United States
[error_messages.no_longer_accepting]
Trust & Safety Content Annotation Analyst

Trust & Safety Content Annotation Analyst

Discord • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : play video games. Over 90% of our users play games, spending a combined 1.5 billion hours playing thousands of unique titles on Discord each month. Discord plays a uniquely important role in the future of gaming. We are focused on making it easier and more fun for people to talk and hang out before, during, and after playing games.

Discord seeks a Trust & Safety Content Annotation Analyst to strengthen our content moderation systems to more accurately and effectively enforce our Community Guidelines at scale. Reporting to our Core Initiatives team, you'll annotate user-reported content to train machine learning models that detect harmful behavior. This role requires flexibility across diverse policy domains, so the ideal candidate balances analytical precision with good judgment and a calm demeanor, even when handling sensitive or potentially distressing content. You'll apply operational rigor to audit ML outputs, investigate the root causes of policy interpretation errors, and communicate your findings to stakeholders across Trust & Safety. Through this work, you'll expand knowledge of policy areas and safety processes while aiding responsible, large-scale user protection.

This position is temporary.

What you’ll be doing

  • Annotate user‑reported content with precision and consistency to build high‑quality training datasets that capture the nuance ML models need to make accurate decisions.
  • Quickly align with internal interpretations to apply policy judgments across multiple harm categories, including social engineering, threats, graphic content, teen safety, and harassment.
  • Work with policy teams to navigate edge cases and ambiguous content, ensuring your annotations reflect current Community Guidelines and platform context.
  • Audit ML model decisions to spot misclassification patterns, then investigate why automated and human judgments diverge.
  • Partner with ML engineers and policy stakeholders to share insights on model performance, propose new annotation frameworks, and flag content categories requiring stronger detection.

What you should have

  • 2+ years of experience in trust & safety or policy work in a social online platform environment.
  • A track record of strong judgment and adaptability across a broad range of trust & safety harm types which we enforce via our Community Guidelines.
  • Ability to focus within structured policy taxonomies and annotation frameworks while maintaining consistency : you’ll be reviewing a lot of content, and experience with deep focus to quickly get through a backlog will be crucial.
  • A calm, resilient demeanor when handling sensitive or potentially distressing content.
  • A strong curiosity around online culture and communication, and the nuances surrounding online speech.
  • Strong communication skills to effectively document annotation rationales and convey findings and recommendations to a wide range of stakeholders, such as policy, quality assurance, and machine learning engineers.
  • The ability to go between specific annotation decisions and broad operational trends, evidenced by previous exposure to quality assurance, root cause analysis, process improvement, or operational excellence initiatives.
  • Bonus points

  • Hands‑on experience with data annotation or dataset creation for machine learning applications.
  • Familiarity with prompt engineering and ongoing iteration on LLMs.
  • Familiarity with Discord or similar community‑based platforms as a user or moderator.
  • Experience working on globally distributed, hybrid work teams.
  • Candidates must reside in or be willing to relocate to the San Francisco Bay Area (Alameda, Contra Costa, Marin, Napa, San Francisco, San Mateo, Santa Clara, Solano, and Sonoma counties).

    The US hourly rate range for this full‑time position is $51.92 to $58.40 + benefits. Our salary ranges are determined by role and level. Within the range, individual pay is determined by additional factors, including job‑related skills, experience, and relevant education or training. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include benefits.

    Why Discord?

    Discord plays a uniquely important role in the future of gaming. We’re a multiplatform, multigenerational and multiplayer platform that helps people deepen their friendships around games and shared interests. We believe games give us a way to have fun with our favorite people, whether listening to music together or grinding in competitive matches for diamond rank. Join us in our mission! Your future is just a click away!

    Discord is committed to inclusion and providing reasonable accommodations during the interview process. We want you to feel set up for success, so if you are in need of reasonable accommodations, please let your recruiter know.

    Please see our Applicant and Candidate Privacy Policy for details regarding Discord’s collection and usage of personal information relating to the application and recruitment process by clicking HERE.

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Analyst Safety • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    Trust and Safety, Fraud and Abuse Analyst

    Trust and Safety, Fraud and Abuse Analyst

    Monograph • San Francisco, CA, United States
    [job_card.full_time]
    Notion helps you build beautiful tools for your life’s work.In today's world of endless apps and tabs, Notion provides one place for teams to get everything done, seamlessly connecting docs, notes,...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Trust and Safety, Fraud and Abuse Analyst

    Trust and Safety, Fraud and Abuse Analyst

    Notion • San Francisco, CA, United States
    [job_card.full_time]
    Trust and Safety, Fraud and Abuse Analyst.Join to apply for the Trust and Safety, Fraud and Abuse Analyst role at Notion. Notion helps you build beautiful tools for your life’s work.In today's world...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Data Annotation • Richmond, California
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Protection and Privacy Analyst

    Data Protection and Privacy Analyst

    Ernst & Young Oman • San Francisco, CA, United States
    [job_card.full_time]
    At EY, we’re all in to shape your future with confidence.We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Interoperability Analyst

    Interoperability Analyst

    VirtualVocations • Oakland, California, United States
    [job_card.full_time]
    A company is looking for an Interoperability Analyst.Key Responsibilities Support the design, implementation, and enhancement of a statewide interoperability platform for behavioral health Colla...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Compliance Test EngineerCompliance & Certification • Berkeley, CA • Full time

    Compliance Test EngineerCompliance & Certification • Berkeley, CA • Full time

    Form Energy • Berkeley, CA, United States
    [job_card.full_time]
    Are you ready to build America's energy future? Form Energy is an American manufacturing and energy technology company.We're revolutionizing energy storage with cost-effective, multi-day technology...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Shape ML Safety at Scale : Content Annotator

    Shape ML Safety at Scale : Content Annotator

    Discord • San Francisco, CA, United States
    [job_card.temporary]
    A leading communication platform in San Francisco is seeking a Trust & Safety Content Annotation Analyst to help strengthen content moderation systems. This role involves annotating user-reported co...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Risk Analyst

    Senior Risk Analyst

    Monzo Bank • San Francisco, CA, United States
    [job_card.full_time]
    We're on a mission to make money work for everyone.We're waving goodbye to the complicated and confusing ways of traditional banking. After starting as a prepaid card, our product offering has grown...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Associate Director, Medical Writing

    Associate Director, Medical Writing

    Jazz Pharmaceuticals • Atherton, California, USA
    [job_card.full_time]
    If you are a current Jazz employee please apply via the Internal Career site.Jazz Pharmaceuticals is a global biopharma company whose purpose is to innovate to transform the lives of patients and ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Data Analyst 3 Oakland, CA, Job ID 81754

    Research Data Analyst 3 Oakland, CA, Job ID 81754

    UofC • Oakland, CA, United States
    [job_card.full_time]
    Research Data Analyst 3 Oakland, CA, Job ID 81754.University of California Agriculture and Natural Resources.Gathers, analyzes, and interprets a wide variety of programmatic data.Designs and condu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Analyst, Technology, Media, and Telecommunications Practice

    Analyst, Technology, Media, and Telecommunications Practice

    Spencer Stuart • San Francisco, CA, United States
    [job_card.full_time] +2
    Spencer Stuart is an equal opportunity and affirmative action employer F / M / Disability / Vet / Sexual Orientation / Gender Identity. Spencer Stuart seeks to recruit an.Analysts play a critical and visible ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Investor Relations Analyst

    Investor Relations Analyst

    Pinterest • San Francisco, CA, United States
    [job_card.full_time]
    Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to br...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Workforce Management Data Analyst

    Senior Workforce Management Data Analyst

    Omada Health • South San Francisco, CA, United States
    [job_card.full_time]
    Omada Health is on a mission to inspire and engage people in lifelong health, one step at a time.Care Delivery's Capacity & Analytics team is responsible for care team capacity modeling, care team ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Analyst, Trust & Safety

    Data Analyst, Trust & Safety

    Chime • San Francisco, CA, United States
    [job_card.full_time]
    As a Trust & Safety Product Analyst, you will develop, test, launch, and scale member banking experience products that build security awareness and adoption. You’ll help keep our members and Chime s...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Bilingual Research Analyst — Health & Housing Data

    Bilingual Research Analyst — Health & Housing Data

    University of California, San Francisco • San Francisco, CA, United States
    [job_card.full_time]
    A university in California is seeking a Research Analyst for a study on police enforcement encounters among older adults. The role involves conducting interviews and managing data in both Spanish an...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Safety & Threat Intelligence Analyst

    AI Safety & Threat Intelligence Analyst

    OpenAI • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI research organization in San Francisco is seeking an AI Abuse and Threat Intelligence Analyst.The role involves identifying and analyzing risks associated with AI technologies, using a...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Data Analyst, Trust & Safety

    Data Analyst, Trust & Safety

    Chym • San Francisco, California, United States
    [job_card.full_time]
    As a Trust & Safety Product Analyst, you will have the opportunity to develop, test, launch and scale member banking experience products that build security awareness and adoption, keeping our memb...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Compensation Analyst

    Compensation Analyst

    Patreon, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Patreon is a media and community platform where over 300,000 creators give their biggest fans access to exclusive work and experiences. We offer creators a variety of ways to engage with their commu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]