Talent.com
Evaluator/Reviewer - Statistical Assistants
Evaluator/Reviewer - Statistical AssistantsSepal • Berkeley, CA, United States
[error_messages.no_longer_accepting]
Evaluator / Reviewer - Statistical Assistants

Evaluator / Reviewer - Statistical Assistants

Sepal • Berkeley, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [job_card.part_time]
[job_card.job_description]

Role Overview

The Occupation-Specific Reviewer evaluates task submissions that require domain expertise in a specific profession or field (e.g., healthcare, law, education, engineering, finance, software development). This role ensures that content is not only guideline-compliant, but also professionally accurate, realistic, and aligned with real-world standards of practice.

Occupation-Specific Reviewers are trusted subject matter experts who apply both formal evaluation criteria and professional judgment, while maintaining strict adherence to safety, compliance, and scope boundaries.

Key Responsibilities

  • Review submissions requiring professional or technical domain knowledge
  • Validate factual accuracy, terminology, and real-world applicability within the domain
  • Ensure outputs remain within allowed scope and do not provide unsafe, misleading, or non-compliant guidance
  • Evaluate alignment with professional standards, norms, and best practices
  • Apply platform guidelines consistently, even when they conflict with personal preference or real-world shortcuts
  • Provide precise, educational, and corrective feedback grounded in both guidelines and domain expertise
  • Identify high-risk errors related to safety, ethics, or misuse
  • Escalate ambiguous or high-impact issues appropriately
  • Maintain clear documentation of review decisions and reasoning

Required Qualifications

  • Advanced degree, professional certification, or equivalent experience in the relevant occupation or field
  • 5+ years of professional experience practicing in that domain
  • Demonstrated experience with :
  • Evaluation, review, auditing, or supervisory responsibilities OR

    Teaching, mentoring, training, or assessing professional work

  • Strong understanding of professional boundaries, risk, and compliance considerations
  • Excellent written communication skills suitable for formal feedback
  • Preferred Qualifications

  • Prior experience reviewing AI-generated or training data content
  • Familiarity with compliance, regulatory, or ethical standards in the field
  • Experience translating expert knowledge into clear, structured explanations
  • Comfort working with evolving guidelines and iterative feedback cycles
  • Key Competencies

  • Subject matter expertise
  • Risk awareness and safety judgment
  • Guideline fidelity
  • Clear, corrective feedback
  • Professional integrity
  • Expectations

  • Strict adherence to confidentiality and data protection requirements
  • Consistent application of guidelines across all reviews
  • Willingness to update evaluation approach as standards evolve
  • Professional, unbiased, and respectful communication at all times
  • Compensation & Logistics

  • $50 to $75 per hour, depending on expertise and relevance, with bonuses for key contributions
  • Begins with a paid trial period
  • Paid every two weeks based on approved and tracked hours
  • Fully remote and async friendly, work at your own pace within flexible deadlines
  • Employment type : Contract, flexible hours (part-time and full-time options).
  • Location : United States or Canada
  • [job_alerts.create_a_job]

    EvaluatorReviewer Statistical Assistants • Berkeley, CA, United States

    [internal_linking.similar_jobs]
    Applied Outcomes Researcher

    Applied Outcomes Researcher

    VirtualVocations • San Francisco, California, United States
    [job_card.full_time]
    A company is looking for an Applied Outcomes Researcher to support evidence-based autism care through rigorous research and product development. Key Responsibilities Support applied research using...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Associate, Research

    Associate, Research

    IEQ Capital • San Mateo, CA, US
    [job_card.full_time]
    IEQ Capital is a Registered Investment Advisor seeking to transform traditional wealth management.Our quest is to integrate the Intellectual and Emotional Quotient, generating exceptional investmen...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Associate Statistical Programming Director

    Associate Statistical Programming Director

    Exelixis • Alameda, CA, United States
    [job_card.full_time]
    Leads statistical programming activities at the study or project level.Uses statistical software (mainly SAS) to create and maintain macros, listings, tabulations, graphical summaries, and formal s...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Statistical Evaluation & Sampling Engineer

    Statistical Evaluation & Sampling Engineer

    Waymo • San Francisco, CA, United States
    [job_card.full_time]
    A leading autonomous driving technology company is looking for an engineer to develop importance sampling techniques for their evaluation pipelines. The role requires skills in probability, statisti...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Research Engineer, LLM Evaluation and Behavioral Analysis

    Senior Research Engineer, LLM Evaluation and Behavioral Analysis

    Together AI • San Francisco, CA, United States
    [job_card.full_time]
    Senior Research Engineer, LLM Evaluation and Behavioral Analysis.Together AI is building the fastest, most capable open‑source‑aligned LLMs and inference stack in the world.As part of the Turbo org...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Engineer, Model Evaluations

    Research Engineer, Model Evaluations

    Anthropic • San Francisco, CA, United States
    [job_card.full_time]
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Engineer : AI Systems & LLM Evaluation + Equity

    Research Engineer : AI Systems & LLM Evaluation + Equity

    Mercor, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A cutting-edge technology company in San Francisco is seeking a Research Engineer.The role involves working on post-training and RLVR, designing experiments, and improving large language models.Ide...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI Evaluation Engineer — Metrics & Data Pipelines

    Senior AI Evaluation Engineer — Metrics & Data Pipelines

    Sentry • San Francisco, CA, United States
    [job_card.full_time]
    A leading software monitoring company is seeking a Senior Software Engineer on its AI / ML team to build evaluation infrastructure for measuring the performance of AI systems.This role involves desig...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Quantitative LLM Researcher

    Quantitative LLM Researcher

    Placeholder • San Francisco, CA, United States
    [job_card.full_time]
    Numerai is the hardest data science tournament in the world, powering an AI hedge fund.Every week we distribute and process terabytes of data, ingest millions of stock market predictions, execute t...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Applied UX Researcher – B2C & B2B (Advertiser) Products

    Applied UX Researcher – B2C & B2B (Advertiser) Products

    US Tech Solutions • San Francisco, CA, United States
    [job_card.full_time]
    Location : San Francisco, CA (onsite in a hybrid model).We are seeking an experienced Applied UX Researcher to join our team in San Francisco, CA, working in a hybrid onsite model.In this role, you ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff Research Associate - translational research

    Staff Research Associate - translational research

    University of California - San Francisco • San Francisco, CA, United States
    [job_card.full_time]
    Staff Research Associate - translational research.HDF Comprehensive Cancer Center.David Oh conducts translational research focusing on the intersection of immunology and oncology.The research assoc...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Financial Markets Research Associate

    Financial Markets Research Associate

    Labelbox • San Francisco, CA, United States
    [job_card.full_time]
    Alignerr supports AI labs and financial organizations by providing researchers who synthesize financial, economic, and business-level information into structured, high-utility outputs.The Financial...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Stock Analysis SME - AI Model Evaluator (Remote)

    Stock Analysis SME - AI Model Evaluator (Remote)

    Braintrust • San Francisco, CA, United States
    [filters.remote]
    [job_card.part_time]
    A technology consulting company is seeking Stock Analysis Subject Matter Experts to evaluate AI-generated responses and provide structured feedback. This part-time role involves collaborating with A...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Associate

    Research Associate

    Actalent • Hercules, CA, United States
    [job_card.full_time]
    Job Title : In-Vivo Research AssociateJob Description.We are seeking a detail-oriented In-Vivo Research Associate to support preclinical studies involving laboratory animals.The ideal candidate will...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Statistical Programmer Oncology Trials

    Lead Statistical Programmer Oncology Trials

    REVOLUTION Medicines • San Francisco, CA, United States
    [job_card.full_time]
    A leading biotechnology company in San Francisco seeks an experienced Statistical Programming professional with over 14 years in oncology trials. The role involves overseeing programming teams, ensu...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Statistical Programmer

    Senior Statistical Programmer

    Olema Oncology • San Francisco, CA, United States
    [job_card.full_time]
    Olema Oncology is dedicated to developing better medicines for breast cancer and beyond.Our lead program, palazestrant (OP-1250), is a complete estrogen receptor antagonist (CERAN) currently in dev...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Physics Subject Matter Expert - AI Evaluation

    Physics Subject Matter Expert - AI Evaluation

    Sepal • Berkeley, CA, United States
    [job_card.full_time]
    About the Project Sepal is conducting a qualitative research study to define benchmarks of professional excellence in physics education. We are looking for experienced professionals to contribute th...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff ML Research Scientist : LLM Evaluation & Benchmarks

    Staff ML Research Scientist : LLM Evaluation & Benchmarks

    Scale AI • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI evaluation company in Seattle is seeking a Staff Machine Learning Research Scientist to advance LLM evaluations, develop benchmarks, and mentor research teams.The ideal candidate has o...[show_more]
    [last_updated.last_updated_30] • [promoted]