Talent.com
Evaluator/Reviewer - Physics Teachers, Postsecondary
Evaluator/Reviewer - Physics Teachers, PostsecondarySepal • San Francisco, CA, United States
Evaluator / Reviewer - Physics Teachers, Postsecondary

Evaluator / Reviewer - Physics Teachers, Postsecondary

Sepal • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [job_card.part_time]
[job_card.job_description]

Role Overview

The Occupation-Specific Reviewer evaluates task submissions that require domain expertise in a specific profession or field (e.g., healthcare, law, education, engineering, finance, software development). This role ensures that content is not only guideline-compliant, but also professionally accurate, realistic, and aligned with real-world standards of practice.

Occupation-Specific Reviewers are trusted subject matter experts who apply both formal evaluation criteria and professional judgment, while maintaining strict adherence to safety, compliance, and scope boundaries.

Key Responsibilities

  • Review submissions requiring professional or technical domain knowledge
  • Validate factual accuracy, terminology, and real-world applicability within the domain
  • Ensure outputs remain within allowed scope and do not provide unsafe, misleading, or non-compliant guidance
  • Evaluate alignment with professional standards, norms, and best practices
  • Apply platform guidelines consistently, even when they conflict with personal preference or real-world shortcuts
  • Provide precise, educational, and corrective feedback grounded in both guidelines and domain expertise
  • Identify high-risk errors related to safety, ethics, or misuse
  • Escalate ambiguous or high-impact issues appropriately
  • Maintain clear documentation of review decisions and reasoning

Required Qualifications

  • Advanced degree, professional certification, or equivalent experience in the relevant occupation or field
  • 5+ years of professional experience practicing in that domain
  • Demonstrated experience with :
  • Evaluation, review, auditing, or supervisory responsibilities OR

    Teaching, mentoring, training, or assessing professional work

  • Strong understanding of professional boundaries, risk, and compliance considerations
  • Excellent written communication skills suitable for formal feedback
  • Preferred Qualifications

  • Prior experience reviewing AI-generated or training data content
  • Familiarity with compliance, regulatory, or ethical standards in the field
  • Experience translating expert knowledge into clear, structured explanations
  • Comfort working with evolving guidelines and iterative feedback cycles
  • Key Competencies

  • Subject matter expertise
  • Risk awareness and safety judgment
  • Guideline fidelity
  • Clear, corrective feedback
  • Professional integrity
  • Expectations

  • Strict adherence to confidentiality and data protection requirements
  • Consistent application of guidelines across all reviews
  • Willingness to update evaluation approach as standards evolve
  • Professional, unbiased, and respectful communication at all times
  • Compensation & Logistics

  • $65 to $100 per hour, depending on expertise and relevance, with bonuses for key contributions
  • Begins with a paid trial period
  • Paid every two weeks based on approved and tracked hours
  • Fully remote and async friendly, work at your own pace within flexible deadlines
  • Employment type : Contract, flexible hours (part-time and full-time options).
  • Location : United States or Canada
  • [job_alerts.create_a_job]

    EvaluatorReviewer Physics Teachers Postsecondary • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    Senior Research Engineer, LLM Evaluation and Behavioral Analysis

    Senior Research Engineer, LLM Evaluation and Behavioral Analysis

    Together AI • San Francisco, CA, United States
    [job_card.full_time]
    Senior Research Engineer, LLM Evaluation and Behavioral Analysis.Together AI is building the fastest, most capable open‑source‑aligned LLMs and inference stack in the world.As part of the Turbo org...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Scientist : AI Evaluation & Alignment

    Research Scientist : AI Evaluation & Alignment

    Patronus AI • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI company is seeking a Research Scientist to develop cutting-edge AI evaluation systems and conduct transformative research in language models. Candidates should have a background in empi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI Evaluation Engineer

    Senior AI Evaluation Engineer

    Sentry • San Francisco, CA, United States
    [job_card.full_time]
    A software monitoring firm is seeking a Senior Software Engineer to join its AI / ML team in San Francisco.In this role, you will design evaluation frameworks to measure AI system performance, develo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Engineer, Model Evaluations

    Research Engineer, Model Evaluations

    Anthropic • San Francisco, CA, United States
    [job_card.full_time]
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Physics Teacher

    Physics Teacher

    Lever Demo - IS Opportunities • San Francisco, California, United States, 94102
    [job_card.full_time]
    PLEASE READ : these jobs are testing jobs of Lever's testing environment - please do not apply for this job.Lever was founded ten years ago to tackle the most strategic challenge that companies face...[show_more]
    [last_updated.last_updated_variable_days]
    Mathematics Expert (Masters / PhDs)

    Mathematics Expert (Masters / PhDs)

    Labelbox • San Francisco, CA, United States
    [job_card.full_time]
    Mathematics Expert – $90 / hr Remote – Alignerr.At Alignerr, we partner with the world’s leading AI research teams and labs to build and train cutting‑edge AI models. Mathematics Expert (Masters / PhDs)...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Engineer : AI Systems & LLM Evaluation + Equity

    Research Engineer : AI Systems & LLM Evaluation + Equity

    Mercor, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A cutting-edge technology company in San Francisco is seeking a Research Engineer.The role involves working on post-training and RLVR, designing experiments, and improving large language models.Ide...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    iLab Teacher

    iLab Teacher

    HCSDK8 • Hillsborough, California, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    HILLSBOROUGH CITY SCHOOL DISTRICT.The responsibility of the teacher is to carry out a program of instruction which enables students to utilize skills taught to discover, to problem solve, to predic...[show_more]
    [last_updated.last_updated_variable_days]
    Applied Research Engineer - AI & LLM Evaluation

    Applied Research Engineer - AI & LLM Evaluation

    Mercor • San Francisco, CA, United States
    [job_card.full_time]
    An innovative AI company in San Francisco is seeking a Research Engineer to contribute to the advancement of AI models.The role involves working on post-training and evaluation tasks, designing exp...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Engineer, Reinforcement Learning

    Research Engineer, Reinforcement Learning

    Trades Workforce Solutions • San Francisco, CA, United States
    [job_card.full_time]
    Want to build the large-scale RL environments frontier labs use to train agents that can truly reason and act?.This team are creating complex reinforcement learning environments — simulations where...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    GenAI Evaluation Scientist Enterprise LLM Systems

    GenAI Evaluation Scientist Enterprise LLM Systems

    Scale AI • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI technology company is seeking an AI Research Engineer to join their Enterprise Evaluations team.In this critical role, you will enhance evaluation systems for LLM-powered workflows.Can...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Quantitative Evaluation Engineer — Simulator Fidelity

    Senior Quantitative Evaluation Engineer — Simulator Fidelity

    Waymo • San Francisco, CA, United States
    [job_card.full_time]
    A leading autonomous driving technology company in San Francisco is seeking a skilled individual to develop methodologies and metrics for simulation realism. This role requires a master's degree in ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Research Engineer, Model Evaluations Platform

    Lead Research Engineer, Model Evaluations Platform

    Anthropic • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI research organization in San Francisco seeks a Research Engineer to lead the design and implementation of its evaluation platform. You will ensure the safety and effectiveness of AI mod...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Machine Learning Engineer - Model Evaluations, Public Sector

    Machine Learning Engineer - Model Evaluations, Public Sector

    Scale AI, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Machine Learning Engineer - Model Evaluations, Public Sector.Louis, MO; New York, NY; Washington, DC.Join the team shaping the future of AI at Scale. Machine Learning Engineer - Model Evaluations, P...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Large-Model Evaluation Engineer — ML Metrics & Simulation

    Large-Model Evaluation Engineer — ML Metrics & Simulation

    Waymo • San Francisco, CA, United States
    [job_card.full_time]
    A leading autonomous technology company is seeking quantitatively-minded engineers to innovate metrics and analysis methods for assessing ML models in complex, safety-critical environments.This rol...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Stock Analysis SME - AI Model Evaluator (Remote)

    Stock Analysis SME - AI Model Evaluator (Remote)

    Braintrust • San Francisco, CA, United States
    [filters.remote]
    [job_card.part_time]
    A technology consulting company is seeking Stock Analysis Subject Matter Experts to evaluate AI-generated responses and provide structured feedback. This part-time role involves collaborating with A...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Postdoctoral Scholar - Physics

    Postdoctoral Scholar - Physics

    University of California Berkeley • Berkeley, CA, United States
    [job_card.full_time]
    The UC postdoc salary scales set the minimum pay determined by experience level at appointment.See the following table(s) for the current salary scale(s) for this position : https : / / www.A reasonable...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AIML - Sr. Machine Learning Infrastructure Engineer, Evaluation

    AIML - Sr. Machine Learning Infrastructure Engineer, Evaluation

    Apple Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Machine Learning Infrastructure Engineer, Evaluation.San Francisco, California, United States Software and Services.How do we ensure that Apple's most advanced AI features perform flawlessly for ev...[show_more]
    [last_updated.last_updated_30] • [promoted]