Talent.com
Research Engineer / Scientist, Robustness & Safety Training
Research Engineer / Scientist, Robustness & Safety TrainingOpenAI • San Francisco, CA, United States
[error_messages.no_longer_accepting]
Research Engineer / Scientist, Robustness & Safety Training

Research Engineer / Scientist, Robustness & Safety Training

OpenAI • San Francisco, CA, United States
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Research Engineer / Scientist, Robustness & Safety Training

Safety Systems - San Francisco

About the Team

The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit society and is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency.

The Model Safety Research team aims to fundamentally advance our capabilities for precisely implementing robust, safe behavior in AI models, and to leverage these advances to make OpenAI’s deployed models safe and beneficial. This requires a breadth of new ML research to address the growing set of safety challenges as AI becomes more powerful and used in more settings. Key focus areas include how to enforce nuanced safety policies without trading off helpfulness and capabilities, how to make the model robust to adversaries, how to address privacy and security risks, and how to make the model trustworthy in safety‑critical domains.

We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely.

About the Role

OpenAI is seeking a senior researcher with passion for AI safety and experience in safety research. Your role will set directions for research to enable and empower safe AGI and work on research projects to make our AI systems safer, more aligned and more robust to adversarial or malicious use cases. You will play a critical role in shaping how a safe AI system should look like in the future at OpenAI, making a significant impact on our mission to build and deploy safe AGI.

In this role, you will :

  • Conduct state‑of‑the‑art research on AI safety topics such as RLHF, adversarial training, robustness, and more.
  • Implement new methods in OpenAI’s core model training and launch safety improvements in OpenAI’s products.
  • Set the research directions and strategies to make our AI systems safer, more aligned and more robust.
  • Coordinate and collaborate with cross‑functional teams, including T&S, legal, policy and other research teams, to ensure that our products meet the highest safety standards.
  • Actively evaluate and understand the safety of our models and systems, identifying areas of risk and proposing mitigation strategies.

You might thrive in this role if you :

  • Are excited about OpenAI’s mission of building safe, universally beneficial AGI and are aligned with OpenAI’s charter.
  • Demonstrate a passion for AI safety and making cutting‑edge AI models safer for real‑world use.
  • Bring 4+ years of experience in the field of AI safety, especially in areas like RLHF, adversarial training, robustness, fairness & biases.
  • Hold a Ph.D. or other degree in computer science, machine learning, or a related field.
  • Possess experience in safety work for AI model deployment.
  • Have an in-depth understanding of deep learning research and / or strong engineering skills.
  • Are a team player who enjoys collaborative work environments.
  • About OpenAI

    OpenAI is an AI research and deployment company dedicated to ensuring that general‑purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

    We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

    Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.

    To notify OpenAI that you believe this job posting is non‑compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

    We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

    OpenAI Global Applicant Privacy Policy

    At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

    Compensation

    $310K – $460K + Offers Equity

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Research Scientist • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    Senior / Staff Safety Research Engineer, Crash and Injury Modeling

    Senior / Staff Safety Research Engineer, Crash and Injury Modeling

    Zoox • Foster City, CA, US
    [job_card.full_time]
    Zoox is on an ambitious journey to develop a full-stack autonomous mobility solution for cities and safely deploy such a robotaxi solution. You will be part of the SDMA Safety Research team, which i...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Founding Research Engineer (Security)

    Founding Research Engineer (Security)

    Greylock Partners • Redwood City, CA, United States
    [job_card.full_time]
    Be among the first 25 applicants.Early-stage, cybersecurity investment (valued over $100M at Seed), founded by a successful serial entrepreneur, is looking to hire a Founding Research with a strong...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Engineer : AI Security & Backend - Equity & Impact

    Research Engineer : AI Security & Backend - Equity & Impact

    Virtue AI • San Francisco, CA, United States
    [job_card.full_time]
    A pioneering AI security company based in California is seeking a Research Engineer to develop and operate flagship products focused on agent and LLM securities. The ideal candidate will possess str...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    AI Engineer & Researcher - Safety & Societal Impact

    AI Engineer & Researcher - Safety & Societal Impact

    xAI • San Francisco, CA, United States
    [job_card.full_time]
    AI Engineer & Researcher - Safety & Societal Impact.AI Engineer & Researcher - Safety & Societal Impact.AI’s mission is to create AI systems that can accurately understand the universe and aid huma...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Engineer, ML Systems (All Industry Levels)

    Research Engineer, ML Systems (All Industry Levels)

    Character.AI • San Francisco, CA, United States
    [job_card.full_time]
    Research Engineer, ML Systems (All Industry Levels).Research Engineer, ML Systems (All Industry Levels).Research Engineer, ML Systems (All Industry Levels). Research Engineer, ML Systems (All Indust...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Research Engineer

    Senior Research Engineer

    Far.Ai • Berkeley, California, USA
    [job_card.full_time]
    AI research institute dedicated to ensuring advanced AI is safe and beneficial for everyone.Our mission is to facilitate breakthrough AI safety research advance global understanding of AI risks and...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Engineer

    Research Engineer

    Metis • San Francisco, CA, United States
    [job_card.full_time]
    Join to apply for the Research Engineer role at Metis.As a Research Engineer at Metis, you’ll work on building the next generation of autonomous post‑training systems that leverage our Mantis platf...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Engineer, Reward Models Training

    Research Engineer, Reward Models Training

    anthropic • San Francisco, CA, United States
    [job_card.full_time]
    Research Engineer, Reward Models Training.Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Research Engineer, Reward Models Platform

    Research Engineer, Reward Models Platform

    Anthropic • San Francisco, CA, United States
    [job_card.full_time]
    Research Engineer, Reward Models Platform.Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY. Anthropic’s mission is to create reliable, interpretable, and steer...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Engineer

    Research Engineer

    Skild AI • San Francisco, CA, United States
    [job_card.full_time]
    At Skild AI, we are building the world's first general purpose robotic intelligence that is robust and adapts to unseen scenarios without failing. We believe massive scale through data-driven machin...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Engineer / Scientist, Pretraining Safety

    Research Engineer / Scientist, Pretraining Safety

    OpenAI • San Francisco, CA, United States
    [job_card.full_time]
    Research Engineer / Scientist, Pretraining Safety.Get AI-powered advice on this job and more exclusive features.The Safety Systems team is responsible for various safety work to ensure our best mod...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Engineer / Scientist, Post-Training

    Research Engineer / Scientist, Post-Training

    Letta Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Solving Self-Improving Superintelligence.Today’s AI brains are brittle and rigid.At Letta, we’re building self-improving artificial intelligence : creating agents that continually learn from experie...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Engineer

    Research Engineer

    Corridor • San Francisco, CA, United States
    [job_card.full_time]
    AI has changed software development.Security hasn't caught up – until now.Corridor is changing the game of product security, giving developers the ability to secure their AI coding.Our team has liv...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Scientist / Engineer

    Research Scientist / Engineer

    Waabi • San Francisco, CA, United States
    [job_card.full_time]
    Waabi, founded by AI pioneer Raquel Urtasun, is an.AI company building the next generation of self-driving technology.With a world-class team and an innovative approach, Waabi aims to bring self-dr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Research Engineer, Adaptable Intelligence (Remote)

    Lead Research Engineer, Adaptable Intelligence (Remote)

    Adaption Labs • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A leading tech company is looking for a Senior Research Engineer to shape the research agenda and product direction.This role involves innovative data adaptation, mentorship for junior team members...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Machine Learning Research Lead, Security & Policy Research Lab

    Machine Learning Research Lead, Security & Policy Research Lab

    Scale AI, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems.Building on this expertis...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Safety Research Engineer - Build Frontier Model Infra

    AI Safety Research Engineer - Build Frontier Model Infra

    Jack & Jill / External ATS • San Francisco, CA, United States
    [job_card.full_time]
    A mission-driven AI research company is seeking a Research Engineer to bridge theoretical AI safety research with practical implementation. In this role, you will build critical infrastructure and c...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Engineer – Scalable ML Training & Inference

    Research Engineer – Scalable ML Training & Inference

    Aldea Inc • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI company in San Francisco is looking for a Research Engineer (Machine Learning) to enhance their multi-modal AI capabilities. The role involves building and optimizing infrastructure for...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]