Talent.com
Research Stream Lead
Research Stream LeadMetr • Berkeley, CA, United States
Research Stream Lead

Research Stream Lead

Metr • Berkeley, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Referral Bonus

We are offering a $21k referral bonus for this role. You can refer people through our form, and it lists the terms of this bonus.

About METR

We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks and mitigations, with a specific focus on threats related to autonomy, AI R&D automation, and alignment.

We believe it is robustly good for civilization to have a clearer understanding of what dangers AI systems pose, and we are extremely excited to find ambitious, excellent people to join our team and tackle one of the most important challenges of our time.

We evaluate candidates primarily through (paid) work tests. We usually do an in-person trial as well but can be flexible about this.

Role Mission : Lead a team and own one of the key areas needed to understand the level of risk from future models

Example research areas :

  • How can we tell models aren’t undermining our evaluations by sandbagging or alignment faking?
  • How much cognition can models do without revealing it in their reasoning traces?
  • How close are models to being able to sabotage research at AI companies or at METR?
  • How reliable are safety claims made by AI developers based on new techniques, e.g. activation steering?
  • What egregiously misaligned behaviors do models display? How good are monitors at picking up on this, or do they tend to collude with (or get exploited by) the agents?
  • Build model organisms or red-teaming approaches to test the robustness of METR’s or external evaluations and safety measures

What the job involves

  • Collaborate with other research streams to identify the questions that need to be answered for METR to be able to accurately assess catastrophic risk from models in the near and longer-term future.
  • Lead research to answer these questions as cheaply and effectively as possible, trading off between being scrappy and careful in the right places.
  • Significantly improve METR's risk reports based on the research your team has done.
  • Publish 'fundamental' research that’s similarly impactful to the time horizon methodology. Your team's work makes foundational progress, improves collective understanding of the relevant phenomena, and becomes the standard way to think and talk about it, for METR and our target audience (highly informed and engaged people but who may be skeptical of AI risk or of METR).
  • Maintain METR’s high-integrity culture - communicate research accurately and don’t overhype - even critics or skeptics generally praise the work's quality.
  • Build a strong team, identify talent needs and be an effective hiring manager, maintain high standards of performance on your team, grow and empower top performers.
  • Lead team effectively, get people excited about and bought into goals, maintain motivation and momentum.
  • Maintain high research velocity : we're generally learning meaningful new things every week or two (unless we're explicitly investing in a large high-payoff project we've derisked).
  • The ideal candidate has experience leading high-performing research teams working with frontier ML systems, such as alignment, post-training, interpretability, or frontier evaluations. Other promising candidate profiles

  • Experience as a research manager in an ML related area (or a technical non-ML field like quantitative trading while also keeping up with relevant ML / AI safety literature)
  • Experience as a technical engineering manager, including with some experience with fast-moving / scrappy research workflows
  • Track record of high-quality ML research, with clear evidence of multiple impactful research outputs (such as papers, blog-posts, etc.) where you are a key contributor. These works feature well-designed methodology or experiments, are well-written, and clearly and carefully communicated without overstating results.
  • High quality output that's highly relevant to METR's work. You have public research, writing, code or some other artifact that demonstrates your careful thinking, deep understanding of and ability to make progress on METR’s research directions.
  • Evidence of outstanding achievement. You have some other impressive achievement that demonstrates you have the relevant skills or can learn very quickly, such as founding a successful startup, having widely-used open-source projects, or having made scientific contributions outside your area of expertise. These are not exhaustive and we'd be excited to hear about other evidence of outstanding achievements!
  • Salary range : $250,000 - $450,000 a year (base)

    Benefits

  • The office : Catered lunch and dinner daily; in-office gym and shower
  • Relocation support : Stipend for moving to the Bay Area
  • Time-off and leave : Unlimited PTO and 21-week parental leave for new parents
  • Commuter benefit : Monthly transit / parking stipend and an annual Uber budget
  • Professional development benefit : for training, courses, conferences, and AI safety education
  • Mental health benefit : for therapy, medication, and other mental health expenses
  • Wellness benefit : for gym memberships and other wellness expenses
  • Work equipment benefit : for home office and workstation equipment expenses
  • Our Culture

    METR is a mission-driven organization. We believe our work can meaningfully shape humanity's future for the better, and we want to be the best people in the world doing this work. We have a tight-knit, collaborative research culture rooted in truth-seeking and integrity. We're fiercely committed to producing high-quality, trustworthy science. We're honest and transparent about our results, especially when they may go against the grain. We've earned trust as reliable partners who handle confidential information with care. We maintain a low-ego, drama-free environment focused on what matters.

    Hybrid Requirements

    Our technical team members are in our office in Berkeley 3-5 days / week. Please let us know in your application if this is a constraint. If you lack US work authorization and would like to work in-person (strongly preferred), we can likely sponsor a cap-exempt H-1B visa for this role.

    We encourage you to apply even if your background may not seem like the perfect fit! We would rather review a larger pool of applications than risk missing out on a promising candidate for the position.

    We are committed to diversity and equal opportunity in all aspects of our hiring process. We do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We welcome and encourage all qualified candidates to apply for our open positions.

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Research Lead • Berkeley, CA, United States

    [internal_linking.similar_jobs]
    Senior Director, Data and AI Architecture Leader

    Senior Director, Data and AI Architecture Leader

    Dynavax Technologies • Emeryville, CA, United States
    [job_card.full_time]
    This position can be 100% remote, but must be located in the United States.Dynavax is a commercial-stage biopharmaceutical company developing and commercializing novel vaccines to help protect the ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Director, Research Subject Protection (0377U), Research Admin & Compliance - 82793

    Director, Research Subject Protection (0377U), Research Admin & Compliance - 82793

    InsideHigherEd • Berkeley, California, United States
    [job_card.full_time]
    Director, Research Subject Protection (0377U), Research Admin & Compliance - 82793.At the University of California, Berkeley, we are dedicated to fostering a community where everyone feels welcome ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Analyst

    Data Analyst

    Quality Talent Group • Napa, California, United States
    [job_card.full_time]
    Our client is a leading force in advancing safer, smarter AI technology.Their work has been featured in.They have built a global community of expert contributors and have paid more than.No contract...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Clinical Lab Scientist (CLS) - $2,120 to $2,280 per week in Napa, CA

    Travel Clinical Lab Scientist (CLS) - $2,120 to $2,280 per week in Napa, CA

    AlliedTravelCareers • Napa, CA, US
    [job_card.full_time]
    AlliedTravelCareers is working with Acruex Health to find a qualified CLS in Napa, California, 94558!.The Clinical Laboratory Scientist performs complex laboratory testing and analysis to assist in...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Pathology opportunity at our Regional Laboratory Berkeley

    Pathology opportunity at our Regional Laboratory Berkeley

    Kaiser Permanente - The Permanente Medical Group, Inc. -Northern California • Berkeley, US
    [job_card.full_time]
    Reduced schedules (with pro-rated compensation) may be available.Some incentive opportunities are estimates based on potential premium pay. The Permanente Medical Group, Inc.American Medical Special...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Prepared Foods Associate Team Leader (Culinary & Deli Assistant Department Manager)

    Prepared Foods Associate Team Leader (Culinary & Deli Assistant Department Manager)

    Whole Foods Market • Napa, CA, US
    [job_card.full_time]
    A career at Whole Foods Market is more than just the work you do- it's about your personal growth and creating meaningful change. Our purpose is to nourish people and the planet.That means improving...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Nurse RN - Case Management - COVID19 - $2,423 per week

    Travel Nurse RN - Case Management - COVID19 - $2,423 per week

    Stability Healthcare • Napa, CA, USA
    [job_card.full_time]
    Stability Healthcare is seeking a travel nurse RN Case Management for a travel nursing job in Napa, California.Job Description & Requirements. Day 1 health insurance with United Healthcare •PTO plan...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Nurse RN - Case Management - $2,349 per week

    Travel Nurse RN - Case Management - $2,349 per week

    Nationwide Therapy Group • Napa, CA, USA
    [job_card.full_time]
    Nationwide Therapy Group is seeking a travel nurse RN Case Management for a travel nursing job in Napa, California.Job Description & Requirements. NTG is committed to matching you to the right posit...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Nurse RN - Case Management - COVID19 - $2,423 per week

    Travel Nurse RN - Case Management - COVID19 - $2,423 per week

    Providence Queen of the Valley Medical Center • Napa, CA, USA
    [job_card.full_time]
    ACLS - Advanced Cardiac Life Support.Registered Nurse position at Providence Queen of the Valley Medical Center in Napa, California. Travel / Contract employment type with a contract length of 13 week...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Nurse RN - Case Management - $2,353 per week

    Travel Nurse RN - Case Management - $2,353 per week

    Coast Medical Service • Napa, CA, USA
    [job_card.full_time]
    Coast Medical Service is seeking a travel nurse RN Case Management for a travel nursing job in Napa, California.Job Description & Requirements. Coast Medical Service is a nationwide travel nursing &...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Research Lead

    AI Research Lead

    Pantera Capital • San Francisco, CA, United States
    [job_card.full_time]
    Perplexity is seeking an exceptional AI Research Tech Lead to drive our research strategy and lead the development of our in-house Online LLMs, the Sonar models. In this leadership role, you will se...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Pathology opportunity at our Regional Laboratory Berkeley

    Pathology opportunity at our Regional Laboratory Berkeley

    HealthEcareers - Client • Berkeley, CA, USA
    [job_card.full_time]
    Reduced schedules (with pro-rated compensation) may be available.Some incentive opportunities are estimates based on potential premium pay. The Permanente Medical Group, Inc.American Medical Special...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Researcher, Research & Insights

    Lead Researcher, Research & Insights

    salesforce.com, inc. • San Francisco, CA, United States
    [job_card.full_time]
    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Salesforce is the #1 AI CRM, where humans with age...[show_more]
    [last_updated.last_updated_less] • [promoted] • [new]
    Impact Analytics Researcher

    Impact Analytics Researcher

    VirtualVocations • Oakland, California, United States
    [job_card.full_time]
    A company is looking for a Researcher, Impact Analytics.Key Responsibilities Design and execute retrospective cohort studies to evaluate patient advocacy impact on outcomes, utilization, and spen...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Travel Nurse RN - Case Management - $2,325 per week

    Travel Nurse RN - Case Management - $2,325 per week

    Cross Country Nurses • Napa, CA, USA
    [job_card.full_time]
    Travel Nurse RN - Case Management - $2,325 per week at Cross Country Nurses summary : .As a Travel Nurse RN specializing in Case Management, you will collaborate with healthcare teams to assess, plan...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Data Annotation • Napa, California
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Nurse - RN - Infection Control - $2777 / Week - Hiring Now

    Travel Nurse - RN - Infection Control - $2777 / Week - Hiring Now

    Fusion Medical Staffing • Sonoma, CA, US
    [job_card.full_time]
    Fusion Medical Staffing is seeking an experienced Infection Control Registered Nurse for an exciting Travel Nursing job in Sonoma, CA. Shift : Inquire Start Date : ASAP Duration : 13 weeks Pay : $2777 / ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel CT Technologist

    Travel CT Technologist

    First Connect Health • Napa, CA, US
    [job_card.full_time]
    First Connect Health is seeking a travel CT Technologist for a travel job in Napa, California.Job Description & Requirements. AM – 12 : 00 PM (based on facility needs).Traveler must be flexi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]