Talent.com
Member of Technical Staff, Model Evaluation
Member of Technical Staff, Model EvaluationxAI • Palo Alto, CA, US
[error_messages.no_longer_accepting]
Member of Technical Staff, Model Evaluation

Member of Technical Staff, Model Evaluation

xAI • Palo Alto, CA, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Description
About xAI

xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company's mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

Tech Stack
  • Python
  • JAX and XLA
  • Rust / C++
  • Spark
Focus
  • Provide complete assessment of models.
  • Deep dive into model training and data to identify the weakness point revealed in evaluation.
  • Communicate with modeling and data team to come up with plans to improve model quality.
Ideal Experience
  • Model assessment and evaluation task development (including public and in-house benchmarking).
  • Collect data and synthesize data for new evals.
  • Build infrastructure and framework for easy-to-use model evaluation, familiarity with inference frameworks like SGlang and vLLM.
Location

The role is based in the Bay Area [San Francisco and Palo Alto]. Candidates are expected to be located near the Bay Area or open to relocation.

Annual Salary Range

$180,000 - $440,000 USD

Benefits

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

xAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

[job_alerts.create_a_job]

Member of Technical Staff, Model Evaluation • Palo Alto, CA, US

[internal_linking.similar_jobs]

Member of Technical Staff

OracleSanta Clara, CA, United States
[job_card.full_time]

Oracle Cloud Infrastructure (OCI) delivers mission-critical applications for top tier enterprises around the world.Our cloud offers unmatched hyper-scale, multi-tenant services deployed in more tha...[internal_linking.show_more]

 • [job_card.promoted]

Member of Technical Staff - Cluster / Platform

RadixArkPalo Alto, CA, United States
[job_card.full_time]

Member of Technical Staff (Cluster / Platform).You will design and operate highly reliable, high-performance GPU/TPU clusters, build next-generation scheduling and resource management systems, and ...[internal_linking.show_more]

 • [job_card.promoted]

Staff ML Engineer

TypefacePalo Alto, CA, United States
[job_card.full_time]

We help the world's biggest brands move from brief to fully personalized campaigns - in days, not months.Founded by Abhay Parasnis and backed by Microsoft, GV, Salesforce, Lightspeed, Madrona and M...[internal_linking.show_more]

 • [job_card.promoted]

Tech Engagement Lead - Model Builder

NVIDIASanta Clara, CA, United States
[job_card.full_time]

NVIDIA is seeking a highly influential Generative AI Technical Engagement Lead to evangelize for, drive, and support the seamless adoption and accelerate the performance of NVIDIA's accelerated com...[internal_linking.show_more]

 • [job_card.promoted]

Travel CT Tech - $3,301 to $3,495 per week in Santa Cruz, CA

AlliedTravelCareersSanta Cruz, CA, US
[job_card.full_time] +2

AlliedTravelCareers is working with Thrive Staffing to find a qualified CT Tech in Santa Cruz, California, 95065!.CT Technologist (Computed Tomography).Seeking an experienced CT Technologist to ope...[internal_linking.show_more]

 • [job_card.promoted]

Staff Engineer-Protocol Development Testing

Johnson and JohnsonMilpitas, CA, United States
[job_card.full_time]

At Johnson & Johnson, we believe health is everything.Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments a...[internal_linking.show_more]

 • [job_card.promoted]

Technology Specialist - eBeam Inspection

KLAMilpitas, CA, United States
[job_card.full_time]

KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, smartpho...[internal_linking.show_more]

 • [job_card.promoted]

Staff Hardware Validation Engineer

Ford Motor CompanyPalo Alto, CA, United States
[job_card.full_time]

In this high-impact role, you will define the validation strategy and technical roadmaps for complex mechatronic hardware across multiple vehicle product lines.You will not only oversee the "bring-...[internal_linking.show_more]

 • [job_card.promoted]

ML Engineer, Foundation Model Evaluation

WaymoMountain View, CA, United States
[job_card.full_time]

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...[internal_linking.show_more]

 • [job_card.promoted]

Member of Technical Staff, Research Scientist

OdysseySanta Clara, CA, United States
[job_card.full_time]

Odyssey is an AI lab pioneering general-purpose world models—a new form of audio-visual intelligence.These models will power the next generation of gaming, education, companionship, simulation, and...[internal_linking.show_more]

 • [job_card.promoted]

Staff Machine Learning Engineer - Foundation Model

XPENGSanta Clara, CA, United States
[job_card.full_time]

AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics.With a strong focus on intelligent...[internal_linking.show_more]

 • [job_card.promoted]

Member of Technical Staff, ASIC Design

NetpremeSanta Clara, CA, United States
[job_card.full_time]

We are seeking experienced Senior ASIC Designers.This role demands proven technical expertise in advanced ASIC design flows, and leadership in execution, cross-functional coordination, and final pr...[internal_linking.show_more]

 • [job_card.promoted]

Principal Member of Technical Staff

ExoSanta Clara County, CA, United States
[job_card.full_time]

Principal Member of Technical Staff.At Exo, we're united by one mission, to take medical imaging where you never thought it could go - everywhere.Through the power of an ultrasound ecosystem design...[internal_linking.show_more]

 • [job_card.promoted]

Build Technician

PrideStaffUnion City, CALIFORNIA
[job_card.full_time]
[filters_job_card.quick_apply]

The Build Technician is responsible for hands-on fabrication, assembly, and preparation of prototype and production builds in a fast paced manufacturing environment.This role requires strong crafts...[internal_linking.show_more]

 • [job_card.promoted]

Member of Technical Staff - Machine Learning (AI Team)

Microsoft CorporationMountain View, CA, United States
[job_card.full_time]

As a Member of Technical Staff - Machine Learning (AI Team), you will work to create LLM models for general purpose capabilities and for products.You may be responsible for developing new methods t...[internal_linking.show_more]

 • [job_card.promoted]

Undergraduate Admissions Evaluator

InsideHigherEdSan Jose, California, United States
[job_card.full_time]

Unit 4 - APC - Academic Professionals of California, Probationary, Full Time, Student Services.The Enrollment Services Department supports the academic mission of the University and collaboratively...[internal_linking.show_more]

 • [job_card.promoted]

Staff Technical Product Manager - Performance Modeling

NextpowerFremont, CA, United States
[job_card.full_time]

Fremont, CA / Hybrid (4 days in office).Staff Technical Product Manager - Performance Modeling.PV performance modeling and simulation platform used to evaluate energy yield, system performance, and...[internal_linking.show_more]

 • [job_card.promoted]

Senior Member of Technical Staff - Algorithm & Performance Optimization - GPU Libraries

Advanced Micro Devices, Inc.Santa Clara, CA, United States
[job_card.full_time]

WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next-generation computing experiences-from AI and data centers, to PCs, gaming and embedded syst...[internal_linking.show_more]