Talent.com
BerriAI
Head of EngineeringBerriAI • San Francisco, CA, United States
Head of Engineering

Head of Engineering

BerriAI • San Francisco, CA, United States
3 days ago
Job type
  • Full-time
Job description

Head Of Engineering

LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Head of Engineering to lead the team building the leading OSS AI gateway.

About The Role

You own the outcomes, the process, and the team. You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community. You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy. This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO. It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight.

Responsibilities

  • Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to
  • Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync
  • Drive well-architected, consistent code patterns across the team
  • Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites
  • Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution
  • Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed
  • Look out for the open-source community and protect open-source adoption as the team scales

What We're Looking For

  • Been an EM before, with a track record of managing and shipping through a team
  • Metrics-driven: has stood up reliability or productivity metrics (on-time ship rate, regressions per release, MTTR) and used them to find root causes
  • Has kept quality high on a fast-moving production system, with evidence of driving an incident or regression rate down (e.g. took P0s from X to Y)
  • Root-cause and incident management: can point to incidents they ran postmortems on and the recurrence rate dropping after
  • Process design: built tracking, review cadences, or release processes from scratch, with before/after numbers to show impact
  • Goal-setting and accountability: has improved a team's on-time delivery or commitment-hit rate
  • Customer-facing when it counts: has owned enterprise escalations and can show trust or retention held up after
  • Hiring and scaling: has filled a defined headcount plan and can speak to time-to-hire and quality bar
  • CS/engineering degree or equivalent hands-on engineering background
  • Worked at a startup, familiar with messy codebases and doing rewrites
  • Bonus: did this at an open-source company
  • Bonus: scaled the eng team at a fast-growing startup

Why Join LiteLLM?

  • High ownership: you own engineering productivity, quality, hiring, and the team's execution for the leading OSS AI gateway
  • Director-level scope, clear path: four areas under you and a direct line to Head of Engineering. Real scope now, not after years of waiting
  • Work directly with the CTO: you report to the founder/CTO and help set direction, not execute someone else's plan three layers down
  • A genuinely hard technical problem: 100+ provider integrations, a Rust migration, and day-zero model launches. The challenge is real and interesting, not process theater
  • High impact, in public: we work with NASA, Stripe, Adobe, and 84.51, and the work is open source. You'd be the person who scaled how LiteLLM is built, and the community sees it
  • Competitive salary, health, dental, and vision benefits
Create a job alert for this search

Head of Engineering • San Francisco, CA, United States

Similar jobs

Head of Enterprise Solutions Architecture Platforms

StripeSouth San Francisco, CA, United States
Full-time

Solution Architecture Team Leader.Stripe is a financial infrastructure platform for businesses.Millions of companiesfrom the world's largest enterprises to the most ambitious startupsuse Stripe to ... Show more

 • Promoted

Head of GTM

AlchemySan Francisco, CA, United States
Full-time

We're seeking a Head Of Go-To-Market to build and scale Alchemy's global revenue engine.This role sits at the intersection of product, growth, and revenue, and will own how Alchemy brings products ... Show more

 • Promoted

Head of Compute

Applied ComputeSan Francisco, CA, United States
Full-time

At Applied Compute, securing the right compute on the right terms is what makes our post-training and agent infrastructure possible.As Head of Compute Partnerships, you'll own the sourcing, economi... Show more

 • Promoted

Head of Customer Engineering

AnyscaleSan Francisco, CA, United States
Full-time

Customer Engineering Team Leader.At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels.We're commercializing Ray, a ... Show more

 • Promoted

Head of Sales

AutomatSan Francisco, CA, United States
Full-time

Automat was founded by a diverse group of creative technologists from teams like Google's Creative Lab, and Samsung's innovation Think Tank Team.We envision a future where intelligent agents stream... Show more

 • Promoted

Head of Commercial

Terra AIRedwood City, CA, United States
Full-time

Head Of Commercial Development.Terra AI is building a new category at the intersection of artificial intelligence, geoscience, and critical resource development.As global demand for copper, lithium... Show more

 • Promoted

Head of Engineering, Platform

GoodfireSan Francisco, CA, United States
Full-time

Goodfire is a research company using interpretability to understand, learn from, and design AI systems.Our mission is to build the next generation of safe and powerful AInot by scaling alone, but b... Show more

 • Promoted

Head of Engineering

Recruiting From ScratchSan Francisco, CA, United States
Full-time

Title Of Role: Head Of Engineering.Location: San Francisco, Onsite.Company Stage Of Funding: Seed Data, Software Development.We're representing a dynamic startup that is accelerating the transitio... Show more

 • Promoted

Head of Product Engineering

fabricSan Francisco, CA, United States
Full-time

Come build the future of commerce with us at fabric! We're building the Agentic Commerce Infrastructure to help merchants grow, sell, and operate in today's AI Commerce-powered shopping experience.... Show more

 • Promoted

Head of Engineering

DYNA Robotics IncRedwood City, CA, United States
Full-time

Join Us To Shape The Next Frontier Of Ai-Driven Robotics!.Dyna Robotics makes general-purpose robots powered by a proprietary embodied AI foundation model that generalizes and self-improves across ... Show more

 • Promoted

Head of GTM Engineering & Systems

Fireworks AISan Mateo, CA, United States
Full-time

As the leader of GTM Engineering you will set the architecture, drive our AI roadmap, or deliver on the auto-magical future that empowers every customer facing role.You'll own the full GTM tech sta... Show more

 • Promoted

Head of Engineering, North America

Heidi HealthSan Francisco, CA, United States
Full-time

Healthcare needs a better rhythm: one that keeps care continuous and deeply human.Heidi is building an AI Care Partner that works alongside clinicians to make that possible.We're a team of doctors,... Show more

 • Promoted

Head of Engineering

Probably GeneticSan Francisco, CA, United States
Full-time

About Probably GeneticProbably Genetic is changing the lives of patients living with severe, complex diseases.Our data platform is used by drug developers and patient advocacy groups to develop and... Show more

 • Promoted

Head of Engineering Operations

AsanaSan Francisco, CA, United States
Full-time

Head Of Engineering Operations.As the Head of Engineering Operations, you will be a key leadership partner to the CTO and the engineering leadership team, owning the operational backbone of our glo... Show more

 • Promoted

Head of Hardware Partnerships

AdyenSan Francisco, CA, United States
Full-time

Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice.At Adyen, everyt... Show more

 • Promoted

Head of Engineering

David AISan Francisco, CA, United States
Full-time

About David AIDavid AI is the first audio data research company.We bring an R&D approach to data-developing datasets with the same rigor AI labs bring to models.Our mission is to bring AI into ... Show more

 • Promoted

Head of Engineering

Poesis LLCSan Francisco, CA, United States
Full-time

About PoesisPoesis is the AI-native investment manager pioneering a new foundation model for investing in U.We're building modular AI systems to predict market movements and outperform legacy manag... Show more

 • Promoted

Head of Engineering

Superpower Health, IncSan Francisco, CA, United States
Full-time

Superpower is building the future of preventative health.We help people unlock peak performance and longevity-and we're working to put an AI doctor in every person's pocket.We have product-market f... Show more

 • Promoted

Director of Engineering

Rosewood HotelsMenlo Park, CA, United States
Full-time

As part of the Engineering Division, which focuses on ensuring the safety, efficiency, and sustainability of all hotel assets, this role contributes to the strategic and operational excellence of t... Show more

 • Promoted

Head of Operations

MagneticSan Francisco, CA, United States
Full-time

Magnetic is building the AI tax preparation platform for modern CPA firms.Our product pairs cutting-edge AI with expert tax professionals, enrolled agents, and CPAs to produce accuracy-guaranteed t... Show more