Senior Software Engineer, Inference Platform

MongoDB’s mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to easily build, scale, and run modern applications by helping them modernize legacy workloads, embrace innovation, and unleash AI. Our industry-leading developer data platform, MongoDB Atlas, is the only globally distributed, multi-cloud database and is available in more than 115 regions across AWS, Google Cloud, and Microsoft Azure. Atlas allows customers to build and run applications anywhere—on premises, or across cloud providers. With offices worldwide and over 175,000 new developers signing up to use MongoDB every month, it’s no wonder that leading organizations, like Samsung and Toyota, trust MongoDB to build next‑generation, AI‑powered applications.

About the Role

We’re looking for a Senior Engineer to help build the next-generation inference platform that supports embedding models used for semantic search, retrieval, and AI-native experiences in MongoDB Atlas.

You’ll join the broader Search and AI Platform organization and collaborate with ML researchers and engineers from our Voyage.ai acquisition. Together, we’re building infrastructure for real‑time, low‑latency, and high‑scale inference — fully integrated with Atlas and designed for developer‑first experiences.

As a Senior Engineer, you'll focus on building core systems and services that power model inference at scale. You'll own key components of the infrastructure, work across teams to ensure tight integration with Atlas, and contribute to a platform designed for reliability, performance, and ease of use.

We are looking to speak to candidates who are based in Palo Alto or Seattle for our hybrid working model.

What You’ll Do

• Design and build components of a multi‑tenant inference platform integrated directly with MongoDB Atlas, supporting semantic search and hybrid retrieval
• Collaborate with AI engineers and researchers to productionize inference for embedding models and rerankers — enabling both batch and real‑time use cases
• Contribute to platform capabilities such as latency‑aware routing, model versioning, health monitoring, and observability
• Improve performance, autoscaling, GPU utilization, and resource efficiency in a cloud‑native environment. Work across product, infrastructure, and ML teams to ensure the inference platform meets the scale, reliability, and latency demands of Atlas users
• Gain hands‑on experience with tools like vLLM and container orchestration with Kubernetes

Who You Are

Nice to Have

Understanding of hybrid retrieval, prompt‑driven systems, or retrieval‑augmented generation (RAG)

Contributions to open‑source infrastructure for ML serving or search

Why Join Us

To drive the personal growth and business impact of our employees, we’re committed to developing a supportive and enriching culture for everyone. From employee affinity groups, to fertility assistance and a generous parental leave policy, we value our employees’ wellbeing and want to support them along every step of their professional and personal journeys. Learn more about what it’s like to work at MongoDB, and help us make an impact on the world!

MongoDB is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request an accommodation due to a disability, please inform your recruiter.

MongoDB, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type and makes all hiring decisions without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

MongoDB’s base salary range for this role in the U.S. is :

$118,000 — $231,000 USD

#J-18808-Ljbffr