Talent.com
Principal Cloud Backend Engineer
Principal Cloud Backend EngineerSambanova Systems • Palo Alto, California, United States
Principal Cloud Backend Engineer

Principal Cloud Backend Engineer

Sambanova Systems • Palo Alto, California, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale.

About The Role

We are seeking a highly skilled and experienced Principal or Senior Principal Cloud Backend Engineer to architect and build the core platform that powers our large-scale AI inference services, with a critical focus on enabling flexible billing and monetization strategies. You will own the design and implementation of the systems that not only ensure reliability and scalability but also directly unlock new revenue streams and business models for our AI services.

This is a high-impact role where you will solve complex challenges at the intersection of cloud-native AI infrastructure, metering, and monetization. You will build the foundational systems for usage-based pricing, subscription plans, and dynamic entitlements that serve as the economic engine for our business. If you are passionate about building platforms that are both technically robust and commercially critical, we want to hear from you.

Key Responsibilities

  • Platform Architecture & Strategy : Lead the technical vision and architecture for our inference serving and monetization platform. Design systems that are fault-tolerant, highly available, and can scale to meet growing demand while accurately tracking usage for billing.
  • Monetization Platform Design : Architect the core systems for flexible monetization, including :
  • Entitlements & Quota Management : Designing a flexible system to define and enforce complex usage plans, rate limits, and access policies.
  • Usage Metering & Aggregation : Building a highly reliable and accurate system to meter usage (e.g., tokens, requests) at scale and prepare data for billing.
  • Billing Integration : Designing clean abstractions and APIs to seamlessly integrate with external billing and payment providers (e.g., Stripe, Metronome).
  • Distributed Systems Design : Architect and implement complex distributed systems involving real-time rate limiting, quota enforcement, and fair-share scheduling for a multi-tenant environment.
  • Performance & Cost Optimization : Identify and eliminate bottlenecks in the end-to-end system, ensuring low-latency request handling while maintaining precise financial accuracy.
  • Technical Leadership : Serve as a technical leader and mentor. Establish best practices in code quality, testing, and observability for business-critical financial data pipelines.
  • Cross-Functional Collaboration : Work closely with Product Management, Finance, and GTM teams to translate business requirements for new pricing models (e.g., subscriptions, pay-as-you-go, custom enterprise plans) into scalable technical solutions.

Required Qualifications (Senior Principal Level)

  • 10 + years of experience in software engineering, with a significant focus on designing and building large-scale, distributed backend systems in cloud environments.
  • 5 + years in a Principal or Lead Engineer role, with a proven track record of architecting, delivering, and operating business-critical platforms.
  • Expert proficiency in one or more of the following : Go, Rust and C++. Deep understanding of concurrency, performance optimization, and systems programming.
  • Deep, hands-on experience with cloud-native technologies (Kubernetes, Docker, etc.) and major cloud providers (AWS, GCP, Azure).
  • Extensive experience with both SQL and NoSQL databases (e.g., PostgreSQL, Redis) and designing data models for high-throughput, low-latency applications.
  • Strong foundation in API design (REST, gRPC), event-driven architecture, and building resilient microservices.
  • Excellent communication and leadership skills, with the ability to drive technical consensus and articulate complex concepts to a diverse audience.
  • Preferred Qualifications

  • Direct Monetization / Billing Experience : Proven experience building or significantly extending platforms for usage-based metering, subscription management, entitlements, or billing systems. Experience with billing providers (e.g., Stripe,Metronome) is a strong plus.
  • Experience in AI / ML Infrastructure : Direct experience building or operating platforms for serving, scaling, and managing AI models (e.g., inference servers, model deployment pipelines).
  • What You'll Work On

    As a key leader on our team, you will be at the forefront of building the economic backbone of our inference platform. Your work will directly impact our ability to :

  • Launch New Business Models : Enable product-led growth through self-service plans, automatic upgrades, pay-as-you-go pricing, and custom enterprise agreements.
  • Monetize Efficiently : Create a flexible platform that allows our business to experiment with and deploy new pricing strategies rapidly without complex engineering changes.
  • Ensure Financial Accuracy : Build robust, auditable systems for metering usage and generating billing events with high reliability.
  • Scale Economically : Design systems that dynamically manage resources and costs, tying infrastructure efficiency directly to business metrics.
  • You will be solving challenging problems at the intersection of distributed systems, cloud infrastructure, and commercial strategy, making our monetization platform a key competitive advantage.

    How to Apply

    Please submit your resume along with a cover letter. In your cover letter, we encourage you to describe your experience with a large-scale system you've architected, particularly any involving billing, entitlements, or monetization. Highlight the challenges you faced in ensuring scalability, reliability, and accuracy, and how you overcame them.

    Submission Guidelines

    Please note that in order to be considered an applicant for any position at SambaNova Systems, you must submit an application form for each position for which you believe you are qualified.

    EEO Policy

    SambaNova Systems is an Equal Opportunity / Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard basis of age (40 and over), color, disability, gender identity, genetic information, marital status, military or veteran status, national origin / ancestry, race, religion, creed, sex (including pregnancy, childbirth, breastfeeding), sexual orientation, and any other applicable status protected by federal, state, or local laws.

    Benefits Summary for US-Based, Full-Time Employment Positions

    SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits. We cover 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents and offer a Health Savings Account (HSA) with employer contribution. We also offer Dental, Vision, Short / Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans in addition to Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care. Our library of well-being benefits available to you and your dependents includes a full subscription to Headspace, Gympass+ membership with access to physical gyms, One Medical membership, counseling services with an Employee Assistance Program, and much more.

    [job_alerts.create_a_job]

    Principal Engineer Cloud • Palo Alto, California, United States

    [internal_linking.related_jobs]
    Staff Cloud Backend Engineer

    Staff Cloud Backend Engineer

    Coupand • Mountain View, California, United States
    [job_card.full_time]
    We know we’re doing the right thing when we hear our customers say, "How did we ever live without Coupang?" Born out of an obsession to make shopping, eating, and living easier than ever, we’re col...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Backend Performance Engineer — Hybrid / Remote

    Principal Backend Performance Engineer — Hybrid / Remote

    Zoom Video Communications • San Jose, CA, United States
    [filters.remote]
    [job_card.full_time]
    A leading communication technology company is seeking a Principal Performance Engineer to optimize backend service performance. You will lead efforts to enhance system efficiency, conduct performanc...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal DevOps Engineer

    Principal DevOps Engineer

    Zoom • San Jose, CA, United States
    [job_card.full_time]
    We are seeking a Principal Meeting DevOps Engineer who combines deep technical expertise with broad system understanding. This engineer should be capable of diving into a wide range of services and ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    Supermicro • San Jose, CA, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Platform Engineer : Kubernetes, CI / CD & Scale

    Principal Platform Engineer : Kubernetes, CI / CD & Scale

    Expedia, Inc. • San Jose, CA, United States
    [job_card.full_time]
    A leading travel technology company in San Jose seeks a Principal Software Development Engineer to lead the architecture of a Kubernetes platform. The ideal candidate will have over 8 years of exper...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    Elastic • Mountain View, CA, United States
    [job_card.full_time]
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Full Stack Engineer - Cloud-Native Observability Platform

    Senior Full Stack Engineer - Cloud-Native Observability Platform

    Cisco Systems, Inc. • Milpitas, CA, United States
    [job_card.full_time]
    Senior Full Stack Engineer - Cloud-Native Observability Platform.We are the Catalyst Center Platforms and Capabilities team, responsible for delivering scalable, secure, and high-productivity cloud...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Backend Engineer - Infrastructure

    Backend Engineer - Infrastructure

    Intellipro Group • Palo Alto, California, United States
    [job_card.full_time] +1
    LiveX AI is on a mission to transform how companies engage with customers—before, during, and after the sale—through the power of AI. Backend Engineer - Infrastructure.We’re looking for a hands-on e...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Backend Engineer & Tech Lead (Cloud, Microservices)

    Senior Backend Engineer & Tech Lead (Cloud, Microservices)

    Walmart Canada • Sunnyvale, CA, United States
    [job_card.full_time]
    A leading retail company is seeking an experienced backend developer to enhance their systems and support innovative solutions. The ideal candidate will have over 7 years of experience in backend de...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Backend Engineer, City Storage Systems - Mountain View

    Staff Backend Engineer, City Storage Systems - Mountain View

    City Storage Systems • Mountain View, California, United States
    [job_card.full_time]
    At City Storage Systems, we're building Infrastructure for Better Food.We help restaurateurs around the world succeed in online food delivery. Our goal is to make food more affordable, higher qualit...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Enterprise Cloud Infrastructure Engineer

    Enterprise Cloud Infrastructure Engineer

    InsideHigherEd • Stanford, California, United States
    [job_card.full_time]
    Enterprise Cloud Infrastructure Engineer.Business Affairs : University IT (UIT), Redwood City, California, United States. Information Technology Services📅Sep 05, 2025 Post Date📅107211 Requisi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Backend & Cloud Infrastructure Engineer

    Senior Backend & Cloud Infrastructure Engineer

    ByteDance • San Jose, CA, United States
    [job_card.full_time]
    A leading technology company in San Jose seeks a Senior Software Engineer for backend and infrastructure development.The ideal candidate has robust experience in software development and performanc...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Cloud Backend Engineer

    Staff Cloud Backend Engineer

    Sonatus • Sunnyvale, California, United States
    [job_card.full_time]
    Join a high-performing team at Sonatus that’s redefining what cars can do in the era of Software-Defined Vehicles (SDV).At Sonatus, we’re driving the transformation to AI-enabled software-defined v...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Engineer, Cloud Software

    Principal Engineer, Cloud Software

    Tarana Wireless, Inc. • Milpitas, CA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Join the Team That's Redefining Wireless Technology At Tarana , we're more than just a fast-growing tech company—we’re a team of bold innovators on a mission to revolutionize broa...[show_more]
    [last_updated.last_updated_30]
    Principal DevOps Engineer

    Principal DevOps Engineer

    Zoom Video Communications • San Jose, CA, US
    [job_card.full_time]
    We are seeking a Principal Meeting DevOps Engineer who combines deep technical expertise with broad system understanding. This engineer should be capable of diving into a wide range of services and ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Systems Engineer - Cloud Infra & Automation

    Principal Systems Engineer - Cloud Infra & Automation

    NVIDIA Corporation • Santa Clara, CA, US
    [job_card.full_time]
    A leading technology company is seeking a Principal Systems Software Engineer to manage and design scalable software systems for their cloud infrastructure. Candidates should have over 15 years of e...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Software Engineer Operational Databases

    Principal Software Engineer Operational Databases

    Cloudera • San Jose, CA, United States
    [job_card.full_time]
    At Cloudera, we empower people to transform complex data into clear and actionable insights.With as much data under management as the hyperscalers, we're the preferred data partner for the top comp...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal DevOps Engineer

    Principal DevOps Engineer

    Veeva Systems • Pleasanton, CA, US
    [job_card.full_time]
    Overview Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS compani...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]