Senior Infrastructure EngineerVast.ai • San Francisco, CA, United States
Senior Infrastructure Engineer
Vast.ai • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]Distributed Systems : Experience building high‑throughput backend systems or compute clouds Compute Orchestration : Familiarity with Docker, or custom scheduling frameworks GPU Infrastructure : Understanding of GPU provisioning, driver management, and workload scheduling Billing & Metering : Implemented or integrated usage‑based billing and account credit systems Marketplace Dynamics : Knowledge of dynamic pricing, spot instances, or supply‑demand balancing mechanisms Security & Multi‑Tenancy : Experience designing secure, multi‑tenant systems in cloud environments Programming : Strong programming skills in Python and C++; ability to write performant, maintainable, well‑architected code Database Expertise : Comfortable designing schemas and queries for large‑scale data systems (PostgreSQL preferred) Experience with GPU security, virtualization, or zero‑trust compute isolation Prior startup experience or end‑to‑end product ownership Improve the backend systems that power Vast.ai’s compute marketplace Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs Develop scalable infrastructure for workload scheduling and resource management Optimize pricing and marketplace logic for efficiency and transparency Collaborate with product and infrastructure teams to shape the future of decentralized compute 15 min – Initial screening with member of your future team (virtual) 40 min – Systems and architectures (virtual) 1 hour – LLM‑assisted coding assessment (virtual) 2 hours – Meet and greet with coding assessment (on‑site) Comprehensive health, dental, vision, and life insurance 401(k) with company match Meaningful early‑stage equity Onsite meals, snacks, and close collaboration with founders and tech leads Ambitious, fast‑paced startup culture where initiative is rewarded
About Us
Vast.ai’s cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.
Job Title
Staff Infrastructure Engineer
Location
On-site at our office in San Francisco or Westwood, Los Angeles.
About the Role
As a Senior Infrastructure Engineer, you will help design and scale the core systems that play the role of Vast.ai’s global GPU marketplace. You’ll work closely with our founders and core engineering team to extend the underlying compute infrastructure — from GPU provisioning and scheduling to billing, orchestration, and marketplace dynamics. We’re looking for someone who has previously built large‑scale infrastructure platforms — systems with similarities to Vast.ai, or distributed compute orchestration frameworks.
Tech Stack
- Python, C++, PostgreSQL, Linux, Docker, KVM, Redis, Terraform, AWS, REST / gRPC APIs
Ideal Experience
Bonus Points
Key Responsibilities
Benchmark, profile, and harden systems for performance, reliability, and fault tolerance
Interview Process (≈ 1 week)
Annual Salary Range
$180,000 – $300,000 + equity + benefits
Benefits
#J-18808-Ljbffr
[job_alerts.create_a_job]
Senior Infrastructure Engineer • San Francisco, CA, United States
[internal_linking.related_jobs]
Join a ground-breaking AI platform company, founded by top AI researchers and successful entrepreneurs, that is building the first Agentic AI Platform for SAP Custom Code.This critical infrastructu...[show_more]
Get AI-powered advice on this job and more exclusive features.This range is provided by Ikuto.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Di...[show_more]
Crossing Hurdles is a global recruitment consultancy firm that assists our clients to hire best talent.It is a cutting-edge AI organization focused on end-to-end SAP custom code modernization, aimi...[show_more]
Arch is a Series B financial technology company that automates the management of private investments, improving access, understanding, and the human experience of investing across asset classes.Pri...[show_more]
Senior Infrastructure Engineer.Direct message the job poster from Commerce.Welcome to the Agentic Commerce Era.At Commerce, our mission is to empower businesses to innovate, grow, and thrive with o...[show_more]
Macroscope aims to be the source of truth of what's happening for any company that builds software.Our mission is to give leaders clarity and engineers time.
We help leaders understand how their pro...[show_more]
Crusoe's mission is to accelerate the abundance of energy and intelligence.We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, spe...[show_more]
Senior Technical Recruiter at Scion Staffing.Senior Infrastructure Engineer.AI infrastructure solutions company in San Francisco!.
This is a full‑time, direct hire position with a hybrid schedule in...[show_more]
Annual Bonus, Sign-on bonus, RSUs, and Stock options.Join a dynamic startup seeking an infrastructure specialist to design, scale, and maintain cutting-edge infrastructure that powers innovative di...[show_more]
Build the future of adaptable intelligence.November 30, 2025 at 8 : 00 AM GMT.We believe the future is adaptable, and not one-size-fits-all.
We will lead in real-time efficient adaptation that combine...[show_more]
Join a ground-breaking AI platform company, founded by top AI researchers and successful entrepreneurs, that is building the first Agentic AI Platform for SAP Custom Code.This critical infrastructu...[show_more]
At Delphi, we are redefining how knowledge is shared by creating a new medium for human communication : .The internet gave us static profiles and endless feeds.
Delphi is something different : a living...[show_more]
Senior Infrastructure Engineer (External).Our client is a leading institutional investment platform in the digital asset space, providing comprehensive infrastructure and technology for investors t...[show_more]
We believe in using space to help life on Earth.Planet designs, builds, and operates the largest constellation of imaging satellites in history.
This constellation delivers an unprecedented dataset ...[show_more]
Alaris Security is building the core technology stack for intelligent cyber security.Designed for enterprise and defense organizations, our platform unifies security data through our proprietary gr...[show_more]
BitGo is the leading infrastructure provider of digital asset solutions, delivering custody, wallets, staking, trading, financing, and settlement services from regulated cold storage.Since our foun...[show_more]
From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large-scale AI datasets, LanceDB is the best foundation for your AI appli...[show_more]
A leading B2B marketing platform is seeking a Software Engineer to develop cloud infrastructure and support product engineering teams.
This role emphasizes collaboration, mentorship, and the impleme...[show_more]
Senior Infrastructure Engineer
Hamilton Barnes • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure & Deployment Engineer
Ikuto • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure Engineer
Crossing Hurdles • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure Engineer
Menlo Ventures • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure Engineer
Commerce • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Infrastructure Engineer
Macroscope Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure Engineer
Crusoe Energy Systems LLC • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Infrastructure Engineer
Scion Staffing • San Francisco, CA, United States
[job_card.permanent] +1
[last_updated.last_updated_variable_days] • [promoted]
Senior Cloud Infrastructure Engineer
Harrison Clarke • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure Engineer
Adaption Labs • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure Engineer
Hamilton Barnes? • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure Engineer
Delphi • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure Engineer (External)
Serotonin Inc • San Francisco, California, United States, 94101
[job_card.full_time]
[last_updated.last_updated_variable_days]
Senior Cloud Engineer (Network)
Planet Labs PBC • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_30] • [promoted]
Senior Infrastructure Engineer
Alaris • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Infrastructure Engineer - InfraOps
BitGo, Inc. • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Cloud Infrastructure Engineer
LanceDB • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]
Senior Cloud Infrastructure Engineer
Qualified • San Francisco, CA, United States
[job_card.full_time]
[last_updated.last_updated_variable_days] • [promoted]