Talent.com
Senior Software Engineer - Infrastructure
Senior Software Engineer - InfrastructureBaseten • Salida, CA, United States
Senior Software Engineer - Infrastructure

Senior Software Engineer - Infrastructure

Baseten • Salida, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

About Baseten

Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors including IVP, Spark Capital, Greylock, and Conviction, we're trusted by leading AI-driven innovators like Writer, Abridge, Bland, Patreon, Descript, Retool, and Zed to deliver industry-leading performance, security, and reliability for their mission-critical workloads. With our recent $75M Series C funding, we're growing fast to make AI accessible across all products.

The Role

As a Senior Infrastructure Software Engineer at Baseten, you'll architect and lead development of our ML inference platform that powers production AI applications. You'll make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor ML models with high performance and reliability.

Example Initiatives

You'll get to work on these types of projects as part of our Infrastructure team :

  • Multi-cloud capacity management
  • Inference on B200 GPUs
  • Multi-node inference
  • Fractional H100 GPUs for efficient model serving

Responsibilities

  • Design and architect scalable infrastructure systems for our ML inference platform
  • Lead optimization of Kubernetes deployments for efficient, cost-effective model serving
  • Drive enhancements to our inference orchestration layer for complex model deployments
  • Define monitoring strategies for model performance, latency, and resource utilization
  • Develop advanced solutions for GPU capacity management and throughput optimization
  • Establish infrastructure automation standards to streamline ML deployment workflows
  • Partner with other engineers to translate complex inference requirements into technical solutions
  • Make critical architectural decisions balancing performance with system reliability
  • Lead technical discussions and mentor junior engineers on infrastructure best practices
  • Contribute to long-term technical strategy and infrastructure roadmap
  • Requirements

  • Bachelor's degree or higher in Computer Science or related field
  • 5+ years experience building production infrastructure systems
  • Expert-level proficiency in Go, with Python experience a plus
  • Deep expertise with Kubernetes in production environments
  • Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) a plus.
  • Advanced understanding of distributed systems concepts and performance tuning
  • Proven experience designing observability systems
  • Track record of leading technical initiatives and mentoring engineers
  • Experience with ML / AI workloads and MLOps platforms highly valued
  • Benefits

  • Competitive compensation package (Flexible PTO, 401k, covered healthcare premiums).
  • This is a unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.
  • An inclusive and supportive work culture that fosters learning and growth.
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
  • Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

    At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

    [job_alerts.create_a_job]

    Senior Software Engineer Infrastructure • Salida, CA, United States

    [internal_linking.similar_jobs]
    Diver

    Diver

    US Navy • Modesto, California, United States
    [job_card.part_time]
    Navy Divers go where few can-into the depths of the sea to execute critical underwater operations that keep the Navy moving and missions on track. From salvaging sunken wreckage and repairing ships ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Structural Project Engineer Engineering Excellence Starts Here

    Structural Project Engineer Engineering Excellence Starts Here

    TETER, Inc • Modesto, CA, US
    [job_card.full_time]
    Fresno, Visalia, Bakersfield, or Modesto, California.TETER is seeking a highly skilled and motivated.Structural Project Engineer I–II. This role is ideal for a licensed Structural Engineer wit...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    General Manager

    General Manager

    Popeyes-14210- Patterson • Patterson, CA, US
    [job_card.full_time]
    The Restaurant General Manager is the executive leader of the restaurant focused on profitability, Guest, people and operations. The RGM has overall responsibility for managing the daily operations ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    PLANT ENGINEER MODESTO

    PLANT ENGINEER MODESTO

    Kingspan Insulated Panels Inc • Modesto, CA, US
    [job_card.full_time]
    Kingspan Insulated Panels North America, a division of the Kingspan Group plc headquartered in Ireland, is a global and trusted leader in the design, manufacturing, and supply of high-performance s...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, Fiat Rails

    Senior Software Engineer, Fiat Rails

    Paxos • Salida, CA, United States
    [job_card.full_time]
    Join Our Team as a Senior Software Engineer!.Are you a passionate software engineer looking for an exciting opportunity? We are seeking a talented individual to join our team as a Senior Software E...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Business Account Executive

    Business Account Executive

    SPECTRUM • TURLOCK, California, United States
    [job_card.full_time]
    This role requires the ability to work lawfully in the U.As a Spectrum B2B Outside Sales Account Executive, you will sell Spectrum’s internet, voice and video services to small businesses door-to-d...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Restaurant Delivery

    Restaurant Delivery

    DoorDash • Lockeford, California, United States
    [job_card.full_time] +1
    Why Deliver with DoorDash? DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, youll ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Information Systems Specialist - Networking & Operations / Information Technology - Central Services

    Information Systems Specialist - Networking & Operations / Information Technology - Central Services

    InsideHigherEd • Modesto, California, United States
    [job_card.full_time] +1
    Information Systems Specialist - Networking & Operations / Information Technology - Central Services.Yosemite Community College District / Central Services. Range 41 (2024-2025 Classified Salary Schedu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Certified OR Tech

    Certified OR Tech

    Doctors Medical Center of Modesto • Modesto, CA, US
    [job_card.full_time]
    Doctors Medical Center of Modesto Hospital is committed to providing exceptional patient care in a supportive and collaborative environment. As a member of our team, you will have the opportunity to...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Continuous Improvement Engineer (West Coast Based)

    Sr. Continuous Improvement Engineer (West Coast Based)

    Divert • Turlock, CA, US
    [job_card.full_time]
    Ideal candidates for this position will be located on the West Coast and will travel to and partner with our facilities across the US up to 30% annually. Applicants who are located on the West Coast...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Controls Engineer (Ignition Specialist)

    Senior Controls Engineer (Ignition Specialist)

    Factory Technologies • Modesto, CA, US
    [job_card.full_time]
    Systems Integrator located in Modesto CA.Controls Engineer (Ignition Specialist).This position requires development work within an office environment and support at client sites.This is not a remot...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Regional Director of Diagnostic Imaging

    Regional Director of Diagnostic Imaging

    Emanuel Medical Ctr • Keyes, CA, US
    [job_card.full_time]
    Welcome to Emanuel Medical Center.Since 1917, Emanuel has been the heart of healthcare in Turlock, California, providing incredible high-quality care with compassion to the patients we serve.We are...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Development Engineer

    Software Development Engineer

    Amazon • Oakdale, CA, USA
    [job_card.full_time]
    Join Amazon's engineering team and help us build innovative solutions to complex problems.As a Software Development Engineer, you will design, develop, and test software applications and services.W...[show_more]
    [last_updated.last_updated_30]
    SAP Functional Analyst (PP)

    SAP Functional Analyst (PP)

    Associated Feed & Supply • Turlock, CA, US
    [job_card.full_time] +1
    Job Title : SAP Functional Analyst (PP)Department : Information Technology.Full / Part-Time : Full-TimeLocation : Remote or Onsite in Turlock, CA FLSA Status : Exempt Shift : Days Rate of Pay : $...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Construction Management Representative

    Construction Management Representative

    Project Solutions Inc. • Modesto, CA, US
    [job_card.full_time]
    El Portal Administrative Area, Yosemite National Park, CA.Management Representative for an exciting opportunity at Yosemite National Park. Join our growing team of professionals who are committed to...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Surgical Tech - $1,399 to $1,488 per week in Turlock, CA

    Travel Surgical Tech - $1,399 to $1,488 per week in Turlock, CA

    AlliedTravelCareers • Turlock, CA, US
    [job_card.full_time]
    AlliedTravelCareers is working with Fusion Medical Staffing to find a qualified Surg Tech in Turlock, California, 95382!. Facility in Turlock, California.Fusion Medical Staffing is seeking a skilled...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer, Windows / Desktop Applications - Modesto, USA

    Senior Software Engineer, Windows / Desktop Applications - Modesto, USA

    Speechify • Modesto, CA, US
    [job_card.full_time]
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Remote Senior Accountant - AI Trainer ($50-$60 / hour)

    Remote Senior Accountant - AI Trainer ($50-$60 / hour)

    Data Annotation • Turlock, California
    [filters.remote]
    [job_card.full_time] +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]