Talent.com
Senior Software Engineer - Infrastructure
Senior Software Engineer - InfrastructureBaseten • Salida, CA, United States
Senior Software Engineer - Infrastructure

Senior Software Engineer - Infrastructure

Baseten • Salida, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

About Baseten

Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors including IVP, Spark Capital, Greylock, and Conviction, we're trusted by leading AI-driven innovators like Writer, Abridge, Bland, Patreon, Descript, Retool, and Zed to deliver industry-leading performance, security, and reliability for their mission-critical workloads. With our recent $75M Series C funding, we're growing fast to make AI accessible across all products.

The Role

As a Senior Infrastructure Software Engineer at Baseten, you'll architect and lead development of our ML inference platform that powers production AI applications. You'll make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor ML models with high performance and reliability.

Example Initiatives

You'll get to work on these types of projects as part of our Infrastructure team :

  • Multi-cloud capacity management
  • Inference on B200 GPUs
  • Multi-node inference
  • Fractional H100 GPUs for efficient model serving

Responsibilities

  • Design and architect scalable infrastructure systems for our ML inference platform
  • Lead optimization of Kubernetes deployments for efficient, cost-effective model serving
  • Drive enhancements to our inference orchestration layer for complex model deployments
  • Define monitoring strategies for model performance, latency, and resource utilization
  • Develop advanced solutions for GPU capacity management and throughput optimization
  • Establish infrastructure automation standards to streamline ML deployment workflows
  • Partner with other engineers to translate complex inference requirements into technical solutions
  • Make critical architectural decisions balancing performance with system reliability
  • Lead technical discussions and mentor junior engineers on infrastructure best practices
  • Contribute to long-term technical strategy and infrastructure roadmap
  • Requirements

  • Bachelor's degree or higher in Computer Science or related field
  • 5+ years experience building production infrastructure systems
  • Expert-level proficiency in Go, with Python experience a plus
  • Deep expertise with Kubernetes in production environments
  • Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) a plus.
  • Advanced understanding of distributed systems concepts and performance tuning
  • Proven experience designing observability systems
  • Track record of leading technical initiatives and mentoring engineers
  • Experience with ML / AI workloads and MLOps platforms highly valued
  • Benefits

  • Competitive compensation package (Flexible PTO, 401k, covered healthcare premiums).
  • This is a unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.
  • An inclusive and supportive work culture that fosters learning and growth.
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
  • Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

    At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

    [job_alerts.create_a_job]

    Senior Software Engineer Infrastructure • Salida, CA, United States

    [internal_linking.similar_jobs]
    Structural Project Engineer Engineering Excellence Starts Here

    Structural Project Engineer Engineering Excellence Starts Here

    TETER, Inc • Modesto, CA, US
    [job_card.full_time]
    Fresno, Visalia, Bakersfield, or Modesto, California.TETER is seeking a highly skilled and motivated.Structural Project Engineer I–II. This role is ideal for a licensed Structural Engineer wit...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    City Engineer / Civil Engineer - Public Works

    City Engineer / Civil Engineer - Public Works

    Ardurra Group, Inc. • Oakdale, CA, US
    [job_card.full_time]
    Ardurra is looking to hire an experienced.As the demand to improve municipal infrastructure increases, we recognize the very diverse and unique needs of our municipal clients and we work closely al...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Application Engineer

    Application Engineer

    E Tech Group • Modesto, CA, United States
    [job_card.full_time]
    We're one of the largest engineering and system integration firms in the United States providing value for our clients through IT automation and control solutions for more than 25 years to the Life...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Diver

    Diver

    US Navy • Modesto, California, United States
    [job_card.part_time]
    Navy Divers go where few can-into the depths of the sea to execute critical underwater operations that keep the Navy moving and missions on track. From salvaging sunken wreckage and repairing ships ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Regional Director of Diagnostic Imaging

    Regional Director of Diagnostic Imaging

    Emanuel Medical Ctr • Hughson, CA, US
    [job_card.full_time]
    Welcome to Emanuel Medical Center.Since 1917, Emanuel has been the heart of healthcare in Turlock, California, providing incredible high-quality care with compassion to the patients we serve.We are...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sage X

    Sage X

    Mindsprint • Modesto, CA, United States
    [job_card.full_time]
    Location : Modesto, CA (Hybrid).Travel- Initial couple of months travel to Modesto- Travel expenses will be covered.A Sage X3 Developer job description involves designing, developing, and maintainin...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Survey Engineer Heavy Civil Construction

    Senior Survey Engineer Heavy Civil Construction

    NDL International Inc. • Modesto, CA, United States
    [job_card.full_time]
    A heavy civil construction firm is seeking a Survey Engineer to conduct precise land surveys for various projects.The role is based near Los Banos, CA, with relocation to project sites across the W...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Manager Service Operations Support Application Software

    Senior Manager Service Operations Support Application Software

    Siemens Healthineers • Salida, CA, US
    [job_card.full_time]
    Service Operations Application Software Manager.Join us in pioneering breakthroughs in healthcare.Our inspiring and caring environment forms a global community that celebrates diversity and individ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Engineering Manager, Localization and Site Discovery

    Engineering Manager, Localization and Site Discovery

    Webflow • Salida, CA, US
    [job_card.full_time] +3
    Engineering Manager, Localization and Site Discovery.At Webflow, our mission is to bring development superpowers to everyone. As the pioneer of the Website Experience Platform (WXP), we're redefinin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote Senior Java Engineer - AI Trainer

    Remote Senior Java Engineer - AI Trainer

    SuperAnnotate • Turlock, California, US
    [filters.remote]
    [job_card.full_time]
    As a Senior Java Engineer, you will work remotely on an hourly paid basis to review AI-generated Java code, architectural solutions, and technical explanations, as well as generate high-quality ref...[show_more]
    [last_updated.last_updated_variable_days]
    Senior EMEA Account Executive

    Senior EMEA Account Executive

    Hologram • Salida, CA, US
    [job_card.full_time]
    Hologram is building the future of IoT connectivity, delivering internet access to millions of connected devices worldwide. We process over 5 billion transactions per month across our global infrast...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Development Engineer

    Software Development Engineer

    Amazon • Oakdale, CA, USA
    [job_card.full_time]
    Join Amazon's engineering team and help us build innovative solutions to complex problems.As a Software Development Engineer, you will design, develop, and test software applications and services.W...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Engineer / Developer

    Data Engineer / Developer

    Toogeza • Salida, CA, United States
    [job_card.full_time]
    We are toogeza, a Ukrainian recruiting company that is focused on hiring talents and building teams for tech startups worldwide. People make a difference in the big game, we may help to find the rig...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Sr. Solution Manager

    Sr. Solution Manager

    Bentley • Salida, CA, US
    [job_card.full_time]
    The Solution Managers are the product managers and owners of Industry Solutions within the Industry Solutions Group (ISG). They are responsible for defining and managing the industry solution roadma...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Engineering Manager, Location AI

    Senior Engineering Manager, Location AI

    Mapbox • Salida, CA, US
    [job_card.full_time]
    Senior Engineering Manager of Location AI.Mapbox's Location AI team aims to make Mapbox the go-to platform for all location-based intelligence. We invest in foundational technologies like Model Cont...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Surgical Tech - $1,399 to $1,488 per week in Turlock, CA

    Travel Surgical Tech - $1,399 to $1,488 per week in Turlock, CA

    AlliedTravelCareers • Turlock, CA, US
    [job_card.full_time]
    AlliedTravelCareers is working with Fusion Medical Staffing to find a qualified Surg Tech in Turlock, California, 95382!. Facility in Turlock, California.Fusion Medical Staffing is seeking a skilled...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Data Engineer

    Sr. Data Engineer

    Mondo • Hughson, CA, US
    [job_card.temporary]
    Onsite, Houston, TX (4 days / week, Mon–Thurs).Onsite, Houston, TX (4 days / week, Mon–Thurs) (Remote-Fridays).Compensation Range : $50 - $70 / hr w2. ETL processes, and cloud-based data archit...[show_more]
    [last_updated.last_updated_30] • [promoted]
    ENGINEER LEVEL 1

    ENGINEER LEVEL 1

    USCS • Turlock, CA, United States
    [job_card.full_time]
    Who We Are : USCS is driven to advance, innovate and serve companies seeking the best service, facilities, and logistics in the cold chain. We are employee focused, an equal employment opportunity em...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]