Talent.com
Principal Software Engineer - AI Systems
Principal Software Engineer - AI SystemsODAIA • Sunnyvale, CA, United States
Principal Software Engineer - AI Systems

Principal Software Engineer - AI Systems

ODAIA • Sunnyvale, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Position Summary...

What you’ll do... What you’ll do

1. AI Systems Engineering

  • Design and implement large-scale, production-grade AI systems that integrate LLMs and Generative AI into real-world applications.
  • Build frameworks that support Retrieval-Augmented Generation (RAG), agentic workflows, and multi-step reasoning at scale.
  • Ensure models and agents are production-ready with strong observability, monitoring, and performance optimization.

2. Architecture & Scalability

  • Architect distributed, fault-tolerant systems capable of supporting high-throughput AI workloads.
  • Lead the design of modular, extensible, and reusable components to accelerate AI adoption across teams.
  • Build MVPs quickly, validate assumptions, and iterate toward scalable long-term solutions.
  • 3. Integration & Delivery

  • Partner with product and platform teams to integrate AI into customer-facing and enterprise-grade applications.
  • Define and enforce standards for APIs, services, and infrastructure that enable seamless AI adoption.
  • Balance functional requirements with non-functional goals such as reliability, latency, and security.
  • 4. Leadership & Mentorship

  • Drive technical strategy for AI initiatives and guide teams in best practices for AI‑driven software development.
  • Mentor engineers across software and AI domains to elevate overall technical expertise.
  • Contribute to thought leadership in AI engineering through internal frameworks, design patterns, and reusable components.
  • What you’ll bring

  • 12+ years of experience in software engineering (backend, distributed systems, large‑scale platforms), with 2+ years applying Generative AI / LLMs in production.
  • Proven expertise in distributed computing, cloud-native architectures (GCP, Azure, or AWS), and systems that prioritize scalability and fault tolerance.
  • Strong coding skills in Python (preferred) and at least one system‑level language (Java, Go, or C++).
  • Experience with ML / AI frameworks (PyTorch, TensorFlow, Hugging Face) as a plus, but applied in the context of building systems, not just training models.
  • Deep knowledge of RAG pipelines, vector databases, and real‑time data integration.
  • Familiarity with resilience engineering : disaster recovery, failover, monitoring, and high availability.
  • Exposure to multi‑modal AI (text, image, video) and optimization techniques (quantization, distillation) is advantageous.
  • Strong grounding in system design, performance engineering, and design patterns.
  • Track record of delivering production systems with AI at scale, not just research or prototyping.
  • Key Positioning Shift

  • Moved model training / fine‑tuning to secondary importance → framed as a plus, not the core.
  • Emphasized distributed systems, cloud, APIs, reliability, and software engineering fundamentals.
  • Framed role as “AI Systems Engineer” / “AI Engineer” instead of “ML Engineer.”
  • Highlighted production integration and customer‑facing impact, which appeals to senior software engineers.
  • Equal Opportunity Employer

    Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing unique styles, experiences, identities, ideas, and opinions – while being inclusive of all people.

    At Walmart, we offer competitive pay as well as performance‑based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company‑paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short‑term and long‑term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.

    You will also receive PTO and / or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.

    For information about PTO, see https : / / one.walmart.com / notices.

    Live Better U is a Walmart‑paid education benefit program for full‑time and part‑time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short‑form certificates. Tuition, books, and fees are completely paid for by Walmart.

    Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.

    For information about benefits and eligibility, see One.Walmart.

    The annual salary range for this position is $143,000.00-$286,000.00

    Additional compensation includes annual or quarterly performance bonuses.

    Additional compensation for certain positions may also include :

  • Stock
  • Minimum Qualifications

  • Option 1 : Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years’ experience in software engineering or related area.
  • Option 2 : 7 years’ experience in software engineering or related area.
  • Preferred Qualifications

  • Master’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years' experience in software engineering or related area. We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture.
  • Primary Location

    1395 Crossman Ave, Sunnyvale, CA 94089-1114, United States of America

    Walmart and its subsidiaries are committed to maintaining a drug‑free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Principal Engineer Ai • Sunnyvale, CA, United States

    [internal_linking.related_jobs]
    Principal Engineer Software (AiOps)

    Principal Engineer Software (AiOps)

    Palo Alto Networks • Santa Clara, California, United States
    [job_card.full_time]
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. Software Engineer - AI / LLM Applications (26456)

    Sr. Software Engineer - AI / LLM Applications (26456)

    Supermicro • San Jose, CA, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal AIOps Engineer, Enterprise AI Platform

    Principal AIOps Engineer, Enterprise AI Platform

    Palo Alto Networks • Santa Clara, California, United States
    [job_card.full_time]
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer ( Sr Architect )

    Principal Software Engineer ( Sr Architect )

    Blue Yonder • Palo Alto, CA, United States
    [job_card.full_time]
    We are seeking an experienced Principal Software Engineer to lead a team of product engineers in designing, developing, and implementing AI-driven solutions at Blue Yonder and provide strategic tec...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal AI Architect : Agentic AI Systems Lead

    Principal AI Architect : Agentic AI Systems Lead

    Zoom • San Jose, CA, United States
    [job_card.full_time]
    A leading video communications company is seeking a Principal AI Architect to design and oversee intelligent agent systems within the Zoom AI Companion team. The role involves creating scalable fram...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Principal Software Engineer

    Principal Software Engineer

    Supermicro • San Jose, CA, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    Cisco Systems, Inc. • San Jose, CA, United States
    [job_card.full_time]
    The application window has been extended to 12 / 24 / 2025.Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received.Strong preference for Bay ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Platform Architect, Agentic AI

    Principal Platform Architect, Agentic AI

    NVIDIA • Santa Clara, CA, United States
    [job_card.full_time]
    Principal Platform Architect, Agentic AI.NVIDIA has been transforming accelerated computing with innovation that’s fueled by great technology—and amazing people. As part of Nvidia's applied AI team ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    Elastic • Mountain View, CA, United States
    [job_card.full_time]
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer - AI Platform Security Core Engineering

    Principal Software Engineer - AI Platform Security Core Engineering

    Servicenow • Santa Clara, California, United States
    [job_card.full_time]
    It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal AI Engineer

    Principal AI Engineer

    TENEX.AI • San Jose, California, United States
    [job_card.full_time]
    TENEX is an AI-native, automation-first, built-for-scale Managed Detection and Response (MDR) provider.We are a force multiplier for defenders, helping organizations enhance their cybersecurity pos...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    Fortinet • Santa Clara, CA, United States
    [job_card.full_time]
    Design and implement platform-level systems.Build scalable, highly available, and cost-efficient services that support.Collaborate with Product and Engineering stakeholders to define functional spe...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal AI / ML System Software Engineer

    Principal AI / ML System Software Engineer

    d-Matrix • Santa Clara, CA, United States
    [job_card.full_time]
    AI to power the transformation of technology.We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. We value humility and believe in direct communic...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Systems Engineer – Cloud Infra & Automation

    Principal Systems Engineer – Cloud Infra & Automation

    NVIDIA Corporation • Santa Clara, CA, United States
    [job_card.full_time]
    A leading technology company is seeking a Principal Systems Software Engineer to manage and design scalable software systems for their cloud infrastructure. Candidates should have over 15 years of e...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Generative AI Engineer

    Principal Generative AI Engineer

    SAP SE • Palo Alto, CA, United States
    [job_card.full_time]
    At SAP, we keep it simple : you bring your best to us, and we'll bring out the best in you.We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to h...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Elasticsearch - Principal Software Engineer II - Vector Search

    Elasticsearch - Principal Software Engineer II - Vector Search

    Elastic • Mountain View, CA, United States
    [job_card.full_time]
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...[show_more]
    [last_updated.last_updated_30] • [promoted]