Talent.com
Principal Software Engineer - AI Systems
Principal Software Engineer - AI SystemsODAIA • Sunnyvale, CA, United States
Principal Software Engineer - AI Systems

Principal Software Engineer - AI Systems

ODAIA • Sunnyvale, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Position Summary...

What you’ll do... What you’ll do

1. AI Systems Engineering

  • Design and implement large-scale, production-grade AI systems that integrate LLMs and Generative AI into real-world applications.
  • Build frameworks that support Retrieval-Augmented Generation (RAG), agentic workflows, and multi-step reasoning at scale.
  • Ensure models and agents are production-ready with strong observability, monitoring, and performance optimization.

2. Architecture & Scalability

  • Architect distributed, fault-tolerant systems capable of supporting high-throughput AI workloads.
  • Lead the design of modular, extensible, and reusable components to accelerate AI adoption across teams.
  • Build MVPs quickly, validate assumptions, and iterate toward scalable long-term solutions.
  • 3. Integration & Delivery

  • Partner with product and platform teams to integrate AI into customer-facing and enterprise-grade applications.
  • Define and enforce standards for APIs, services, and infrastructure that enable seamless AI adoption.
  • Balance functional requirements with non-functional goals such as reliability, latency, and security.
  • 4. Leadership & Mentorship

  • Drive technical strategy for AI initiatives and guide teams in best practices for AI‑driven software development.
  • Mentor engineers across software and AI domains to elevate overall technical expertise.
  • Contribute to thought leadership in AI engineering through internal frameworks, design patterns, and reusable components.
  • What you’ll bring

  • 12+ years of experience in software engineering (backend, distributed systems, large‑scale platforms), with 2+ years applying Generative AI / LLMs in production.
  • Proven expertise in distributed computing, cloud-native architectures (GCP, Azure, or AWS), and systems that prioritize scalability and fault tolerance.
  • Strong coding skills in Python (preferred) and at least one system‑level language (Java, Go, or C++).
  • Experience with ML / AI frameworks (PyTorch, TensorFlow, Hugging Face) as a plus, but applied in the context of building systems, not just training models.
  • Deep knowledge of RAG pipelines, vector databases, and real‑time data integration.
  • Familiarity with resilience engineering : disaster recovery, failover, monitoring, and high availability.
  • Exposure to multi‑modal AI (text, image, video) and optimization techniques (quantization, distillation) is advantageous.
  • Strong grounding in system design, performance engineering, and design patterns.
  • Track record of delivering production systems with AI at scale, not just research or prototyping.
  • Key Positioning Shift

  • Moved model training / fine‑tuning to secondary importance → framed as a plus, not the core.
  • Emphasized distributed systems, cloud, APIs, reliability, and software engineering fundamentals.
  • Framed role as “AI Systems Engineer” / “AI Engineer” instead of “ML Engineer.”
  • Highlighted production integration and customer‑facing impact, which appeals to senior software engineers.
  • Equal Opportunity Employer

    Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing unique styles, experiences, identities, ideas, and opinions – while being inclusive of all people.

    At Walmart, we offer competitive pay as well as performance‑based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company‑paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short‑term and long‑term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.

    You will also receive PTO and / or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.

    For information about PTO, see https : / / one.walmart.com / notices.

    Live Better U is a Walmart‑paid education benefit program for full‑time and part‑time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short‑form certificates. Tuition, books, and fees are completely paid for by Walmart.

    Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.

    For information about benefits and eligibility, see One.Walmart.

    The annual salary range for this position is $143,000.00-$286,000.00

    Additional compensation includes annual or quarterly performance bonuses.

    Additional compensation for certain positions may also include :

  • Stock
  • Minimum Qualifications

  • Option 1 : Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years’ experience in software engineering or related area.
  • Option 2 : 7 years’ experience in software engineering or related area.
  • Preferred Qualifications

  • Master’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years' experience in software engineering or related area. We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture.
  • Primary Location

    1395 Crossman Ave, Sunnyvale, CA 94089-1114, United States of America

    Walmart and its subsidiaries are committed to maintaining a drug‑free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Principal Engineer Ai • Sunnyvale, CA, United States

    [internal_linking.related_jobs]
    Sr. Software Engineer - AI / LLM Applications (26456)

    Sr. Software Engineer - AI / LLM Applications (26456)

    Supermicro • San Jose, CA, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer, AI Products

    Software Engineer, AI Products

    Xai • Palo Alto, California, United States
    [job_card.full_time]
    AI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excelle...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer - AI Systems

    Principal Software Engineer - AI Systems

    ODAIA • Sunnyvale, CA, US
    [job_card.full_time] +1
    Design and implement large-scale, production-grade AI systems that integrate LLMs and Generative AI into real-world applications. Build frameworks that support Retrieval-Augmented Generation (RAG), ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Engineer Software (AiOps)

    Principal Engineer Software (AiOps)

    Palo Alto Networks • Santa Clara, California, United States
    [job_card.full_time]
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, AI for Quantum

    Senior Software Engineer, AI for Quantum

    PsiQuantum • Palo Alto, CA, United States
    [job_card.full_time]
    PsiQuantum'smission is to build the first useful quantum computers-machines capable of delivering the breakthroughs the field has long promised. Since our founding in 2016, our singular focus has be...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, AI Platform

    Senior Software Engineer, AI Platform

    Linkedin • Mountain View, California, United States
    [job_card.full_time]
    LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover excit...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Software Engineer, Core AI

    Staff Software Engineer, Core AI

    Floqast • San Jose, California, United States
    [job_card.full_time]
    As a Staff AI Engineer on our Core AI team, you will be a cornerstone of FloQast's AI transformation.You will architect, build, and scale the AI products that power our accounting automation platfo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    Supermicro • San Jose, CA, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    Cisco Systems, Inc. • San Jose, CA, United States
    [job_card.full_time]
    The application window has been extended to 12 / 24 / 2025.Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received.Strong preference for Bay ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Software Engineer

    AI Software Engineer

    VirtualVocations • Fremont, California, United States
    [job_card.full_time]
    A company is looking for an AI Software Engineer I to help build core features and pipelines for their AI platform.Key Responsibilities Build AI-enabled product features such as chat, recommendat...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    Elastic • Mountain View, CA, United States
    [job_card.full_time]
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer - AI Platform Security Core Engineering

    Principal Software Engineer - AI Platform Security Core Engineering

    Servicenow • Santa Clara, California, United States
    [job_card.full_time]
    It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    VirtualVocations • Fremont, California, United States
    [job_card.full_time]
    A company is looking for a Senior Software Engineer, AI Product.Key Responsibilities Build and refine early-stage AI systems and frameworks to enhance user experiences Guide AI innovation by col...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal AI Engineer

    Principal AI Engineer

    TENEX.AI • San Jose, California, United States
    [job_card.full_time]
    TENEX is an AI-native, automation-first, built-for-scale Managed Detection and Response (MDR) provider.We are a force multiplier for defenders, helping organizations enhance their cybersecurity pos...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI Systems Performance Engineer

    Senior AI Systems Performance Engineer

    Sambanova Systems • Palo Alto, California, United States
    [job_card.full_time]
    The era of pervasive AI has arrived.In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI System Engineer, Sr. Staff

    AI System Engineer, Sr. Staff

    Sk Hynix America • San Jose, California, United States
    [job_card.full_time]
    Job Title : AI System Engineer, Sr.At SK hynix America, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data center...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    Fortinet • Santa Clara, CA, United States
    [job_card.full_time]
    Design and implement platform-level systems.Build scalable, highly available, and cost-efficient services that support.Collaborate with Product and Engineering stakeholders to define functional spe...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Elasticsearch - Principal Software Engineer II - Vector Search

    Elasticsearch - Principal Software Engineer II - Vector Search

    Elastic • Mountain View, CA, United States
    [job_card.full_time]
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...[show_more]
    [last_updated.last_updated_30] • [promoted]