Talent.com
AI Infrastructure Software Architect
AI Infrastructure Software ArchitectKLA • Milpitas, CA, USA
AI Infrastructure Software Architect

AI Infrastructure Software Architect

KLA • Milpitas, CA, USA
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Description

/ Preferred Qualifications

Are you passionate about building the backbone of AI innovation? Join our team as a Sr. AI Infrastructure Software Engineer and help craft the next-generation software infrastructure that powers groundbreaking AI frameworks like CUDA, TensorFlow, PyTorch, and JAX!

This role is ideal for engineers who excel in system-level development and are eager to expand their impact in high-performance computing—driving innovation where complexity meets scale!

Key Responsibilities :

  • Architect and implement robust software infrastructure to support AI / ML workloads across multiple frameworks and hardware platforms.
  • Design and optimize system-level components using C, C++, and Python, ensuring high performance, scalability, and maintainability.
  • Collaborate with multi-functional and cross-divisional teams to integrate AI frameworks (e.g., TensorFlow, PyTorch, JAX, ONNX) into a unified development environment.
  • Lead the development of build systems and toolchains usingMakefiles, CMake, Clang, and GCC.
  • Stay ahead of modern software and AI trends, and guide the team in adopting standard processes and new technologies.
  • Provide technical leadership and mentorship to junior engineers and chip in to long-term architectural decisions.

Required Qualifications :

  • Education & Experience : Advanced degree in Computer Science, Electrical Engineering, or a related field, with a strong background in system-level software development.
  • Programming & Tools : Proficient in C, modern C++, Python, and experienced with Linux development environments. Familiar with build tools (Makefile, CMake), compilers (Clang, GCC), and container technologies (e.g., Kubernetes).
  • Technical Expertise : Deep understanding of software architecture, compiler toolchains, and runtime systems. Experience building infrastructure for AI / ML frameworks or high-performance computing environments.
  • Specialized Skills : Hands-on experience with CUDA, GPU programming, and familiarity with TensorFlow and deep learning model interoperability is a strong plus.
  • multi-functional Impact : Proven track record to develop scalable software infrastructure across multiple divisions or organizations.
  • AI & HPC Knowledge : Strong grasp of modern AI trends, including model optimization, distributed training, and inference acceleration.
  • Communication : Excellent written and verbal communication skills.
  • Preferred Qualifications

  • Experience working with AI accelerators or heterogeneous computing environments.
  • Contributions to open-source AI or systems software projects.
  • Strong collaboration skills, with the ability to influence and align partners across teams and geographies.
  • Minimum Qualifications

    Doctorate (Academic) Degree and related work experience of 5 years; Master's Level Degree and related work experience of 8 years; Bachelor's Level Degree and related work experience of 12 yearsBase Pay Range : $180,000.00 - $306,000.00 AnnuallyPrimary Location : USA-CA-Milpitas-KLAKLA’s total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits including but not limited to : medical, dental, vision, life, and other voluntary benefits, 401(K) including company matching, employee stock purchase program (ESPP), student debt assistance, tuition reimbursement program, development and career growth opportunities and programs, financial planning benefits, wellness benefits including an employee assistance program (EAP), paid time off and paid company holidays, and family care and bonding leave.

    Interns are eligible for some of the benefits listed. Our pay ranges are determined by role, level, and location. The range displayed reflects the pay for this position in the primary location identified in this posting. Actual pay depends on several factors, including state minimum pay wage rates, location, job-related skills, experience, and relevant education level or training. We are committed to complying with all applicable federal and state minimum wage requirements where applicable. If applicable, your recruiter can share more about the specific pay range for your preferred location during the hiring process.

    KLA is proud to be an Equal Opportunity Employer. We will ensure that qualified individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.

    Be aware of potentially fraudulent job postings or suspicious recruiting activity by persons that are currently posing as KLA employees. KLA never asks for any financial compensation to be considered for an interview, to become an employee, or for equipment. Further, KLA does not work with any recruiters or third parties who charge such fees either directly or on behalf of KLA. Please ensure that you have searched for legitimate job postings. KLA follows a recruiting process that involves multiple interviews in person or on video conferencing with our hiring managers. If you are concerned that a communication, an interview, an offer of employment, or that an employee is not legitimate, please send an email to to confirm the person you are communicating with is an employee. We take your privacy very seriously and confidentially handle your information.

    [job_alerts.create_a_job]

    Infrastructure Architect • Milpitas, CA, USA

    [internal_linking.related_jobs]
    Senior AI Data Center Systems Architect — Equity Eligible

    Senior AI Data Center Systems Architect — Equity Eligible

    NVIDIA • Santa Clara, CA, United States
    [job_card.full_time]
    NVIDIA is seeking a Senior Software Architect for their Data Center Systems team in Santa Clara.This role involves leading software activities for deep learning server platforms and collaborating w...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Software Engineer, AI Compute Infrastructure

    Software Engineer, AI Compute Infrastructure

    HeyGen • Palo Alto, CA, United States
    [job_card.full_time]
    Software Engineer, AI Compute Infrastructure.At HeyGen, our mission is to make visual storytelling accessible to all.Over the last decade, visual content has become the preferred method of informat...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Azure Architect

    Azure Architect

    Noblesoft Technologies • Milpitas, California, USA
    [job_card.full_time]
    Location : Milpitas - California.Experience in Azure cloud service design deployment and support.Hands-on experience designing and implementing cloud solutions using various Azure services like Vir...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI System Architect : Enterprise AI Orchestrator

    Senior AI System Architect : Enterprise AI Orchestrator

    Adobe Inc. • San Jose, CA, United States
    [job_card.full_time]
    A leading technology company in California is seeking a Senior AI System Architect to bridge business needs with advanced AI system design. The role focuses on translating use cases into scalable so...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Tech Lead, AI Compute Infrastructure

    Tech Lead, AI Compute Infrastructure

    HeyGen • Palo Alto, CA, US
    [job_card.full_time]
    At HeyGen, our mission is to make visual storytelling accessible to all.Over the last decade, visual content has become the preferred method of information creation, consumption, and retention.But ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Strategic Cloud Architect for Semiconductors

    Strategic Cloud Architect for Semiconductors

    Google Inc. • Sunnyvale, CA, United States
    [job_card.full_time]
    A leading technology company is seeking a Principal Architect IV for Google Cloud in California.This role requires a blend of technical and business acumen, focusing on building strategic relations...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Cloud Architect

    Cloud Architect

    TEKsystems • San Jose, CA, United States
    [job_card.full_time]
    TEKsystems is seeking a Cloud Architect for an on-site role in San Jose, CA or Lehi, UT •.This is a long term contract position. Must be authorized to work in the US for any employer.Bachelor's degre...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Cloud Architect

    Sr. Cloud Architect

    Supermicro • San Jose, CA, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Architect - AI SaaS for Multi-Tenant Platform

    Principal Architect - AI SaaS for Multi-Tenant Platform

    Jobs via Dice • Pleasanton, CA, US
    [job_card.full_time]
    A technology firm is seeking a Principal Architect in Pleasanton, California.This role encompasses leading the design and execution of a next-generation multi-tenant SaaS platform aimed at AI finan...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI GPU Cloud Architect – Enterprise Solutions

    Senior AI GPU Cloud Architect – Enterprise Solutions

    GMI Cloud • Mountain View, California, United States
    [job_card.full_time]
    A leading AI infrastructure company is seeking a Senior Solution Architect to design innovative GPU cloud and AI solutions. In this role, you'll engage with enterprise and hyperscaler customers, lea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Platform Technical Architect

    AI Platform Technical Architect

    Tror AI for everyone • San Jose, California, USA
    [job_card.full_time]
    Job Title : AI Platform Technical Architect.Designing and implementing large-scale distributed systems microservices serverless and event-driven architectures. Cloud-native architecture experience in...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]
    Cloud Architect – AIML

    Cloud Architect – AIML

    Purple Drive • San Jose, California, USA
    [job_card.full_time]
    Design and optimize cloud-based AI / ML data systems.Lead architecture strategy and implementation across full ML pipelines in Azure. Ensure scalability automation security and cross-team collaboratio...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Architect, AI Foundations & Scalable Inference

    Architect, AI Foundations & Scalable Inference

    Adobe Inc. • San Jose, CA, United States
    [job_card.full_time]
    A leading technology company is seeking a Principal Scientist to enhance Adobe Express's AI framework.The role requires expertise in large-scale distributed systems and machine learning, focusing o...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Enterprise AI Solutions Architect — Scale & Deploy AI

    Enterprise AI Solutions Architect — Scale & Deploy AI

    NVIDIA Corporation • Santa Clara, CA, United States
    [job_card.full_time]
    A global leader in AI technology is seeking experienced AI developers to design and build enterprise AI solutions.You will guide customers in adopting NVIDIA AI technologies, tackle sophisticated A...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI-Driven Multi-Cloud Platform Architect

    AI-Driven Multi-Cloud Platform Architect

    Georgian Partners • Mountain View, CA, US
    [job_card.full_time]
    A leading AI decision intelligence firm is seeking a Principal Architect to build and scale their multi-cloud infrastructure. This role requires over 10 years of experience in cloud technologies, sp...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    AI & HPC Infra Architect for Large Clusters

    AI & HPC Infra Architect for Large Clusters

    Advanced Micro Devices, Inc. • San Jose, CA, United States
    [job_card.full_time]
    A leading technology company in San Jose is seeking an experienced System Solutions Architect to drive AI infrastructure projects. The ideal candidate will have a strong background in Kubernetes-bas...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI / HPC Systems Architect

    Senior AI / HPC Systems Architect

    NVIDIA Corporation • Santa Clara, CA, United States
    [job_card.full_time]
    A leading technology company in Santa Clara is seeking a Senior HPC / AI Solutions Architect to join their Infrastructure Specialists Team. This role involves building and maintaining AI / HPC infrastru...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI Inference Networking Architect

    Senior AI Inference Networking Architect

    NVIDIA • Santa Clara, CA, United States
    [job_card.full_time]
    A leading technology company in Santa Clara is seeking a Senior Software Architect for AI Networking.This role involves optimizing AI inference infrastructure and collaborating on advanced networki...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]