Talent.com
AI Infrastructure Architect
AI Infrastructure ArchitectOkta for Developers • San Francisco, CA, United States
AI Infrastructure Architect

AI Infrastructure Architect

Okta for Developers • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Overview

AI Infrastructure Architect. We are looking for a smart and versatile AI Infrastructure Architect to build and evolve the AI infrastructure and platform that powers our identity security solutions. Your work will enable internal teams and product groups to integrate AI capabilities safely, securely, and at scale—empowering Okta’s mission to protect millions of digital identities worldwide. While your primary focus will be to architect scalable, secure, and resilient infrastructure supporting AI-driven tools, frameworks, and identity services, we value someone who isn’t afraid to get hands-on when needed to help solve complex challenges and drive projects forward.

Key Responsibilities

  • Lead AI enablement initiatives, including proof-of-concepts for emerging AI infrastructure technologies and integration approaches.
  • Collaborate cross-functionally with engineering, security, data science, and product teams to align AI platform architecture with business and security goals.
  • Architect scalable, resilient, and secure AI infrastructure that supports AI-powered tools and features across Okta’s Identity Platform.
  • Lead infrastructure decisions across AWS, GCP, or hybrid environments with a focus on secure identity data handling.
  • Develop and maintain infrastructure-as-code frameworks (e.g., Terraform, Helm) to ensure consistent, reproducible deployment of AI services.
  • Champion security and compliance by embedding data privacy and identity protection standards directly into the AI platform and infrastructure design.
  • Serve as the key advocate and strategist for AI-driven efficiency initiatives across infrastructure platform teams and pre-production systems.
  • Implement robust MLOps practices, such as model evaluation, rollback strategies, and A / B testing, to guarantee the reliability and governance of AI in production.
  • Drive continuous innovation by staying current with AI and cloud infrastructure trends and evangelizing best practices internally.

Qualifications

  • 10+ years in infrastructure or software engineering, with ≥ 2 years building AI / ML systems
  • Exceptional systems-level thinking and a track record in architecting and building enterprise-grade infrastructure
  • Deep expertise in cloud platforms (AWS, GCP), distributed systems, and container orchestration (Kubernetes)
  • Hands-on experience to create, review, and contribute large chunks of quality code
  • Preferred

  • Experience in identity, security, fraud, or risk analytics domains.
  • Experience operationalizing large language models or foundation models in production environments.
  • Contributions to MLOps or infrastructure open-source projects.
  • What You’ll Gain

  • Opportunity to lead infrastructure shaping AI systems that protect millions of identity transactions.
  • Be at the core of building efficient and AI-powered enterprise-grade solutions that touch internal and external customers alike.
  • Compensation and Benefits

    The annual base salary range for this position for candidates located in California is between $263,000 and $395,000 USD. Your actual base salary will depend on factors such as skills, qualifications, experience, and work location. Okta offers equity (where applicable), bonus, and benefits, including health, dental and vision insurance, 401(k), flexible spending account, and paid leave in accordance with applicable plans and policies. To learn more about Total Rewards, please visit : https : / / rewards.okta.com / us.

    Location and Travel

    Many roles are based in California. Some roles may require travel to one of our office locations for in-person onboarding.

    Equal Opportunity

    Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws. If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use the provided form to request an accommodation. Okta is committed to complying with applicable data privacy and security laws and regulations. For more information, please see our Privacy Policy at https : / / www.okta.com / privacy-policy / .

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Infrastructure Architect • San Francisco, CA, United States

    [internal_linking.related_jobs]
    Senior Infra Architect, Enterprise AI Platform

    Senior Infra Architect, Enterprise AI Platform

    Scale • San Francisco, CA, United States
    [job_card.full_time]
    A leading AI technology company in San Francisco is seeking a Senior Infrastructure Software Engineer to define and scale their multi-cloud infrastructure supporting enterprise AI products.The role...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Infrastructure Architect

    Infrastructure Architect

    Sutherland • San Francisco, California, USA
    [job_card.full_time]
    All your information will be kept confidential according to EEO guidelines.EEOC and Veteran Documentation.During employment employees are treated without regard to race color religion sex national ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Infrastructure Architect

    AI Infrastructure Architect

    Okta • San Francisco, CA, United States
    [job_card.full_time]
    AI Infrastructure Architect – We are looking for a smart and versatile AI Infrastructure Architect to build and evolve the AI infrastructure and platform that powers our identity security solutions...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Infrastructure Engineer, Core Infrastructure

    AI Infrastructure Engineer, Core Infrastructure

    Scale AI, Inc. • San Francisco, California, United States
    [job_card.full_time]
    As a Software Engineer on the ML Infrastructure team, you will design and build the next generation of foundational systems that power all ML Infrastructure compute at Scale - from model training a...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Architect, AI-Driven Integration Cloud

    Principal Architect, AI-Driven Integration Cloud

    Relha LLC • San Francisco, CA, United States
    [job_card.full_time]
    A leading technology company is seeking a Principal Architect to lead the architecture strategy for its Integration Cloud. This role focuses on AI-led innovations in integration and API platforms, r...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Architect : Agentic AI & Cloud-Native Platforms

    Senior Architect : Agentic AI & Cloud-Native Platforms

    Ernst & Young Oman • San Francisco, CA, United States
    [job_card.full_time]
    A global professional services firm is seeking an Architect to define and deliver scalable architectures for AI systems.In this role, you'll work with diverse teams to translate business requiremen...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI API Solutions Architect

    Senior AI API Solutions Architect

    Glean • San Francisco, CA, United States
    [job_card.full_time]
    A leading Work AI platform is seeking a Senior Solution Architect to enhance the use of their APIs and SDKs in internal AI applications. The role involves collaborating with engineers and customers ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Infrastructure Architect (Remote-First, Equity)

    AI Infrastructure Architect (Remote-First, Equity)

    CEF AI • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A leading AI technology company in San Francisco is seeking a Principal Software Engineer to design and deliver an innovative AI-first data computing platform. The role requires strong experience in...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior AI Infra Architect & Tech Leader

    Senior AI Infra Architect & Tech Leader

    Scale AI • San Francisco, CA, United States
    [job_card.full_time]
    A forward-thinking tech company is seeking a Distinguished Engineer to lead AI / ML infrastructure development.This hands-on technical leader will influence architectural decisions and mentor senio...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Infrastructure Architect — Platform & Systems

    AI Infrastructure Architect — Platform & Systems

    Postman • San Francisco, CA, United States
    [job_card.full_time]
    A leading API platform company in San Francisco is seeking a Member of Technical Staff on AI Infrastructure to build and maintain foundational systems for AI models. Collaborate with engineering tea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Network Architect — AI Cloud Infrastructure

    Senior Network Architect — AI Cloud Infrastructure

    CMK Resources, Inc. • San Francisco, CA, United States
    [job_card.full_time]
    A leading technology recruitment agency is seeking a Senior Network Engineer to architect and implement network solutions for AI cloud infrastructure. This contract-to-hire role demands 15+ years of...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Infrastructure Engineer - PlayerZero

    AI Infrastructure Engineer - PlayerZero

    HireOTS • San Francisco, CA, United States
    [job_card.full_time]
    The platform is used by engineering and support teams to : .Autonomously debug problems in production software.Fix issues directly in the codebase. Prevent recurring issues through intelligent root-ca...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI System Solution Architect

    AI System Solution Architect

    Cango Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Design end-to-end technical architecture for LLM and Diffusion model inference on large-scale GPU clusters.Develop innovative solutions in KV Cache management, distributed scheduling, pipelining / ba...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote AI Research Infrastructure Architect

    Remote AI Research Infrastructure Architect

    Block • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A financial technology firm in San Francisco is seeking an AI Research Infrastructure Engineer to architect and build intelligent systems for research automation. The role includes designing AI work...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    Spellbrush • San Francisco, CA, US
    [job_card.full_time]
    Spellbrush, the world’s leading generative AI studio behind.AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on all platforms.Design, imple...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI Architect – Multi-Agent Systems & Platform Infrastructure

    Senior AI Architect – Multi-Agent Systems & Platform Infrastructure

    Nivalto • San Francisco, CA, United States
    [job_card.full_time]
    Senior AI Architect – Multi-Agent Systems & Platform Infrastructure.Senior AI Architect – Multi-Agent Systems & Platform Infrastructure. Senior AI Architect – Multi-Agent Systems & Platform Infrastr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior AI Infrastructure Engineer

    Senior AI Infrastructure Engineer

    LanceDB • San Francisco, CA, United States
    [job_card.full_time]
    LanceDB is a developer-friendly, open-source data lake for multimodal AI.From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Enterprise Architect - Power BI Architect - West Coast

    Enterprise Architect - Power BI Architect - West Coast

    Capgemini • San Francisco, CA, United States
    [job_card.full_time]
    Job Description - Enterprise Architect - Power BI Architect - West Coast (054078).Job Description - Enterprise Architect - Power BI Architect - West Coast (054078). Identify and translate system req...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]