Talent.com
saransh
Infra Architect - AI Platform & GenAI Infrastructuresaransh • Concord, CA, United States
Search for other jobs
Infra Architect - AI Platform & GenAI Infrastructure

Infra Architect - AI Platform & GenAI Infrastructure

saransh • Concord, CA, United States
22 hours ago
Job type
  • Full-time
  • Quick Apply
Job description

Role: Infra Architect - AI Platform & GenAI Infrastructure

Location: Concord, California (Bay Area Preferred)

The candidate combines strong technical depth with the ability to define long-term architecture, influence roadmaps, and lead cross-functional initiatives.

Lead architecture and technical direction for:

  • Enterprise GenAI Platform
  • Agentic AI Platform
  • Model Serving Infrastructure
  • Prompt and Evaluation Frameworks
  • AI Governance and Guardrails
  • Agent Runtime Platforms
  • Observability and AI Operations

Multi-Cloud AI Platform

Design and drive architecture across:

  • OpenShift AI / RHOAI
  • GCP Vertex AI
  • Gemini Models
  • Azure AI Foundry
  • AWS Bedrock
  • Anthropic Claude
  • OpenAI

Platform Scalability & Resiliency

Lead initiatives involving:

  • Capacity planning
  • GPU platform strategy
  • NVIDIA Super POD architecture
  • Multi-region resiliency
  • Cloud DR strategy
  • Active-active platform architectures
  • High availability and disaster recovery

Required Qualifications

  • 10+ years of software engineering, infrastructure and architecture experience.
  • 5+ years designing large-scale cloud-native platforms.
  • Strong experience with:
    • Kubernetes/OpenShift
    • Distributed systems
    • Cloud architectures
    • AI/ML platforms
    • API platforms
    • Data platforms
  • Deep understanding of:
    • Generative AI
    • RAG architectures
    • Agentic AI
    • Model Serving
    • MLOps
  • Experience designing highly available Tier-1 production systems.

Vendor/Sourcing Note: Focus primarily on candidates with strong hands-on experience in Kubernetes/OpenShift, AI/ML Platforms, MLOps/AIOps, and Cloud Architecture. Bay Area local candidates are preferred. Strong profiles should be prioritized as this is a fast-moving requirement with vendor competition.

Create a job alert for this search

Infra Architect - AI Platform & GenAI Infrastructure • Concord, CA, United States