Talent.com
TalentOla
Real-Time Inference Engineering LeadTalentOla • Concord, CA, United States
Real-Time Inference Engineering Lead

Real-Time Inference Engineering Lead

TalentOla • Concord, CA, United States
5 days ago
Job type
  • Full-time
  • Quick Apply
Job description

Job Description

Job Title: Real-Time Inference Engineering Lead

Location: Concord, California

Rate ::$80/hr

JOB ID # /BPM: 102602-117-2

Real-Time Inference Engineering Lead

The Real-Time Inference Engineering Lead is responsible for designing, building, and operationalizing scalable, low-latency model serving platforms that power real-time AI and predictive decisioning use cases. This role leads the architecture, deployment, performance optimization, resiliency, and operational governance of online inference services across cloud and on-premises environments.

* Design and implement highly available, low-latency model serving architectures for real-time inference workloads.
* Develop and standardize deployment patterns for scalable AI/ML services across Kubernetes-based platforms.
* Lead API-based inference service design, integration, and lifecycle management.
* Optimize model serving performance through latency tuning, caching strategies, autoscaling, and resource management.
* Establish monitoring, observability, SLOs/SLAs, alerting, and operational runbooks for production services.
* Drive load testing, capacity planning, resiliency engineering, and disaster recovery readiness.
* Integrate inference platforms with CI/CD pipelines to enable automated deployments and controlled releases.
* Partner with Data Science, Platform Engineering, MLOps, and Infrastructure teams to ensure reliable production model operations.
* Govern operational best practices, security, reliability, and performance standards for enterprise AI deployments.

* Online inference and model-serving architectures
* Real-time APIs and distributed systems design
* Kubernetes, container orchestration, and service mesh technologies
* Autoscaling, capacity management, and workload optimization
* Performance engineering, load testing, and latency optimization
* Monitoring, observability, logging, tracing, and SLO management
* CI/CD, DevOps, and Infrastructure-as-Code practices
* Reliability engineering, fault tolerance, and resiliency patterns
* Cloud and on-premises platform operations
* Python, Java, Go, or similar backend development experience

* Experience with MLOps platforms and enterprise AI deployment frameworks.
* Hands-on experience with real-time recommendation, fraud, risk, personalization, or predictive analytics platforms.
* Familiarity with GPU-based inference, model optimization, and multi-cloud deployments.

A successful candidate combines AI platform engineering, distributed systems expertise, and operational excellence to deliver resilient, high-performance inference platforms that enable enterprise-scale real-time AI solutions.

Create a job alert for this search

Real-Time Inference Engineering Lead • Concord, CA, United States

Similar jobs

Dir, Engineering

Lam ResearchFremont, CA, United States
Full-time

The Customer Support Business Group focuses on enabling our customers with premier customer support throughout their lifecycle with Lam.We drive performance, productivity, safety, and quality of cu... Show more

 • Promoted

AI Enterprise Architect - Remote & AI Solutions Leader

Workday, Inc.Pleasanton, CA, United States
Remote
Full-time

A leading AI platform provider is seeking an experienced Enterprise Architect - AI to drive the adoption of AI-enabled solutions.This role involves acting as a trusted advisor to prospects, leverag... Show more

 • Promoted

Site CI/Lean Specialist

AmportsBenicia, CA, United States
Full-time

Continuous Improvement Specialist.Process Analysis: Observe, map, and analyze current state processes across various site functions (e.Project Management: Lead and manage continuous improvement pro... Show more

 • Promoted

Operations Analyst

Total SafetyFairfield, CA, United States
Full-time

Total Safety is looking for an Operations Support Specialist to join their safety conscious team! The Operations Support Specialist provide administrative and technical support for a business's day... Show more

 • Promoted

Loss Investigations Manager

Westamerica BankFairfield, CA, United States
Full-time

Westamerica is among the largest commercial banks headquartered in California.We are looking for outstanding people to join our winning team.We reached our current strength because our employees, c... Show more

 • Promoted

Technical Program Lead - Engineering

Hyve SolutionsFremont, CA, United States
Full-time

We are seeking a Technical Program Manager (TPM) to lead customer network/compute rack programs, with a focus on rack design and system and rack-level integration.Own end-to-end delivery of custome... Show more

 • Promoted

Release Engineering Lead

Network OptixWalnut Creek, CA, United States
Full-time

Release Engineering LeadNetwork Optix (Nx) is a global powerhouse in video software development, driven by a mission to empower the creation of intelligent video-based solutions and products capabl... Show more

 • Promoted

Sr. Manager, Technical Architect Enterprise AI Solutions

Canadian SolarWalnut Creek, CA, United States
Full-time

AI Leader Position At Canadian Solar.At Canadian Solar, our vision is to make lives better by bringing electricity powered by the sun to millions of people worldwide.As a leading manufacturer of so... Show more

 • Promoted

Project Engineering Manager - (Full Time) - at Fairfield, CA (IK)

Central Business Solutions, IncFairfield, CA, United States
Full-time

The Project Engineering Manager is responsible for leading engineering projects, coordinating with cross-functional teams, and ensuring successful project delivery.This role requires a blend of tec... Show more

 • Promoted

[Remote] Performance Oriented, Senior C++ Engineer for core animation runtime at Rive

Meetingcpp GmbHFremont, CA, United States
Remote
Full-time

Remote Performance Oriented, Sr.C+Engineer for core animation runtime at Rivepublished at 10.Location :RemoteCompany :RiveRemote support for this position :yesRive is a new way to build production-... Show more

 • Promoted

Engineering Manager

Schweitzer Engineering LaboratoriesVacaville, CA, United States
Full-time

Schweitzer Engineering Laboratories seeks an Engineering Manager to support the West Region within the Engineering Services Division.In this role you'll be leading teams to deliver power system sol... Show more

 • Promoted

Enterprise AI Platform Governance & Operations Lead

Lam ResearchFremont, CA, United States
Full-time

The Enterprise AI team helps Lam scale responsible, secure, and high-value use of AI across the company.The team works across enterprise AI platforms, developer tools, data and knowledge platforms,... Show more

 • Promoted

? Product Development Lead?

Mat3raWalnut Creek, CA, United States
Full-time +1

Product Manager For Digital Materials RnD Platform.We are building the real-world J.Calling out experienced product managers - people with strong technical backgrounds (STEM degree, experience in s... Show more

 • Promoted

Manager, Imaging

Sutter HealthFairfield, CA, United States
Full-time

Manages and provides operational leadership in the Solano locations to diagnostic imaging department(s) that may include radiography, fluoroscopy, mammography, ultrasound, computed tomography, nucl... Show more

 • Promoted

Product Engineering Manager

HR Journals LLCFairfield, CA, United States
Full-time

Fairfield, California, United States.About the Job Product Engineering Manager.A leading global technology firm specializing in digital and infrastructure solutions is seeking a highly capable Proj... Show more

 • Promoted

Sales Lead

JourneysFairfield, CA, United States
Part-time

Location: Fairfield, CA (Solano Mall).Journeys is a teen retail leader with an emphasis on footwear and unique specialty items including apparel, backpacks, hats and accessories.With more than 800 ... Show more

 • Promoted

Project Lead - MES

Syntricate TechnologiesVacaville, CA, United States
Full-time

Project Lead MES based in Vacaville, CA (Onsite) for a Fulltime position.Job Location: Vacaville, CA (Onsite) Duration: Full time.Relevant Experience (in Yrs): At least 10 Years.Priority 1: Experi... Show more

 • Promoted

Principal Developer Experience Engineer - Remote

PayNearMeFremont, CA, United States
Remote
Full-time

Company DescriptionPayNearMe develops technology to facilitate the end-to-end customer payment experience, making it easy for businesses to accept, disburse and manage payments.Our modern and relia... Show more

 • Promoted

Mission Control Center Lead

Joby AviationConcord, CA, United States
Permanent

Staff/Principal Mission Control Center Lead.Joby Flight Research designs, develops, and flight-tests novel aircraft using a software-first autonomy approach.We build and deploy autonomy, perception... Show more

 • Promoted

Market Research Associate - No Experience

Clubshop | USVacaville, California
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more