Senior AI Engineer (Santa Clara)

Senior AI Engineer - Video Search (Applied Research & Product)

Remote - United States

About the Company

Were partnering with a U.S-based applied AI company building next-generation real-time video understanding systems deployed at scale across enterprise, government, and public environments. The platform combines cutting-edge multimodal AI, vector search, and high-performance inference pipelines to make visual data searchable, interpretable, and actionable in real time.

This is a chance to join a well-funded, mission-driven organization with over tens of thousands of active camera streams and a rapidly growing R&D team pushing the boundaries of multimodal retrieval and AI systems design.

The Role

Were looking for a Senior AI Engineer to lead the applied research and productionization of our video search and retrieval stack - connecting natural-language queries to high-dimensional video representations with real-time performance.

Youll work at the intersection of deep learning research, scalable systems, and GPU-optimized inference, owning models and pipelines end-to-end from training through deployment.

What Youll Do

• Design and build natural-language-to-video retrieval systems using state-of-the-art architectures (e.g., V-JEPA, CLIP, SigLIP, Video-LLMs, ViViT, TimeSformer).
• Develop temporal localization and video summarization capabilities with fine-grained moment-level embeddings.
• Stand up vector search infrastructure (FAISS, Milvus, pgvector, Pinecone) with optimized sharding, caching, and hybrid retrieval strategies.
• Optimize GPU inference and serving pipelines using ONNX Runtime, TensorRT, or ROCm for low-latency performance.
• Drive multi-GPU training and distributed serving (FSDP, ZeRO, DDP, NCCL / RCCL) with strong understanding of parallelization and quantization techniques.
• Collaborate with MLOps, backend, and product teams to deliver production-ready AI features at scale.
• Define and track key retrieval and relevance metrics (R@K, mAP, nDCG) and run live A / B evaluations.
• Mentor junior engineers, document design decisions, and drive innovation through rigorous experimentation.

What Were Looking For

Nice-to-Haves

Compensation & Logistics

Why Join