Talent.com
Senior Engineering Manager - Accelerated Compute Memory Systems
Senior Engineering Manager - Accelerated Compute Memory SystemsPryon • San Francisco, CA, United States
Senior Engineering Manager - Accelerated Compute Memory Systems

Senior Engineering Manager - Accelerated Compute Memory Systems

Pryon • San Francisco, CA, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Engineering Manager - Accelerated Compute Memory Systems

About Pryon : We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform. Our proprietary, cutting‑edge natural language processing capabilities transform unstructured data into meaningful experiences that increase productivity with unmatched accuracy and speed. Pryon is building one of the industry's most ambitious AI infrastructure platforms : a petabyte‑scale ingestion and inference system powering mission‑critical government and enterprise deployments. We need an Engineering Manager with deep HPC expertise—someone who can teach, not be taught. You’ll lead the technical team building our ingestion, retrieval, and inference layers, ensuring scalability, reliability, and compliance.

In This Role You Will

  • Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission‑critical deployments for commercial and federal entities with millions of public users
  • Architect and deliver horizontally scalable, fault‑tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users
  • Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF)
  • Oversee design and optimization of LLM‑driven data ingestion and retrieval workflows
  • Own optimization and tuning of high‑throughput, low‑latency production environments via async orchestration frameworks
  • Establish performance benchmarking, compliance frameworks, and automated testing for scale
  • You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high‑performing team
  • Collaborate cross‑functionally with Product, Executive Leadership, and Customer Success

What You’ll Need to Be Successful

  • 10+ years in software engineering, 5+ years in management roles with large‑scale AI / ML systems and infrastructure
  • Expert‑level proficiency in Python and Golang, with 5+ years building production distributed systems
  • Experience with orchestration frameworks (Kubernetes, Ray, Dask)
  • Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar)
  • Experience with message queuing systems (Kafka, Pulsar, RabbitMQ)
  • In‑depth knowledge and hands‑on experience building scalable distributed architectures and high‑performance compute systems
  • Proven experience in multimodal ingestion pipelines within RAG platforms
  • Direct experience in designing, fine‑tuning, and optimizing LLMs for ingestion and retrieval workloads
  • Previous success managing engineering teams delivering production‑grade, HPC‑scale RAG systems
  • Deep understanding of infra domains : compute, storage, networking, observability, security, disaster recovery, and cost management
  • Familiarity with HPC cluster management softwares such as Slurm
  • Familiarity with cloud platforms (AWS, Azure, GCP) and / or on‑prem datacenter operations
  • Benefits for Full Time Employees

  • Remote first organization
  • 100% Company paid Health / Dental / Vision benefits for you and your dependents
  • Life Insurance, Short‑term and Long‑term Disability
  • 401k
  • Unlimited PTO
  • We are interested in every qualified candidate who is authorized to work in the United States. However, we are not able to sponsor or take over sponsorship of employment visas at this time. Pryon will not consider race, religion, sex, sexual preference, or national origin in ways that violate the Nation's civil rights laws. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Senior Engineering Manager • San Francisco, CA, United States

    [internal_linking.similar_jobs]
    Senior Engineering Manager, Core Product

    Senior Engineering Manager, Core Product

    Discord • San Francisco, CA, United States
    [job_card.full_time]
    Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : . Over 90% of our users play games, spending a comb...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Engineering Manager, Foundations

    Senior Engineering Manager, Foundations

    Jobright.ai • San Francisco, CA, United States
    [job_card.full_time]
    Senior Engineering Manager, Foundations.Be among the first 25 applicants.Senior Engineering Manager, Foundations.Jobright is an AI-powered career platform that helps job seekers discover the top op...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineering Manager : Scale & Mentor Teams

    Senior Software Engineering Manager : Scale & Mentor Teams

    Amazon • San Francisco, CA, United States
    [job_card.full_time]
    A leading technology company is seeking a Software Development Manager in San Francisco to lead engineering teams and build scalable software applications. The ideal candidate will have over 7 years...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineering Manager – Hybrid DevOps Lead

    Senior Software Engineering Manager – Hybrid DevOps Lead

    Early Warning Services LLC • San Francisco, CA, United States
    [job_card.full_time]
    A leading financial technology company is seeking a Senior Manager of Software Engineering in San Francisco.The role involves overseeing multiple engineering teams, ensuring adherence to Agile prac...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Manager, Software Engineering, Back End

    Senior Manager, Software Engineering, Back End

    Capital One • San Francisco, CA, United States
    [job_card.full_time] +1
    Senior Manager, Software Engineering, Back EndWhat You’ll Do : • Lead a portfolio of diverse technology projects and a team of developers with deep experience in distributed microservices, and full s...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Engineering Manager, Computer Vision

    Senior Engineering Manager, Computer Vision

    Menlo Ventures • San Francisco, CA, United States
    [job_card.full_time]
    Hover is making the homeowner journey easy, transparent and fun.Starting with the home improvement industry, we’re answering age-old questions like, “What is it going to look like?” and “What is it...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Engineering Manager, MAAS — Distributed Systems Leader

    Engineering Manager, MAAS — Distributed Systems Leader

    Canonical • San Francisco, CA, United States
    [job_card.full_time]
    A leading open-source technology firm is seeking an Engineering Manager to lead the MAAS team in San Francisco.This role requires technical leadership and expertise in Python and Golang, alongside ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Product Manager - Accelerated Compute Memory Systems

    Senior Product Manager - Accelerated Compute Memory Systems

    Medium • San Francisco, CA, United States
    [job_card.full_time]
    We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leadi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote Backend Engineering Manager — Scale High-Impact Systems

    Remote Backend Engineering Manager — Scale High-Impact Systems

    Pantera Capital • San Francisco, CA, United States
    [filters.remote]
    [job_card.full_time]
    A prominent investment firm is looking for an Engineering Manager to lead a small team of senior engineers remotely.The ideal candidate has strong experience in backend development, especially with...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Engineering Manager, Mapping

    Senior Engineering Manager, Mapping

    Lyft • San Francisco, CA, United States
    [job_card.full_time]
    At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Mapping team at Lyft is ta...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Engineering Manager - Accelerated Compute Memory Systems

    Senior Engineering Manager - Accelerated Compute Memory Systems

    Ring Inc • San Francisco, CA, United States
    [job_card.full_time]
    We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leadi...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Engineering Manager, Desktop

    Engineering Manager, Desktop

    anthropic • San Francisco, CA, United States
    [job_card.full_time]
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineering Manager, Enterprise

    Senior Software Engineering Manager, Enterprise

    Nuna Inc. • San Francisco, CA, United States
    [job_card.full_time]
    Senior Manager Software, Enterprise.Senior Manager Software, Enterprise.At Nuna, our mission is to make high-quality healthcare affordable for everyone. We are dedicated to tackling one of our natio...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineering Manager - Storage

    Software Engineering Manager - Storage

    Lambda • San Francisco, CA, United States
    [job_card.full_time]
    We are seeking an experienced Software Engineering Manager with a history in the development of storage protocols and distributed storage systems to lead a team of Storage Software Engineers and Di...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Manager, Software Engineering

    Senior Manager, Software Engineering

    Early Warning® • San Francisco, CA, United States
    [job_card.full_time]
    At Early Warning, we’ve powered and protected the U.Zelle®, Paze℠, and so much more.As a trusted name in payments, we partner with thousands of institutions to increase access to financial services...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Manager, Cloud Engineering

    Senior Manager, Cloud Engineering

    PG Forsta • Emeryville, CA, United States
    [job_card.full_time]
    PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Manager, Autonomy Hardware Systems Engineering

    Senior Manager, Autonomy Hardware Systems Engineering

    Zoox • Foster City, CA, US
    [job_card.full_time]
    We are looking for a seasoned Systems Engineering leader to manage the Autonomy Hardware Systems organization.You will lead a functional organization divided into two core pillars : System Design &a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Engineering Manager, Deep Learning

    Senior Engineering Manager, Deep Learning

    Hayden AI • San Francisco, CA, United States
    [job_card.full_time]
    Senior Engineering Manager, Deep Learning.At Hayden AI, we are on a mission to harness the power of computer vision to transform the way transit systems and other government agencies address real‑w...[show_more]
    [last_updated.last_updated_30] • [promoted]