Talent.com
Senior Engineering Manager - Accelerated Compute Memory Systems
Senior Engineering Manager - Accelerated Compute Memory SystemsPryon • Chicago, Illinois, United States, 60601
[error_messages.no_longer_accepting]
Senior Engineering Manager - Accelerated Compute Memory Systems

Senior Engineering Manager - Accelerated Compute Memory Systems

Pryon • Chicago, Illinois, United States, 60601
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Engineering Manager - Accelerated Compute Memory Systems

About Pryon : Were a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now were building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform. Our proprietary, cutting-edge natural language processing capabilities transform unstructured data into meaningful experiences that increase productivity with unmatched accuracy and speed.

Pryon is building one of the industry's most ambitious AI infrastructure platforms : a petabyte-scale ingestion and inference system powering mission-critical government and enterprise deployments. We need an Engineering Manager with deep HPC expertisesomeone who can teach, not be taught. Youll lead the technical team building our ingestion, retrieval, and inference layers, ensuring scalability, reliability, and compliance.

In This Role You Will :

  • Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission-critical deployments for commercial and federal entities with millions of public users.
  • Architect and deliver horizontally scalable, fault-tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users.
  • Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF).
  • Oversee design and optimization of LLM-driven data ingestion and retrieval workflows.
  • Own optimization and tuning of high-throughput, low-latency production environments via async orchestration frameworks.
  • Establish performance benchmarking, compliance frameworks, and automated testing for scale.
  • You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high-performing team.
  • Collaborate cross-functionally with Product, Executive Leadership, and Customer Success.

What You'll Need to Be Successful :

  • 10+ years in software engineering, 5+ years in management roles with large-scale AI / ML systems and infrastructure.
  • Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems.
  • Experience with orchestration frameworks (Kubernetes, Ray, Dask) . Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar) .
  • Experience with message queuing systems (Kafka, Pulsar, RabbitMQ) .
  • In-depth knowledge and hands on experience building scalable distributed architectures and high-performance compute systems.
  • Proven experience in multimodal ingestion pipelines within RAG platforms.
  • Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads.
  • Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems.
  • Deep understanding of infra domains : compute, storage, networking, observability, security, disaster recovery, and cost management.
  • Familiarity with HPC cluster management softwares such as Slurm
  • Familiarity with cloud platforms (AWS, Azure, GCP) and / or on-prem datacenter operations.
  • Benefits for Full Time Employees : - Remote first organization- 100% Company paid Health / Dental / Vision benefits for you and your dependents- Life Insurance, Short-term and Long-term Disability- 401k- Unlimited PTO

    We are interested in every qualified candidate who is authorized to work in the United States. However, we are not able to sponsor or take over sponsorship of employment visas at this time.

    Pryon will not consider race, religion, sex, sexual preference, or national origin in ways that violate the Nation's civil rights laws.

    PI220486eddcd6-30511-39134746

    [job_alerts.create_a_job]

    Senior Engineering Manager • Chicago, Illinois, United States, 60601

    [internal_linking.similar_jobs]
    Software Engineering Manager (Chicago)

    Software Engineering Manager (Chicago)

    Prairie Consulting Services • Chicago, IL, US
    [job_card.full_time] +1
    Software Project Manager (FTE Chicago / Naperville Hybrid).This role requires someone who can operate comfortably in both. Youll guide software projects from kickoff to deliveryhandling timelines, bu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Software Engineering Manager – Hybrid, Cloud & AI

    Lead Software Engineering Manager – Hybrid, Cloud & AI

    The Hartford • Chicago, IL, United States
    [job_card.full_time]
    A leading insurance company is seeking a Manager of Software Engineering in Chicago to lead a talented team in delivering innovative software solutions. The successful candidate should have a strong...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr Mgr Software Engineering

    Sr Mgr Software Engineering

    Medline Industries - Transportation & Operations • Northbrook, Illinois, United States
    [job_card.full_time]
    Job Description Medline Industries has an immediate opening for a highly experienced and motivated senior manager of Software Engineering to lead our team in modernizing our warehouse management sy...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Manager, Systems Analysis

    Senior Manager, Systems Analysis

    Blue Cross Blue Shield Association • Chicago, IL, United States
    [job_card.full_time]
    This role is responsible for the overall delivery of technical solutions initiatives.Serves as the primary point of contact for the delivery, operations, and support of complex technology solutions...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    Hispanic Alliance for Career Enhancement • Chicago, IL, United States
    [job_card.full_time]
    North America, Japan and the United Kingdom.At Grainger, We Keep the World Working® by serving more than 4.Known for its commitment to service and award-winning culture, the Company had 2024 revenu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Technology Site Reliability Engineering Manager

    Senior Technology Site Reliability Engineering Manager

    Cooley LLP • Chicago, IL, United States
    [job_card.full_time]
    Senior Technology Site Reliability Engineering Manager.Cooley is seeking a Senior Site Reliability Engineering Manager to join the. Infrastructure & Development Operations.The Senior Technology Site...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Manager, Software Engineering Management

    Manager, Software Engineering Management

    ServiceNow, Inc. • Chicago, IL, United States
    [job_card.full_time]
    It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Engineering Manager, Sensor Management

    Sr. Engineering Manager, Sensor Management

    Corelight • Chicago, IL, US
    [job_card.full_time]
    Engineering Manager, Sensor Management.Towards the end of our interview process is an in-person interview.Do you want to help make the world safe from cyber attack?. At Corelight, we believe that th...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    Vivid Seats • Chicago, IL, US
    [job_card.full_time]
    Founded in 2001, Vivid Seats (NASDAQ : SEAT) is a leading online ticket marketplace committed to becoming the ultimate partner for connecting fans to the live events, artists, and teams they love.We...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Linux Engineering Manager - Optimisation for Latest Hardware

    Linux Engineering Manager - Optimisation for Latest Hardware

    Canonical • Chicago, IL, United States
    [job_card.full_time]
    Linux Engineering Manager - Optimisation for Latest Hardware.Linux Engineering Manager - Optimisation for Latest Hardware. Linux Engineering Manager - Optimisation for Latest Hardware.Be among the f...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    Meredith • Chicago, IL, United States
    [job_card.full_time]
    In-office Expectations : This position is hybrid in-office, with the ability to work remotely for up to 2 days per week.Allrecipes, BHG, MyRecipes, Food & Wine and more. People Inc reaches millions o...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineering Manager — Cloud-Native & GenAI Leader

    Senior Software Engineering Manager — Cloud-Native & GenAI Leader

    Motorola Solutions • Chicago, IL, United States
    [job_card.full_time]
    A leading communications technology firm is seeking an experienced Senior Software Engineering Manager in Chicago, Illinois. This role involves leading a team to develop cloud-native solutions and e...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Full-Stack Engineering Leader : AWS & Microservices

    Senior Full-Stack Engineering Leader : AWS & Microservices

    Capital One • Chicago, IL, United States
    [job_card.full_time]
    A leading financial technology company is seeking a Senior Manager Software Engineer in Chicago, IL.This role involves leading technology projects and a team of developers to create innovative solu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    W. W. Grainger • Chicago, IL, United States
    [job_card.full_time]
    Select how often (in days) to receive an alert : .CHICAGO, IL, US, 60661-4555 Remote, IL, US, N / A.North America, Japan and the United Kingdom. At Grainger, We Keep the World Working® by serving more t...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    algojobs • Chicago, IL, United States
    [job_card.full_time]
    Founded in 2001, Vivid Seats (NASDAQ : SEAT) is a leading online ticket marketplace committed to becoming the ultimate partner for connecting fans to the live events, artists, and teams they love.We...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Engineering Manager

    Senior Data Engineering Manager

    Oshi Health • Chicago, IL, US
    [job_card.full_time]
    Oshi Health is revolutionizing GI care with a digital clinic model that provides easy, convenient access to an integrated and multidisciplinary care team that takes a holistic approach to diagnosin...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Manager, Engineering - Cloud Infrastructure

    Senior Manager, Engineering - Cloud Infrastructure

    Relativity • Chicago, IL, United States
    [job_card.full_time]
    The Relativity engineering department builds and maintains scalable, secure, and performant solutions that empower legal and compliance teams globally. Our mission spans multiple domains, including ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Manager, Software Engineering

    Manager, Software Engineering

    Circle • Chicago, IL, United States
    [job_card.full_time]
    Be among the first 25 applicants.Circle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data — globally, near...[show_more]
    [last_updated.last_updated_30] • [promoted]