Talent.com
Senior Engineering Manager - Accelerated Compute Memory Systems
Senior Engineering Manager - Accelerated Compute Memory SystemsPryon • Chicago, Illinois, United States, 60601
Senior Engineering Manager - Accelerated Compute Memory Systems

Senior Engineering Manager - Accelerated Compute Memory Systems

Pryon • Chicago, Illinois, United States, 60601
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Engineering Manager - Accelerated Compute Memory Systems

About Pryon : Were a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now were building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform. Our proprietary, cutting-edge natural language processing capabilities transform unstructured data into meaningful experiences that increase productivity with unmatched accuracy and speed.

Pryon is building one of the industry's most ambitious AI infrastructure platforms : a petabyte-scale ingestion and inference system powering mission-critical government and enterprise deployments. We need an Engineering Manager with deep HPC expertisesomeone who can teach, not be taught. Youll lead the technical team building our ingestion, retrieval, and inference layers, ensuring scalability, reliability, and compliance.

In This Role You Will :

  • Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission-critical deployments for commercial and federal entities with millions of public users.
  • Architect and deliver horizontally scalable, fault-tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users.
  • Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF).
  • Oversee design and optimization of LLM-driven data ingestion and retrieval workflows.
  • Own optimization and tuning of high-throughput, low-latency production environments via async orchestration frameworks.
  • Establish performance benchmarking, compliance frameworks, and automated testing for scale.
  • You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high-performing team.
  • Collaborate cross-functionally with Product, Executive Leadership, and Customer Success.

What You'll Need to Be Successful :

  • 10+ years in software engineering, 5+ years in management roles with large-scale AI / ML systems and infrastructure.
  • Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems.
  • Experience with orchestration frameworks (Kubernetes, Ray, Dask) . Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar) .
  • Experience with message queuing systems (Kafka, Pulsar, RabbitMQ) .
  • In-depth knowledge and hands on experience building scalable distributed architectures and high-performance compute systems.
  • Proven experience in multimodal ingestion pipelines within RAG platforms.
  • Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads.
  • Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems.
  • Deep understanding of infra domains : compute, storage, networking, observability, security, disaster recovery, and cost management.
  • Familiarity with HPC cluster management softwares such as Slurm
  • Familiarity with cloud platforms (AWS, Azure, GCP) and / or on-prem datacenter operations.
  • Benefits for Full Time Employees : - Remote first organization- 100% Company paid Health / Dental / Vision benefits for you and your dependents- Life Insurance, Short-term and Long-term Disability- 401k- Unlimited PTO

    We are interested in every qualified candidate who is authorized to work in the United States. However, we are not able to sponsor or take over sponsorship of employment visas at this time.

    Pryon will not consider race, religion, sex, sexual preference, or national origin in ways that violate the Nation's civil rights laws.

    PI220486eddcd6-30511-39134746

    [job_alerts.create_a_job]

    Senior Engineering Manager • Chicago, Illinois, United States, 60601

    [internal_linking.related_jobs]
    Lead Software Engineering Manager – Hybrid, Cloud & AI

    Lead Software Engineering Manager – Hybrid, Cloud & AI

    The Hartford • Chicago, IL, United States
    [job_card.full_time]
    A leading insurance company is seeking a Manager of Software Engineering in Chicago to lead a talented team in delivering innovative software solutions. The successful candidate should have a strong...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr Mgr Software Engineering

    Sr Mgr Software Engineering

    Medline Industries - Transportation & Operations • Northbrook, Illinois, United States
    [job_card.full_time]
    Job Description Medline Industries has an immediate opening for a highly experienced and motivated senior manager of Software Engineering to lead our team in modernizing our warehouse management sy...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel MRI Tech - $2,076 to $2,302 per week in Zion, IL

    Travel MRI Tech - $2,076 to $2,302 per week in Zion, IL

    AlliedTravelNetwork • Zion, IL, US
    [job_card.full_time]
    AlliedTravelNetwork is working with LRS Healthcare to find a qualified MRI Tech in Zion, Illinois, 60099!.Ready to start your next travel adventure? LRS Healthcare offers a full benefits package, 2...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    Hispanic Alliance for Career Enhancement • Chicago, IL, United States
    [job_card.full_time]
    North America, Japan and the United Kingdom.At Grainger, We Keep the World Working® by serving more than 4.Known for its commitment to service and award-winning culture, the Company had 2024 revenu...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Technology Site Reliability Engineering Manager

    Senior Technology Site Reliability Engineering Manager

    Cooley LLP • Chicago, IL, United States
    [job_card.full_time]
    Senior Technology Site Reliability Engineering Manager.Cooley is seeking a Senior Site Reliability Engineering Manager to join the. Infrastructure & Development Operations.The Senior Technology Site...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineering Manager (Chicago)

    Software Engineering Manager (Chicago)

    Prairie Consulting Services • Chicago, IL, United States
    [job_card.full_time]
    Software Project Manager (FTE Chicago / Naperville Hybrid).This role requires someone who can operate comfortably in both. Youll guide software projects from kickoff to deliveryhandling timelines, bu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Nurse - RN - Endoscopy

    Travel Nurse - RN - Endoscopy

    Uniti Med • Highland Park, IL, US
    [job_card.full_time]
    Uniti Med is seeking an experienced Endoscopy Registered Nurse for an exciting Travel Nursing job in Highland Park, IL.Shift : Inquire Start Date : ASAP Duration : 12 weeks. Uniti Med provides career o...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Manager Software Engineering, Gen AI

    Senior Manager Software Engineering, Gen AI

    Caterpillar • Chicago, Illinois, USA
    [job_card.full_time] +1
    Your Work Shapes the World at Caterpillar Inc.When you join Caterpillar yourejoining a global team who cares not just about the work we do but also about each other. We are the makers problem solve...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Manager, Software Engineering Management

    Manager, Software Engineering Management

    ServiceNow • Chicago, Illinois, USA
    [job_card.full_time]
    ReleaseOps is the ServiceNow application deployment pipeline used to package validate and deliver updates and applications with speed safety and consistency. The team builds maintains and troublesho...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Engineering Manager, Sensor Management

    Sr. Engineering Manager, Sensor Management

    Corelight • Chicago, IL, US
    [job_card.full_time]
    Engineering Manager, Sensor Management.Towards the end of our interview process is an in-person interview.Do you want to help make the world safe from cyber attack?. At Corelight, we believe that th...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Manager, Software Engineering Management

    Manager, Software Engineering Management

    ServiceNow, Inc. • Chicago, IL, United States
    [job_card.full_time]
    It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Linux Engineering Manager - Optimisation for Latest Hardware

    Linux Engineering Manager - Optimisation for Latest Hardware

    Canonical • Chicago, IL, United States
    [job_card.full_time]
    Linux Engineering Manager - Optimisation for Latest Hardware.Linux Engineering Manager - Optimisation for Latest Hardware. Linux Engineering Manager - Optimisation for Latest Hardware.Be among the f...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    Meredith • Chicago, IL, United States
    [job_card.full_time]
    In-office Expectations : This position is hybrid in-office, with the ability to work remotely for up to 2 days per week.Allrecipes, BHG, MyRecipes, Food & Wine and more. People Inc reaches millions o...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    W. W. Grainger • Chicago, IL, United States
    [job_card.full_time]
    Select how often (in days) to receive an alert : .CHICAGO, IL, US, 60661-4555 Remote, IL, US, N / A.North America, Japan and the United Kingdom. At Grainger, We Keep the World Working® by serving more t...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    algojobs • Chicago, IL, United States
    [job_card.full_time]
    Founded in 2001, Vivid Seats (NASDAQ : SEAT) is a leading online ticket marketplace committed to becoming the ultimate partner for connecting fans to the live events, artists, and teams they love.We...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Manager, Software Engineering

    Manager, Software Engineering

    Circle • Chicago, IL, United States
    [job_card.full_time]
    Be among the first 25 applicants.Circle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data — globally, near...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineering Manager

    Software Engineering Manager

    Beyond Finance • Chicago, IL, United States
    [job_card.full_time]
    At Beyond Finance, we've made it our mission to help everyday Americans escape the endless cycle of crippling debt and step into a brighter financial future. Through compassionate, individualized ca...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel MRI Tech - $2,076 to $2,302 per week in Zion, IL

    Travel MRI Tech - $2,076 to $2,302 per week in Zion, IL

    AlliedTravelCareers • Zion, IL, US
    [job_card.full_time]
    AlliedTravelCareers is working with LRS Healthcare to find a qualified MRI Tech in Zion, Illinois, 60099!.Ready to start your next travel adventure? LRS Healthcare offers a full benefits package, 2...[show_more]
    [last_updated.last_updated_30] • [promoted]