Talent.com
CUDA Kernel Engineer
CUDA Kernel EngineerPRAGMATIKE • Chicago, Illinois, United States
CUDA Kernel Engineer

CUDA Kernel Engineer

PRAGMATIKE • Chicago, Illinois, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Location : Cambridge, MA (Eastern Time / UTC -4) Relocation package available

Start date : ASAP

Languages : English (required)

About the Role

Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital , founded by MIT CSAIL researchers.

We are searching for a CUDA Kernel Engineer who has hands-on experience developing and optimizing NVIDIA CUDA kernels from scratch . You will work on the GPU performance layer powering large-scale, high-throughput AI systems used by Fortune 500 customers.

This role is ideal for someone who deeply understands NVIDIA GPU architecture, memory hierarchy, warp-level execution, and profiling workflows not someone coming from generic hardware, FPGA, or non-NVIDIA compute backgrounds. You will directly influence the GPU efficiency, throughput, and scalability of mission-critical AI systems.

What Youll Do

  • Design, implement, and optimize custom CUDA kernels for NVIDIA GPUs , with a focus on maximizing occupancy, memory throughput, and warp efficiency.
  • Profile GPU workloads using tools such as N sight Compute, Nsight Systems, nvprof, and CUDA‐MEMCHECK .
  • Analyze and eliminate performance bottlenecks including warp divergence, uncoalesced memory access, register pressure, and PCIe transfer overhead.
  • Improve GPU memory pipelines (global, shared, L2, texture memory) and ensure proper memory coalescing.
  • Collaborate closely with AI systems, model acceleration, and backend distributed systems teams.
  • Contribute to GPU architecture decisions, kernel libraries, and internal performance-engineering best practices.

What Were Looking For

  • Proven track record building NVIDIA CUDA kernels from scratchnot just calling existing libraries.
  • Strong ability to optimize kernels (tiling strategies, occupancy tuning, shared memory design, warp scheduling).
  • Deep understanding of CUDA threads, warps, blocks, and grids, GPU memory hierarchy and memory coalescing, as well as warp divergence (how to detect, analyze, and mitigate it)
  • Experience diagnosing PCIe bottlenecks and optimizing host-device transfers (pinned memory, streams, batching, overlap).
  • Familiarity with C++, CUDA runtime APIs, and GPU debugging / profiling tooling.
  • Bonus Points

  • Experience with multi-GPU or distributed GPU systems (NCCL, NVLink, MIG).
  • Background in GPU acceleration for ML frameworks or HPC workloads.
  • Knowledge of model inference optimization (TensorRT, CUDA Graphs, CUTLASS).
  • Exposure to compiler-level optimization or PTX / SASS analysis.
  • Startup experience or comfort working in fast-moving, ambiguous environments.
  • Why This Role Will Pivot Your Career

  • Research pedigree : MIT CSAIL founders recognized for breakthrough AI and systems contributions.
  • Customer impact : Deploy AI solutions powering Fortune 500 clients .
  • Industry momentum : Lab alumni have led high-value acquisitions (MosaicML Databricks, Run : AI Nvidia, W&B CoreWeave).
  • Funding & growth : Oversubscribed seed round, next funding in 2026.
  • Career growth & influence : Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale .
  • Culture & autonomy : Own critical systems while collaborating with world-class engineers.
  • Aspirational impact : Solve GPU / AI performance challenges few engineers ever face.
  • Benefits

  • Competitive salary & equity options
  • Sign-on bonus
  • Health, Dental, and Vision
  • 401k
  • Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

    [job_alerts.create_a_job]

    Engineer • Chicago, Illinois, United States

    [internal_linking.similar_jobs]
    Senior Software Engineer, Core

    Senior Software Engineer, Core

    Trellis • Chicago, IL, US
    [job_card.full_time]
    Trellis is a profitable, fast-growing Series A startup backed by General Catalyst, QED, NYCA, and Amex Ventures.We're reimagining how people shop for home and auto insurance, using smart techno...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Cloud Engineer

    Cloud Engineer

    Genesis10 • Chicago, IL, US
    [job_card.permanent]
    Genesis10 is seeking a Cloud Engineer for a permanent position with a financial services client located in Chicago, IL.Summary : Genesis10 is seeking a Cloud Engineer to lead and automate a large, c...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Guidewire Cloud Software Engineer I - Hybrid Opportunity (Based in West Des Moines, Iowa)

    Guidewire Cloud Software Engineer I - Hybrid Opportunity (Based in West Des Moines, Iowa)

    The Mutual Group • Chicago, IL, US
    [job_card.full_time]
    As a Guidewire Cloud Software Engineer I, you will be responsible for the development, migration, optimization, and scaling of the Guidewire insurance software platform within cloud environments.Yo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Sitecore XM Cloud Engineer

    Senior Sitecore XM Cloud Engineer

    Tata Consultancy Services • Chicago, IL, US
    [job_card.full_time]
    Job Description Role - Senior Sitecore XM Cloud Developer Mandatory Technical Skills Sitecore XM Cloud (SaaS-based, headless CMS) – hands-on experience with cloud-native Sitecore architecture Sitec...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Full Stack Engineer (Flutter & Backend)

    Senior Full Stack Engineer (Flutter & Backend)

    Albi • Chicago, IL, US
    [job_card.full_time]
    We are a fast-growing SaaS company on a mission to propel the restoration industry forward by empowering restoration companies with the technology they need to scale and grow their businesses.Top 1...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Software Engineer

    Lead Software Engineer

    Relativity • Chicago, IL, United States
    [job_card.full_time]
    We are seeking a Lead Software Engineer to join the Retrieval Ingestion Team at Relativity.This role is ideal for an experienced engineer who thrives on designing and operating high throughput inge...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, Compute Platform

    Senior Software Engineer, Compute Platform

    Moonlite • Chicago, IL, US
    [job_card.full_time]
    Moonlite delivers high-performance AI infrastructure for organizations running intensive computational research, large-scale model training, and demanding data processing workloads.We provide infra...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr Mechanical Engineer Data Center Development

    Sr Mechanical Engineer Data Center Development

    Pkaza • Ashburn, Illinois, USA
    [job_card.full_time]
    Sr Mechanical Engineer - Data Center Development - Ashburn VA.This position is also available for your coworkers that do Civil Engineering or Electrical Engineering in NoVA.Also looking for a Lead ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Backend Engineer (Chicago)

    Senior Backend Engineer (Chicago)

    Chime • Chicago, Illinois, United States
    [filters.remote]
    [job_card.full_time]
    Chime Engineering is growing rapidly as we scale to meet the financial needs of our members.We're looking for driven engineers with strong leadership skills to help evolve our risk architecture, en...[show_more]
    [last_updated.last_updated_30] • [promoted]
    DevSecOpsOpenShift (Kubernetes) Engineer

    DevSecOpsOpenShift (Kubernetes) Engineer

    Expert Technology Services • Lansing, Illinois, USA
    [job_card.full_time]
    This position functions as lead DevSecOps / Azure DevOps / OpenShift (Kubernetes) engineer responsible for supporting large State of Michigan Department of Health and Human Services Health Services (DH...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Service Engineer

    Service Engineer

    Supermicro • Chicago, IL, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer - US - Crypto

    Principal Software Engineer - US - Crypto

    Career Renew • Chicago, IL, US
    [job_card.full_time]
    Career Renew is recruiting for one of its clients a Principal Software Engineer - US - Crypto - this is a fully remote role for US based candidates. Join a stellar team of leaders and experts in blo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Android Engineer — Kotlin, Scale & Impact

    Senior Android Engineer — Kotlin, Scale & Impact

    Grindr LLC • Chicago, IL, United States
    [job_card.full_time]
    A leading social media company is seeking an experienced Android Developer to work on their app.This hybrid position involves collaboration with cross-functional teams, building scalable applicatio...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Backend Engineer

    Backend Engineer

    Databento • Chicago, IL, US
    [job_card.full_time]
    Databento is a startup that builds modern APIs to get financial data.As a Series A startup, we've raised $37.M to date, and grown our revenues by over 958% Y / Y in the past year—all with a...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Full Stack Engineer

    Full Stack Engineer

    Motorola Solutions • Chicago, Illinois, USA
    [job_card.full_time]
    At Motorola Solutions we believe that everything starts with our people.Were a global close-knit community united by the relentless pursuit to help keep people safer everywhere.Our critical communi...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Software Engineer, Core Identity (Auth0)

    Senior Software Engineer, Core Identity (Auth0)

    Okta • Chicago, IL, United States
    [job_card.full_time]
    Senior Software Engineer, Core Identity (Auth0).Join to apply for the Senior Software Engineer, Core Identity (Auth0) role at Okta. Okta is The World’s Identity Company.We free everyone to safely us...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer - CORE

    Senior Software Engineer - CORE

    Alliant Credit Union • Chicago, IL, US
    [job_card.full_time] +2
    Design, development and implement assigned platform in a collaborative and inclusive agile team.Work on multiple and complex features concurrently. Use foundational technical knowledge of full stack...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead DevOps Engineer with cloud expertise

    Lead DevOps Engineer with cloud expertise

    The Federal Home Loan Bank of Chicago • Chicago, Illinois, United States
    [job_card.full_time]
    Salary : $108,450 - 180,825 per year.SCRUM / Agile software development environment.Proficient in deploying and managing Continuous Integration tools such as Azure DevOps, Jenkins, TeamCity, Octopus, ...[show_more]
    [last_updated.last_updated_1_day] • [promoted]