Talent.com
CUDA Kernel Engineer
CUDA Kernel EngineerPRAGMATIKE • Chicago, Illinois, United States
CUDA Kernel Engineer

CUDA Kernel Engineer

PRAGMATIKE • Chicago, Illinois, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Location : Cambridge, MA (Eastern Time / UTC -4) Relocation package available

Start date : ASAP

Languages : English (required)

About the Role

Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital , founded by MIT CSAIL researchers.

We are searching for a CUDA Kernel Engineer who has hands-on experience developing and optimizing NVIDIA CUDA kernels from scratch . You will work on the GPU performance layer powering large-scale, high-throughput AI systems used by Fortune 500 customers.

This role is ideal for someone who deeply understands NVIDIA GPU architecture, memory hierarchy, warp-level execution, and profiling workflows not someone coming from generic hardware, FPGA, or non-NVIDIA compute backgrounds. You will directly influence the GPU efficiency, throughput, and scalability of mission-critical AI systems.

What Youll Do

  • Design, implement, and optimize custom CUDA kernels for NVIDIA GPUs , with a focus on maximizing occupancy, memory throughput, and warp efficiency.
  • Profile GPU workloads using tools such as N sight Compute, Nsight Systems, nvprof, and CUDA‐MEMCHECK .
  • Analyze and eliminate performance bottlenecks including warp divergence, uncoalesced memory access, register pressure, and PCIe transfer overhead.
  • Improve GPU memory pipelines (global, shared, L2, texture memory) and ensure proper memory coalescing.
  • Collaborate closely with AI systems, model acceleration, and backend distributed systems teams.
  • Contribute to GPU architecture decisions, kernel libraries, and internal performance-engineering best practices.

What Were Looking For

  • Proven track record building NVIDIA CUDA kernels from scratchnot just calling existing libraries.
  • Strong ability to optimize kernels (tiling strategies, occupancy tuning, shared memory design, warp scheduling).
  • Deep understanding of CUDA threads, warps, blocks, and grids, GPU memory hierarchy and memory coalescing, as well as warp divergence (how to detect, analyze, and mitigate it)
  • Experience diagnosing PCIe bottlenecks and optimizing host-device transfers (pinned memory, streams, batching, overlap).
  • Familiarity with C++, CUDA runtime APIs, and GPU debugging / profiling tooling.
  • Bonus Points

  • Experience with multi-GPU or distributed GPU systems (NCCL, NVLink, MIG).
  • Background in GPU acceleration for ML frameworks or HPC workloads.
  • Knowledge of model inference optimization (TensorRT, CUDA Graphs, CUTLASS).
  • Exposure to compiler-level optimization or PTX / SASS analysis.
  • Startup experience or comfort working in fast-moving, ambiguous environments.
  • Why This Role Will Pivot Your Career

  • Research pedigree : MIT CSAIL founders recognized for breakthrough AI and systems contributions.
  • Customer impact : Deploy AI solutions powering Fortune 500 clients .
  • Industry momentum : Lab alumni have led high-value acquisitions (MosaicML Databricks, Run : AI Nvidia, W&B CoreWeave).
  • Funding & growth : Oversubscribed seed round, next funding in 2026.
  • Career growth & influence : Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale .
  • Culture & autonomy : Own critical systems while collaborating with world-class engineers.
  • Aspirational impact : Solve GPU / AI performance challenges few engineers ever face.
  • Benefits

  • Competitive salary & equity options
  • Sign-on bonus
  • Health, Dental, and Vision
  • 401k
  • Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

    [job_alerts.create_a_job]

    Engineer • Chicago, Illinois, United States

    [internal_linking.similar_jobs]
    Sandwich Artist

    Sandwich Artist

    Subway - 45572-0 • Zion, IL, US
    [job_card.full_time] +1
    As part of the Subway® Team, you as a Sandwich Artist ® will focus on four main things : .Providing an excellent Guest experience. Preparing and serving great food .Keeping restaurants cl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Surgical Tech - $2,788 to $2,988 per week in Oak Lawn, IL

    Travel Surgical Tech - $2,788 to $2,988 per week in Oak Lawn, IL

    AlliedTravelCareers • Oak Lawn, IL, US
    [job_card.full_time]
    AlliedTravelCareers is working with Titan Medical Group to find a qualified Surg Tech in Oak Lawn, Illinois, 60455!.Titan Medical is looking for travelers to fill a Travel Surgical Tech position fo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sandwich Artist

    Sandwich Artist

    Subway - 37052-0 • Winthrop Harbor, IL, US
    [job_card.full_time] +1
    As part of the Subway® Team, you as a Sandwich Artist ® will focus on four main things : .Providing an excellent Guest experience. Preparing and serving great food .Keeping restaurants cl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Software Engineer

    Lead Software Engineer

    Relativity • Chicago, IL, United States
    [job_card.full_time]
    We are seeking a Lead Software Engineer to join the Retrieval Ingestion Team at Relativity.This role is ideal for an experienced engineer who thrives on designing and operating high throughput inge...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sandwich Artist

    Sandwich Artist

    Subway - 5824-0 • Highland Park, IL, US
    [job_card.full_time] +1
    As part of the Subway® Team, you as a Sandwich Artist ® will focus on four main things : .Providing an excellent Guest experience. Preparing and serving great food .Keeping restaurants cl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Computational Mechanics (FEA) Engineer

    Computational Mechanics (FEA) Engineer

    USA Thornton Tomasetti, Inc. • Chicago, IL, US
    [job_card.full_time]
    An independent organization of creative thinkers and innovative doers collaborating from offices worldwide, our mission is to bring our clients' ideas to life and, in the process, lay the groun...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    QC Lead

    QC Lead

    WOTM - Partners Professional • Bridgeview, IL, US
    [job_card.full_time] +1
    Job Title : Quality Control Lead.Location : 8407 S 77th Ave.Type : Direct Hire – Fulltime opportunity .Sh...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Travel Nurse RN - ICU - Intensive Care Unit - $2,673 per week

    Travel Nurse RN - ICU - Intensive Care Unit - $2,673 per week

    Rang Healthcare • Zion, IL, United States
    [job_card.permanent]
    Rang Healthcare is seeking a travel nurse RN ICU - Intensive Care Unit for a travel nursing job in Zion, Illinois.Job Description & Requirements. ICU RN for Stem Cell Transplant and Car-T patient un...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Backend API Engineer

    Backend API Engineer

    AHEAD • Chicago, IL, United States
    [job_card.full_time]
    The Backend API Engineer will build the APIs and platform services that agents and the UI consume.They will also be responsible for performant, reliable, secure endpoints and real-time interfaces e...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Low-Voltage Field Tech

    Low-Voltage Field Tech

    Keyth Security Systems Inc • Highland Park, IL, US
    [job_card.permanent]
    We are seeking a dedicated and skilled Low-Voltage Field Technician to join our dynamic team.This role offers an exciting opportunity to work on a variety of low-voltage systems, providing essentia...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    CRNA - Anesthesiology job available in Chicago, Illinois

    CRNA - Anesthesiology job available in Chicago, Illinois

    Palm Health Resources • Zion, IL, US
    [job_card.part_time]
    New direct-hire CRNA position available near the IL / WI state line.This area is commutable from Greater Milwaukee & Greater Chicago. This is a unique and rewarding opportunity as the employer is ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Service Engineer

    Service Engineer

    Supermicro • Chicago, IL, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Telemedicine Physician

    Telemedicine Physician

    QuickMD • Zion, IL, US
    [job_card.full_time]
    QuickMD is a leading telemedicine provider, delivering high-quality virtual care across 44 states.Since our founding in 2019, we have helped more than 100,000 patients access essential medical trea...[show_more]
    [last_updated.last_updated_30] • [promoted]
    CDL-A Refrigerated Truck Driver in Zion, IL

    CDL-A Refrigerated Truck Driver in Zion, IL

    AllTruckJobs • Zion, IL, US
    [job_card.full_time]
    Ready for a career upgrade? Join Marten Transport! As a stable, financially healthy carrier – and a 2025 TCA Elite Fleet honoree – we offer the best of both worlds : high miles in your region and th...[show_more]
    [last_updated.last_updated_30] • [promoted]
    CDL-A Lease Driver - Up to $230,000 per year

    CDL-A Lease Driver - Up to $230,000 per year

    Trekker • Highland Park, IL, US
    [job_card.full_time]
    We believe every driver deserves real ownership, real respect, and real opportunity.Our Lease Purchase Program is built around. We built our Lease Purchase Program around what matters most : .We&rsquo...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Application System Administrator

    Application System Administrator

    Powers Health • Munster, IN, US
    [job_card.full_time]
    Reporting to the Application Manager, the Applications System Administrator is responsible for coordinating all operational aspects for applications assigned as the primary system administrator and...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Sandwich Artist

    Sandwich Artist

    Subway - 18170-0 • Zion, IL, US
    [job_card.full_time] +1
    As part of the Subway® Team, you as a Sandwich Artist ® will focus on four main things : .Providing an excellent Guest experience. Preparing and serving great food .Keeping restaurants cl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    remote Kernel Developer

    remote Kernel Developer

    LaBine and Associates • Chicago, IL, US
    [filters.remote]
    [job_card.full_time]
    Fulltime and remote friendly opportunity for a.As a Kernel Software Developer at our global client, you will design, implement, and maintain key subsystems in the kernel, working across Windows, Li...[show_more]
    [last_updated.last_updated_30] • [promoted]