Talent.com
CUDA Kernel Engineer
CUDA Kernel EngineerPRAGMATIKE • Chicago, Illinois, United States
CUDA Kernel Engineer

CUDA Kernel Engineer

PRAGMATIKE • Chicago, Illinois, United States
[job_card.1_day_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Location : Cambridge, MA (Eastern Time / UTC -4) Relocation package available

Start date : ASAP

Languages : English (required)

About the Role

Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital , founded by MIT CSAIL researchers.

We are searching for a CUDA Kernel Engineer who has hands-on experience developing and optimizing NVIDIA CUDA kernels from scratch . You will work on the GPU performance layer powering large-scale, high-throughput AI systems used by Fortune 500 customers.

This role is ideal for someone who deeply understands NVIDIA GPU architecture, memory hierarchy, warp-level execution, and profiling workflows not someone coming from generic hardware, FPGA, or non-NVIDIA compute backgrounds. You will directly influence the GPU efficiency, throughput, and scalability of mission-critical AI systems.

What Youll Do

  • Design, implement, and optimize custom CUDA kernels for NVIDIA GPUs , with a focus on maximizing occupancy, memory throughput, and warp efficiency.
  • Profile GPU workloads using tools such as N sight Compute, Nsight Systems, nvprof, and CUDA‐MEMCHECK .
  • Analyze and eliminate performance bottlenecks including warp divergence, uncoalesced memory access, register pressure, and PCIe transfer overhead.
  • Improve GPU memory pipelines (global, shared, L2, texture memory) and ensure proper memory coalescing.
  • Collaborate closely with AI systems, model acceleration, and backend distributed systems teams.
  • Contribute to GPU architecture decisions, kernel libraries, and internal performance-engineering best practices.

What Were Looking For

  • Proven track record building NVIDIA CUDA kernels from scratchnot just calling existing libraries.
  • Strong ability to optimize kernels (tiling strategies, occupancy tuning, shared memory design, warp scheduling).
  • Deep understanding of CUDA threads, warps, blocks, and grids, GPU memory hierarchy and memory coalescing, as well as warp divergence (how to detect, analyze, and mitigate it)
  • Experience diagnosing PCIe bottlenecks and optimizing host-device transfers (pinned memory, streams, batching, overlap).
  • Familiarity with C++, CUDA runtime APIs, and GPU debugging / profiling tooling.
  • Bonus Points

  • Experience with multi-GPU or distributed GPU systems (NCCL, NVLink, MIG).
  • Background in GPU acceleration for ML frameworks or HPC workloads.
  • Knowledge of model inference optimization (TensorRT, CUDA Graphs, CUTLASS).
  • Exposure to compiler-level optimization or PTX / SASS analysis.
  • Startup experience or comfort working in fast-moving, ambiguous environments.
  • Why This Role Will Pivot Your Career

  • Research pedigree : MIT CSAIL founders recognized for breakthrough AI and systems contributions.
  • Customer impact : Deploy AI solutions powering Fortune 500 clients .
  • Industry momentum : Lab alumni have led high-value acquisitions (MosaicML Databricks, Run : AI Nvidia, W&B CoreWeave).
  • Funding & growth : Oversubscribed seed round, next funding in 2026.
  • Career growth & influence : Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale .
  • Culture & autonomy : Own critical systems while collaborating with world-class engineers.
  • Aspirational impact : Solve GPU / AI performance challenges few engineers ever face.
  • Benefits

  • Competitive salary & equity options
  • Sign-on bonus
  • Health, Dental, and Vision
  • 401k
  • Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

    [job_alerts.create_a_job]

    Engineer • Chicago, Illinois, United States

    [internal_linking.similar_jobs]
    Travel MRI Tech - $2,076 to $2,302 per week in Zion, IL

    Travel MRI Tech - $2,076 to $2,302 per week in Zion, IL

    AlliedTravelNetwork • Zion, IL, US
    [job_card.full_time]
    AlliedTravelNetwork is working with LRS Healthcare to find a qualified MRI Tech in Zion, Illinois, 60099!.Ready to start your next travel adventure? LRS Healthcare offers a full benefits package, 2...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Field Sales Representative

    Field Sales Representative

    AT&T • Winthrop Harbor, IL, US
    [job_card.full_time]
    Job Description : Join an elite group of sales professionals bringing customized, white glove experiences directly in the customer's home. Field Sales Representatives at AT&T are driven to connec...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior System Administrator

    Senior System Administrator

    InsideHigherEd • Palos Hills, Illinois, United States
    [job_card.full_time]
    Infrastructure & Network Services.Under general direction, the Senior System Administrator is responsible for reviewing the design, installation, maintenance, training, and support of Windows serve...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Quality Technician / CMM Programmer

    Quality Technician / CMM Programmer

    Integrity Trade Services • Alsip, IL, US
    [job_card.permanent]
    Quality Technician / CMM Programmer.This position is a direct hire opportunity!.Integrity Trade Services is hiring a.Quality Technician / CMM Programmer. DOE! Receive comprehensive benefits through...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Quality Control Lead

    Quality Control Lead

    Partners Personnel • Bridgeview, IL, US
    [job_card.full_time] +1
    Direct Hire – Fulltime opportunity .Shift (4 PM – 2 AM) Monday-Thursday; Friday & Saturday as required.Assist in the train...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Field Representative

    Field Representative

    RDSolutions formerly RetailData • Zion, IL, US
    [job_card.part_time]
    The retail industry continues to see unprecedented dynamics as it pivots to a true omni-channel shopping experience.Informed retailers are succeeding, and RDSolutions is providing them with the con...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Lead Software Engineer

    Lead Software Engineer

    Relativity • Chicago, IL, United States
    [job_card.full_time]
    We are seeking a Lead Software Engineer to join the Retrieval Ingestion Team at Relativity.This role is ideal for an experienced engineer who thrives on designing and operating high throughput inge...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Project Engineer / Detailer-Commercial Door &Hardware

    Project Engineer / Detailer-Commercial Door &Hardware

    Kimmel and Associates • Chicago, IL, United States
    [job_card.full_time]
    The company is a leading commercial contractor specializing in Division 8 products and services.They have built a reputation for delivering turn-key solutions through their collaborative Product an...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Nurse RN - Intensive Care Unit (ICU) / Critical Care - $2,700 to $2,850 per week in Zion, IL

    Travel Nurse RN - Intensive Care Unit (ICU) / Critical Care - $2,700 to $2,850 per week in Zion, IL

    TravelNurseSource • Zion, IL, US
    [job_card.full_time] +1
    TravelNurseSource is working with Lancesoft Inc to find a qualified ICU / Critical Care RN in Zion, Illinois, 60099!.Night 3x12-Hour (19 : 00 - 07 : 30). Established in 2000, LanceSoft is a Certified MBE ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Nurse RN - ICU - Intensive Care Unit - $2,673 per week

    Travel Nurse RN - ICU - Intensive Care Unit - $2,673 per week

    Rang Healthcare • Zion, IL, United States
    [job_card.permanent]
    Rang Healthcare is seeking a travel nurse RN ICU - Intensive Care Unit for a travel nursing job in Zion, Illinois.Job Description & Requirements. ICU RN for Stem Cell Transplant and Car-T patient un...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel MRI Tech - $2,076 to $2,302 per week in Zion, IL

    Travel MRI Tech - $2,076 to $2,302 per week in Zion, IL

    LRS Healthcare • Zion, IL, US
    [job_card.full_time]
    Ready to start your next travel adventure? LRS Healthcare offers a full benefits package, 24 / 7 support, and a responsive, traveler-first culture. What are you waiting for? Apply today!.Valid license...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Field Service Engineer - Chicago

    Field Service Engineer - Chicago

    Executive Directions & Pinnacle Int'l • Chicago, IL, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    One of our clients is a German-owned (US-based) capital equipment subsidiary that sells inline automated systems for the confectionary and food industries. Due to growth and expansion in North Ameri...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Facilities Manager

    Facilities Manager

    Uline • Zion, IL, United States
    [job_card.full_time]
    Facilities Manager Wisconsin Distribution Center 12885 104th St.Pleasant Prairie, WI 53158 Set the standard for facilities excellence! As a Facilities Manager, oversee Uline’s Distribution Center w...[show_more]
    [last_updated.last_updated_30] • [promoted]
    CRNA - Anesthesiology job available in Chicago, Illinois

    CRNA - Anesthesiology job available in Chicago, Illinois

    Palm Health Resources • Zion, IL, US
    [job_card.part_time]
    Part-time or per diem CRNA needed near the Illinois - Wisconsin state line.Work 8-hour weekday shifts at a well-regarded cancer treatment hospital and see neuro, ENT, thoracic, abdominal, ortho, an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Service Engineer

    Service Engineer

    Supermicro • Chicago, IL, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Telemedicine Physician

    Telemedicine Physician

    QuickMD • Zion, IL, US
    [job_card.full_time]
    QuickMD is a leading telemedicine provider, delivering high-quality virtual care across 44 states.Since our founding in 2019, we have helped more than 100,000 patients access essential medical trea...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Engineer II

    Engineer II

    Medline Industries - Transportation & Operations • Northbrook, IL, US
    [job_card.full_time]
    Analyze existing processes and develop recommendations for new processes to improve efficiencies and labor savings.This role exists within the Operations Management Development Program (OMDP).Analy...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Gopuff Delivery Gigs

    Gopuff Delivery Gigs

    GoPuff • Highland Park, IL, US
    [job_card.part_time] +1
    Deliver with Gopuff and get paid to deliver what your neighbors need from a Gopuff facility near you! With one centralized pickup location and smaller delivery zones, Gopuff makes earning effortles...[show_more]
    [last_updated.last_updated_30] • [promoted]