Talent.com
CUDA Kernel Engineer
CUDA Kernel EngineerPRAGMATIKE • Washington D.C., District of Columbia, United States
CUDA Kernel Engineer

CUDA Kernel Engineer

PRAGMATIKE • Washington D.C., District of Columbia, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Location : Cambridge, MA (Eastern Time / UTC -4) Relocation package available

Start date : ASAP

Languages : English (required)

About the Role

Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital , founded by MIT CSAIL researchers.

We are searching for a CUDA Kernel Engineer who has hands-on experience developing and optimizing NVIDIA CUDA kernels from scratch . You will work on the GPU performance layer powering large-scale, high-throughput AI systems used by Fortune 500 customers.

This role is ideal for someone who deeply understands NVIDIA GPU architecture, memory hierarchy, warp-level execution, and profiling workflows not someone coming from generic hardware, FPGA, or non-NVIDIA compute backgrounds. You will directly influence the GPU efficiency, throughput, and scalability of mission-critical AI systems.

What Youll Do

  • Design, implement, and optimize custom CUDA kernels for NVIDIA GPUs , with a focus on maximizing occupancy, memory throughput, and warp efficiency.
  • Profile GPU workloads using tools such as N sight Compute, Nsight Systems, nvprof, and CUDA‐MEMCHECK .
  • Analyze and eliminate performance bottlenecks including warp divergence, uncoalesced memory access, register pressure, and PCIe transfer overhead.
  • Improve GPU memory pipelines (global, shared, L2, texture memory) and ensure proper memory coalescing.
  • Collaborate closely with AI systems, model acceleration, and backend distributed systems teams.
  • Contribute to GPU architecture decisions, kernel libraries, and internal performance-engineering best practices.

What Were Looking For

  • Proven track record building NVIDIA CUDA kernels from scratchnot just calling existing libraries.
  • Strong ability to optimize kernels (tiling strategies, occupancy tuning, shared memory design, warp scheduling).
  • Deep understanding of CUDA threads, warps, blocks, and grids, GPU memory hierarchy and memory coalescing, as well as warp divergence (how to detect, analyze, and mitigate it)
  • Experience diagnosing PCIe bottlenecks and optimizing host-device transfers (pinned memory, streams, batching, overlap).
  • Familiarity with C++, CUDA runtime APIs, and GPU debugging / profiling tooling.
  • Bonus Points

  • Experience with multi-GPU or distributed GPU systems (NCCL, NVLink, MIG).
  • Background in GPU acceleration for ML frameworks or HPC workloads.
  • Knowledge of model inference optimization (TensorRT, CUDA Graphs, CUTLASS).
  • Exposure to compiler-level optimization or PTX / SASS analysis.
  • Startup experience or comfort working in fast-moving, ambiguous environments.
  • Why This Role Will Pivot Your Career

  • Research pedigree : MIT CSAIL founders recognized for breakthrough AI and systems contributions.
  • Customer impact : Deploy AI solutions powering Fortune 500 clients .
  • Industry momentum : Lab alumni have led high-value acquisitions (MosaicML Databricks, Run : AI Nvidia, W&B CoreWeave).
  • Funding & growth : Oversubscribed seed round, next funding in 2026.
  • Career growth & influence : Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale .
  • Culture & autonomy : Own critical systems while collaborating with world-class engineers.
  • Aspirational impact : Solve GPU / AI performance challenges few engineers ever face.
  • Benefits

  • Competitive salary & equity options
  • Sign-on bonus
  • Health, Dental, and Vision
  • 401k
  • Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

    [job_alerts.create_a_job]

    Engineer • Washington D.C., District of Columbia, United States

    [internal_linking.similar_jobs]
    Mission Platform Engineer - Kubernetes & APIs

    Mission Platform Engineer - Kubernetes & APIs

    Palantir Technologies • Washington, DC, United States
    [job_card.full_time]
    An established industry player is seeking a Mission Manager to empower US Government customers with robust software solutions. This role focuses on building elegant APIs and managing Kubernetes-base...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Reverse / Embedded Engineer

    Reverse / Embedded Engineer

    Leidos Inc • Columbia, MD, United States
    [job_card.full_time]
    Leidos is an innovation company rapidly addressing the world's most vexing challenges in national security and health.Our 47,000 employees collaborate to create smarter technology solutions for cus...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior GPU RAN Engineer

    Senior GPU RAN Engineer

    DeepSig Inc Careers Page • Arlington, VA, US
    [job_card.full_time]
    This role combines expertise in GPU / CPU computing with advanced wireless system design, focusing on 5G / 6G RAN development, signal processing, and performance benchmarking.Design, develop, and optim...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Storage Engineer - Active TS / SCI with CI Poly

    Storage Engineer - Active TS / SCI with CI Poly

    ENS Solutions, LLC • Washington, DC, United States
    [job_card.full_time]
    Storage Engineer – Active TS / SCI with CI Poly.As a Storage Engineer supporting the Government, you will be trusted to engineer solutions for storage devices and backup technologies, automating data...[show_more]
    [last_updated.last_updated_30] • [promoted]
    ME00511-Systems Engineer 3

    ME00511-Systems Engineer 3

    Momentum Engineering • Columbia, Maryland, United States, 21045
    [job_card.full_time]
    Woman-Owned Small Business (WOSB), fosters an employee-centric culture.Our strength lies in our people.With a high percentage of employees holding advanced degrees in engineering, computer science,...[show_more]
    [last_updated.last_updated_variable_hours] • [new]
    Senior Model Based Systems Engineer

    Senior Model Based Systems Engineer

    The Johns Hopkins University Applied Physics Laboratory • Laurel, MD, United States
    [job_card.full_time]
    Are you a systems thinker with model-based systems engineering (MBSE) experience that wants to have impact on nationally important defense programs. Do you enjoy developing and deploying cutting edg...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Middleware Engineer

    Middleware Engineer

    Akkodis • Washington, District of Columbia, United States
    [job_card.temporary]
    Akkodis is seeking a Senior Middleware Engineer for a Contract To Hire job that is onsite in Washington, DC, US.The Senior Middleware Engineer will work closely with the Development, Server, DB, an...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Radar Systems Engineer

    Radar Systems Engineer

    Umbra • Arlington, VA, US
    [job_card.permanent]
    Umbra is an American space technology company delivering advanced systems, from sensors to spacecraft, that empower customers worldwide with unmatched access to critical information from space.Our ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Platform Engineer

    Platform Engineer

    Raft • Arlington, VA, United States
    [job_card.full_time]
    All of the programs we support require.All work must be conducted within the continental U.Distributed Data Systems, Platforms at Scale, and Complex Application Development, with headquarters in Mc...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Forward Deployed Engineer

    Forward Deployed Engineer

    LMI Consulting, LLC • Washington, District of Columbia, United States
    [job_card.full_time]
    Salaried High Fringe / Full-Time.LMI is seeking a skilled Forward Deployed Engineer in the Washington, DC region.Successful Forward Deployed Engineers demonstrate competency in integrating advanced t...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Platform Engineer

    Platform Engineer

    LMI Consulting, LLC • Washington, District of Columbia, United States
    [job_card.full_time]
    Salaried High Fringe / Full-Time.LMI is seeking a Platform Engineer with a minimum of 5 years of experience supporting Army enterprise solutions. LMI is a new breed of digital solutions provider dedic...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Middleware Engineer

    Middleware Engineer

    Robert Half • Washington, DC, US
    [job_card.full_time]
    We are seeking a highly skilled.This role is responsible for delivering reliable infrastructure support for web application solutions and maintaining a stable, scalable middleware environment.The i...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Middleware Engineer

    Lead Middleware Engineer

    Meta Force Technology Staffing LLC • Washington, DC, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Lead Middleware Engineer onsite Washington DC 5x per week -Clearable for DOT Public Trust - 6 month CTH CERTIFICATION REQUIRE...[show_more]
    [last_updated.last_updated_variable_days]
    Senior Kubernetes Infrastructure Engineer — Scale & Automation

    Senior Kubernetes Infrastructure Engineer — Scale & Automation

    Palantir Technologies • Washington, DC, United States
    [job_card.full_time]
    An established industry player is seeking a Senior Software Engineer to join their Substrate team, responsible for core production infrastructure. In this role, you'll design and build managed Kuber...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Requirements Engineer

    Requirements Engineer

    Nalley Consulting • Washington, DC, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Nalley Consulting is seeking full-time Requirements Engineers in metro Washington, D.Requirements Engineer LCAT : Mid and Senior Location : DIA HQ, Washington, D. TS / SCI with willingness to ...[show_more]
    [last_updated.last_updated_30]
    DevSecOps Engineer-Federal CI / CD & GitLab

    DevSecOps Engineer-Federal CI / CD & GitLab

    IMAGINEEER LLC • Washington, DC, US
    [job_card.full_time]
    CI / CD pipelines using GitLab across complex, multi-cloud environments.You will work closely with cybersecurity, application development, and infrastructure teams to embed security into every stage ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Systems Engineer (MId) Job #576

    Systems Engineer (MId) Job #576

    Allen Integrated Solutions • Washington, DC, US
    [job_card.full_time]
    Springfield, VA, Chantilly, VA.Minimum Years' Experience : .Overall Assignment Description : .Mid-level Systems Engineers employ a multi-discipline approach to requirements engineering, solutions e...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Radar Systems Engineer

    Radar Systems Engineer

    The Johns Hopkins University Applied Physics Laboratory • Laurel, MD, United States
    [job_card.temporary]
    Are you interested in developing advanced radar systems to make an impact on our nation's defense?.Do you want to be part of an enthusiastic team dedicated to advancing the state of the art in rada...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]