Talent.com
CUDA Kernel Engineer
CUDA Kernel EngineerPRAGMATIKE • Washington D.C., District of Columbia, United States
CUDA Kernel Engineer

CUDA Kernel Engineer

PRAGMATIKE • Washington D.C., District of Columbia, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Location : Cambridge, MA (Eastern Time / UTC -4) Relocation package available

Start date : ASAP

Languages : English (required)

About the Role

Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital , founded by MIT CSAIL researchers.

We are searching for a CUDA Kernel Engineer who has hands-on experience developing and optimizing NVIDIA CUDA kernels from scratch . You will work on the GPU performance layer powering large-scale, high-throughput AI systems used by Fortune 500 customers.

This role is ideal for someone who deeply understands NVIDIA GPU architecture, memory hierarchy, warp-level execution, and profiling workflows not someone coming from generic hardware, FPGA, or non-NVIDIA compute backgrounds. You will directly influence the GPU efficiency, throughput, and scalability of mission-critical AI systems.

What Youll Do

  • Design, implement, and optimize custom CUDA kernels for NVIDIA GPUs , with a focus on maximizing occupancy, memory throughput, and warp efficiency.
  • Profile GPU workloads using tools such as N sight Compute, Nsight Systems, nvprof, and CUDA‐MEMCHECK .
  • Analyze and eliminate performance bottlenecks including warp divergence, uncoalesced memory access, register pressure, and PCIe transfer overhead.
  • Improve GPU memory pipelines (global, shared, L2, texture memory) and ensure proper memory coalescing.
  • Collaborate closely with AI systems, model acceleration, and backend distributed systems teams.
  • Contribute to GPU architecture decisions, kernel libraries, and internal performance-engineering best practices.

What Were Looking For

  • Proven track record building NVIDIA CUDA kernels from scratchnot just calling existing libraries.
  • Strong ability to optimize kernels (tiling strategies, occupancy tuning, shared memory design, warp scheduling).
  • Deep understanding of CUDA threads, warps, blocks, and grids, GPU memory hierarchy and memory coalescing, as well as warp divergence (how to detect, analyze, and mitigate it)
  • Experience diagnosing PCIe bottlenecks and optimizing host-device transfers (pinned memory, streams, batching, overlap).
  • Familiarity with C++, CUDA runtime APIs, and GPU debugging / profiling tooling.
  • Bonus Points

  • Experience with multi-GPU or distributed GPU systems (NCCL, NVLink, MIG).
  • Background in GPU acceleration for ML frameworks or HPC workloads.
  • Knowledge of model inference optimization (TensorRT, CUDA Graphs, CUTLASS).
  • Exposure to compiler-level optimization or PTX / SASS analysis.
  • Startup experience or comfort working in fast-moving, ambiguous environments.
  • Why This Role Will Pivot Your Career

  • Research pedigree : MIT CSAIL founders recognized for breakthrough AI and systems contributions.
  • Customer impact : Deploy AI solutions powering Fortune 500 clients .
  • Industry momentum : Lab alumni have led high-value acquisitions (MosaicML Databricks, Run : AI Nvidia, W&B CoreWeave).
  • Funding & growth : Oversubscribed seed round, next funding in 2026.
  • Career growth & influence : Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale .
  • Culture & autonomy : Own critical systems while collaborating with world-class engineers.
  • Aspirational impact : Solve GPU / AI performance challenges few engineers ever face.
  • Benefits

  • Competitive salary & equity options
  • Sign-on bonus
  • Health, Dental, and Vision
  • 401k
  • Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

    [job_alerts.create_a_job]

    Engineer • Washington D.C., District of Columbia, United States

    [internal_linking.similar_jobs]
    Travel Cath Lab Tech - $2,923 per week in Frederick, MD

    Travel Cath Lab Tech - $2,923 per week in Frederick, MD

    AlliedTravelCareers • Columbia, Maryland, US
    [job_card.full_time]
    AlliedTravelCareers is working with Olaro to find a qualified Cath Lab Tech in Frederick, Maryland, 21701!.We are seeking a highly skilled and detail-oriented Cardiac Cath Lab Technologist to join ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Linux Kernel Engineer

    Linux Kernel Engineer

    VirtualVocations • Alexandria, Virginia, United States
    [job_card.full_time]
    A company is looking for a Linux Kernel Engineer to contribute to the development of advanced networking technologies.Key Responsibilities : Design and develop high-performance kernel drivers and ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Associate Engineer

    Associate Engineer

    Element Materials Technology • Columbia, MD, United States
    [job_card.permanent]
    Element has an opportunity for two.As a member of the SAR team, the Associate Engineer position performs a variety of routine and non-routine testing assignments within the department and insures t...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    DevOps Cloud Engineer

    DevOps Cloud Engineer

    ALTA IT Services • Alexandria, VA, US
    [job_card.full_time]
    Job Title : DevOps Cloud Engineer Location : Alexandria, VA DevOps Cloud Engineer Top Secret clearance $180k Alexandria, VA or Gaithersburg, MD We are looking for an experienced DevOps Cloud Network ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Machine Learning Engineer

    Machine Learning Engineer

    Welldoc Inc • Columbia, Maryland, United States
    [job_card.full_time]
    Welldoc is at the forefront of digital health, driven by a powerful mission : empowering better cardiometabolic health through AI-powered, personalized digital tech, with a vision to be the leading ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    (2736) Backend Software Engineer

    (2736) Backend Software Engineer

    Iamus Consulting • Columbia, Maryland, United States
    [filters.remote]
    [job_card.full_time]
    We are currently seeking a talented and experienced Software Engineer to join our team.As a Software Engineer, you will be responsible for designing, developing, and implementing complex software c...[show_more]
    [last_updated.last_updated_30] • [promoted]
    DevOps Engineer

    DevOps Engineer

    Twenty • Arlington, VA, United States
    [job_card.full_time]
    DevOps Engineer / Software Engineer – Infrastructure.This position is at the crossroads of software engineering, operations, and security. You will own core AWS infrastructure, drive observability a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Modeling & Simulation Engineer

    Modeling & Simulation Engineer

    BAE Systems • Rockville, MD, US
    [job_card.full_time]
    BAE Systems is seeking a Simulation Developer to support our work as a prime contractor on a high-profile U.Knowledge of system integration, dynamic analysis capabilities, and a desire to mold Mode...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    GC Service Engineer

    GC Service Engineer

    Shimadzu Scientific Instruments • Columbia, MD, United States
    [job_card.full_time]
    Established in 1975, Shimadzu Scientific Instruments is one of the largest suppliers of analytical instrumentation, physical testing, and environmental monitoring systems in the world.Ground-breaki...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Principal ASIC Static Timing Engineer

    Senior Principal ASIC Static Timing Engineer

    Northrop Grumman • Columbia, MD, US
    [job_card.full_time]
    RELOCATION ASSISTANCE : Relocation assistance may be available.At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact people's lives around the...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Platform Engineer

    Platform Engineer

    Raft • Arlington, VA, United States
    [job_card.full_time]
    All of the programs we support require.All work must be conducted within the continental U.Distributed Data Systems, Platforms at Scale, and Complex Application Development, with headquarters in Mc...[show_more]
    [last_updated.last_updated_30] • [promoted]
    GenAI Engineer

    GenAI Engineer

    Accenture Federal Services • Washington, DC, United States
    [job_card.full_time]
    At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared pu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    High Performance Computing (HPC) Linux Systems Engineer, Senior

    High Performance Computing (HPC) Linux Systems Engineer, Senior

    LCG • Bethesda, Maryland, USA
    [job_card.full_time]
    Job Title : High Performance Computing (HPC) / Linux Systems Engineer Senior.Rockville MD(Onsite required 5 days a week with potential for reduced onsite days as client needs evolve).We are seeking a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Hiring our Heroes Skillbridge - Systems Engineer

    Hiring our Heroes Skillbridge - Systems Engineer

    SYSTEMS PLANNING AND ANALYSIS, INC. • Alexandria, VA, US
    [job_card.full_time]
    Systems Planning and Analysis, Inc.SPA) delivers high-impact, technical solutions to complex national security issues.With over 50 years of business expertise and consistent growth, we are known fo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineer -Mid

    Software Engineer -Mid

    Tetrad Digital Integrity • Mount Vernon, Virginia, United States
    [job_card.full_time] +1
    Tetrad Digital Integrity (TDI) is a leading-edge cybersecurity firm with a mission to safeguard and protect our customers from increasing threats and vulnerabilities in this digital age.We are look...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    System Storage Engineer Level 6 (AESE6)

    System Storage Engineer Level 6 (AESE6)

    Advantage Engineering & IT Solutions • Howard County, Maryland, USA
    [job_card.full_time]
    GTSC company is growing its team! Seeking a.Senior System Storage Engineer Level 6.This is not a hybrid or remote position. Meets or exceeds years of required experience depending upon formal educat...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer - Senior - CCSA

    Software Engineer - Senior - CCSA

    Nemean Solutions, LLC • Pentagon, DC, United States
    [job_card.full_time]
    Nemean Solutions, headquartered in Sierra Vista, AZ, is a certified SBA 8(a) Native Hawaiian Organization (NHO) and veteran-operated company providing advanced Military Intelligence, Enterprise and...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Journeyman Cloud Engineer

    Journeyman Cloud Engineer

    Leidos Inc • Alexandria, VA, United States
    [job_card.full_time]
    At Leidos, we're more than a technology company-we're a trusted partner pioneering the future of defense and intelligence. Our diverse teams of innovators unite around a common mission : empowering o...[show_more]
    [last_updated.last_updated_30] • [promoted]