Talent.com
Staff / Principal ML Ops Engineer
Staff / Principal ML Ops EngineerPRAGMATIKE • Washington D.C., District of Columbia, United States
Staff / Principal ML Ops Engineer

Staff / Principal ML Ops Engineer

PRAGMATIKE • Washington D.C., District of Columbia, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Location : Cambridge, MA (Eastern Time / UTC -4) Relocation package available

Start date : ASAP

Languages : English (required)

About the Role

Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital , founded by MIT CSAIL researchers.

We are seeking a Staff / Principal ML Ops Engineer to lead the design, implementation, and scaling of the companys ML infrastructure and production AI systems. This is a high-impact, architecture-defining role where youll work across the entire model lifecycletraining, evaluation, deployment, observability, and continuous optimization.

You will partner closely with AI researchers, GPU systems engineers, backend teams, and product stakeholders to ensure the companys large-scale AI systems are robust, efficient, automated, and production-grade . This role is ideal for someone who has already built and owned ML platforms at scale and can drive strategy as well as hands-on execution.

What Youll Do

  • Architect, build, and scale the end-to-end ML Ops pipeline, including training, fine-tuning, evaluation, rollout, and monitoring.
  • Design reliable infrastructure for model deployment, versioning, reproducibility, and orchestration across cloud and on-prem GPU clusters.
  • Optimize compute usage across distributed systems (Kubernetes, autoscaling, caching, GPU allocation, checkpointing workflows).
  • Lead the implementation of observability for ML systems (monitor drift, performance, throughput, reliability, cost).
  • Build automated workflows for dataset curation, labeling, feature pipelines, evaluation, and CI / CD for ML models.
  • Collaborate with researchers to productionize models and accelerate training / inference pipelines.
  • Establish ML Ops best practices, internal standards, and cross-team tooling.
  • Mentor engineers and influence architectural direction across the entire AI platform.

What Were Looking For

  • Deep hands-on experience designing and operating production ML systems at scale (Staff / Principal-level expected).
  • Strong background in ML Ops, distributed systems, and cloud infrastructure (AWS, GCP, or Azure).
  • Proficiency with Python and familiarity with TypeScript or Go for platform integration.
  • Expertise in ML frameworks :  PyTorch, Transformers, vLLM, Llama-factory, Megatron-LM, CUDA / GPU acceleration (practical understanding)
  • Strong experience with containerization and orchestration (Docker, Kubernetes, Helm, autoscaling).
  • Deep understanding of ML lifecycle workflows : training, fine-tuning, evaluation, inference, model registries.
  • Ability to lead technical strategy, collaborate cross-functionally, and operate in fast-paced environments
  • Bonus Points

  • Experience deploying and operating LLMs and generative models in production at enterprise scale.
  • Familiarity with DevOps, CI / CD, automated deployment pipelines, and infrastructure-as-code.
  • Experience optimizing GPU clusters, scheduling, and distributed training frameworks.
  • Prior startup experience or comfort operating with ambiguity and high ownership.
  • Experience working with data engineering, feature pipelines, or real-time ML systems.
  • Why This Role Will Pivot Your Career

  • Research pedigree : MIT CSAIL founders recognized for breakthrough AI and systems contributions.
  • Customer impact : Deploy AI solutions powering Fortune 500 clients .
  • Industry momentum : Lab alumni have led high-value acquisitions (MosaicML Databricks, Run : AI Nvidia, W&B CoreWeave).
  • Funding & growth : Oversubscribed seed round, next funding in 2026.
  • Career growth & influence : Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale .
  • Culture & autonomy : Own critical systems while collaborating with world-class engineers.
  • Aspirational impact : Solve AI performance challenges few engineers ever face.
  • Benefits

  • Competitive salary & equity options
  • Sign-on bonus
  • Health, Dental, and Vision
  • 401k
  • Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

    [job_alerts.create_a_job]

    Principal Ml Engineer • Washington D.C., District of Columbia, United States

    [internal_linking.similar_jobs]
    Modeling and Simulation Engineer

    Modeling and Simulation Engineer

    BOOZ, ALLEN & HAMILTON, INC. • Alexandria, VA, US
    [job_card.full_time] +1
    Modeling and Simulation Engineer.Are you looking for an opportunity to combine your technical skills with big picture thinking to make an impact on national security? As a Modeling and Simulation (...[show_more]
    [last_updated.last_updated_less] • [promoted] • [new]
    Multi-Modality Technologist S

    Multi-Modality Technologist S

    University Of Maryland Medical System • Fort Washington, MD, US
    [job_card.full_time]
    We’re looking for a MULTI-MODALITY Technologist to join our extraordinary Team at University of Maryland Capital Region Medical Center. Our affiliation with the University of Maryland Medical ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Security Engineer

    Lead Security Engineer

    Foxhole Technology • Alexandria, VA, United States
    [job_card.full_time]
    Job Title : Lead Security Engineer.Clearance : Top Secret w / SCI eligibility.Start : Based on Contract Award.Foxhole Technology provides robust cybersecurity and IT support capabilities for federal civ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Advanced Endoscopy Gastroenterology Physician

    Advanced Endoscopy Gastroenterology Physician

    HCA Healthcare • Alexandria, US
    [job_card.full_time]
    Gastroenterology Advanced Endoscopy.Rapides Regional Medical Center is seeking an advanced gastroenterologist to join and expand the gastroenterology service line in Alexandria, Louisiana.Seeking a...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    OB / GYN

    OB / GYN

    Skagit Regional Health • Mount Vernon, US
    [job_card.full_time]
    OB / GYN – Mount Vernon, Washington.Do you want to build your career while strengthening your community? Skagit Regional Health is seeking a OB / GYN to join our growing Women’s Health prac...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Engineer Lead (Electromagnetic Compatibility) - Washington, D.C.

    Engineer Lead (Electromagnetic Compatibility) - Washington, D.C.

    Serco North America • Washington, DC, US
    [job_card.full_time] +1
    If you seek a rewarding, high profile and challenging position supporting projects for the US Navy, then Serco has a wonderful opportunity for you!. As the Engineer Lead (Electromagnetic Compatibili...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Neonatologist

    Neonatologist

    Pediatrix Medical Group • Alexandria, US
    [job_card.full_time]
    NICU Excellence + Collegial Team + Home Call - Discover Your Next Career Move.Rapides Women's and Children's Hospital (RWCH). This is more than just a job ? it's a chance to make a meaningful impact...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. AI / ML Engineer II (6182)

    Sr. AI / ML Engineer II (6182)

    Metrostar • Capitol Heights, Maryland, United States
    [job_card.full_time]
    AI / ML models for IC missions—spanning feature engineering, training, evaluation, drift monitoring, and deployment across classified fabrics (MLOps at scale). AI / ML Lead on team consisting of softwar...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    Corcentric • Bethesda, MD, United States
    [job_card.full_time] +1
    As a Principal Software Engineer at Corcentric, you will join a driven, innovative team within an ambitious, entrepreneurial global organization. You will lead the design and implementation of moder...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. ML Engineer

    Sr. ML Engineer

    Blend360 • Chevy Chase, Maryland, United States
    [filters.remote]
    [job_card.full_time]
    Blend is seeking an experienced Machine Learning Engineer with deep expertise in AWS-based ML pipelines, MLOps best practices, and infrastructure-as-code. This role is focused entirely on pipeline e...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Exceptional Opportunity for Endocrinologist Ready to make a Lasting Impact? Step Up and Make Your Mark

    Exceptional Opportunity for Endocrinologist Ready to make a Lasting Impact? Step Up and Make Your Mark

    SSM Health • Mount Vernon, US
    [job_card.full_time]
    SSM Health is an Equal Opportunity Employer : .Join a thriving community and elevate your career as an Endocrinologist with SSM Health - Illinois! We invite you to take over an established outpatient...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI / ML Engineer Manager

    AI / ML Engineer Manager

    Accenture Federal Services • Arlington, VA, United States
    [job_card.full_time]
    At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared pu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff / Principal ML Ops Engineer

    Staff / Principal ML Ops Engineer

    PRAGMATIKE • Washington, DC, US
    [job_card.full_time]
    Cambridge, MA (Eastern Time / UTC -4).Pragmatike is hiring on behalf of a.AI startup recognized as a Top 10 GenAI company by GTM Capital. Staff / Principal ML Ops Engineer.ML infrastructure and prod...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Local Contract Ultrasound Technologist

    Local Contract Ultrasound Technologist

    Medical Solutions Allied • Alexandria, VA, US
    [job_card.full_time]
    Medical Solutions Allied is seeking a local contract Ultrasound Technologist for a local contract job in Alexandria, Virginia. Job Description & Requirements.We’re seeking talented healthc...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    14T - THAAD Launching Station Enhanced Operator / Maintainer

    14T - THAAD Launching Station Enhanced Operator / Maintainer

    IDS International • Arlington, VA, US
    [job_card.full_time]
    IDS believes in resolving conflict, building innovative approaches to do so.Combining operational expertise with an intimate understanding of today’s greatest challenges, we bring our custome...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Systems Operations Engineer II

    Systems Operations Engineer II

    InsideHigherEd • Washington D.C., United States
    [job_card.full_time]
    The Talent Acquisition department hires qualified candidates to fill positions which contribute to the overall strategic success of Howard University. Hiring staff “for fit” makes significant contri...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Nuclear Medicine Technologist-Radiology OP-Part Time

    Nuclear Medicine Technologist-Radiology OP-Part Time

    CHRISTUS Health • Alexandria, United States
    [job_card.part_time]
    Description Summary : The Nuclear Medicine Technologist will perform a wide variety of routine and advanced imaging procedures, will provide support for other imaging technologists as needed, and he...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal ML Engineer, ML Platform Engineering

    Principal ML Engineer, ML Platform Engineering

    Xometry • North Bethesda, MD, US
    [job_card.full_time]
    Xometry (NASDAQ : XMTR) powers the industries of today and tomorrow by connecting the people with big ideas to the manufacturers who can bring them to life. Xometry's digital marketplace gives ma...[show_more]
    [last_updated.last_updated_30] • [promoted]