Talent.com
Staff / Principal ML Ops Engineer
Staff / Principal ML Ops EngineerPRAGMATIKE • Washington D.C., District of Columbia, United States
Staff / Principal ML Ops Engineer

Staff / Principal ML Ops Engineer

PRAGMATIKE • Washington D.C., District of Columbia, United States
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Location : Cambridge, MA (Eastern Time / UTC -4) Relocation package available

Start date : ASAP

Languages : English (required)

About the Role

Pragmatike is hiring on behalf of a fast-growing AI startup recognized as a Top 10 GenAI company by GTM Capital , founded by MIT CSAIL researchers.

We are seeking a Staff / Principal ML Ops Engineer to lead the design, implementation, and scaling of the companys ML infrastructure and production AI systems. This is a high-impact, architecture-defining role where youll work across the entire model lifecycletraining, evaluation, deployment, observability, and continuous optimization.

You will partner closely with AI researchers, GPU systems engineers, backend teams, and product stakeholders to ensure the companys large-scale AI systems are robust, efficient, automated, and production-grade . This role is ideal for someone who has already built and owned ML platforms at scale and can drive strategy as well as hands-on execution.

What Youll Do

  • Architect, build, and scale the end-to-end ML Ops pipeline, including training, fine-tuning, evaluation, rollout, and monitoring.
  • Design reliable infrastructure for model deployment, versioning, reproducibility, and orchestration across cloud and on-prem GPU clusters.
  • Optimize compute usage across distributed systems (Kubernetes, autoscaling, caching, GPU allocation, checkpointing workflows).
  • Lead the implementation of observability for ML systems (monitor drift, performance, throughput, reliability, cost).
  • Build automated workflows for dataset curation, labeling, feature pipelines, evaluation, and CI / CD for ML models.
  • Collaborate with researchers to productionize models and accelerate training / inference pipelines.
  • Establish ML Ops best practices, internal standards, and cross-team tooling.
  • Mentor engineers and influence architectural direction across the entire AI platform.

What Were Looking For

  • Deep hands-on experience designing and operating production ML systems at scale (Staff / Principal-level expected).
  • Strong background in ML Ops, distributed systems, and cloud infrastructure (AWS, GCP, or Azure).
  • Proficiency with Python and familiarity with TypeScript or Go for platform integration.
  • Expertise in ML frameworks :  PyTorch, Transformers, vLLM, Llama-factory, Megatron-LM, CUDA / GPU acceleration (practical understanding)
  • Strong experience with containerization and orchestration (Docker, Kubernetes, Helm, autoscaling).
  • Deep understanding of ML lifecycle workflows : training, fine-tuning, evaluation, inference, model registries.
  • Ability to lead technical strategy, collaborate cross-functionally, and operate in fast-paced environments
  • Bonus Points

  • Experience deploying and operating LLMs and generative models in production at enterprise scale.
  • Familiarity with DevOps, CI / CD, automated deployment pipelines, and infrastructure-as-code.
  • Experience optimizing GPU clusters, scheduling, and distributed training frameworks.
  • Prior startup experience or comfort operating with ambiguity and high ownership.
  • Experience working with data engineering, feature pipelines, or real-time ML systems.
  • Why This Role Will Pivot Your Career

  • Research pedigree : MIT CSAIL founders recognized for breakthrough AI and systems contributions.
  • Customer impact : Deploy AI solutions powering Fortune 500 clients .
  • Industry momentum : Lab alumni have led high-value acquisitions (MosaicML Databricks, Run : AI Nvidia, W&B CoreWeave).
  • Funding & growth : Oversubscribed seed round, next funding in 2026.
  • Career growth & influence : Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale .
  • Culture & autonomy : Own critical systems while collaborating with world-class engineers.
  • Aspirational impact : Solve AI performance challenges few engineers ever face.
  • Benefits

  • Competitive salary & equity options
  • Sign-on bonus
  • Health, Dental, and Vision
  • 401k
  • Pragmatike is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.

    [job_alerts.create_a_job]

    Principal Ml Engineer • Washington D.C., District of Columbia, United States

    [internal_linking.similar_jobs]
    Multi-Modality Technologist S

    Multi-Modality Technologist S

    University Of Maryland Medical System • Fort Washington, MD, US
    [job_card.full_time]
    We’re looking for a MULTI-MODALITY Technologist to join our extraordinary Team at University of Maryland Capital Region Medical Center. Our affiliation with the University of Maryland Medical ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Advanced Endoscopy Gastroenterology Physician

    Advanced Endoscopy Gastroenterology Physician

    HCA Healthcare • Alexandria, US
    [job_card.full_time]
    Gastroenterology Advanced Endoscopy.Rapides Regional Medical Center is seeking an advanced gastroenterologist to join and expand the gastroenterology service line in Alexandria, Louisiana.Seeking a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Optical Astronomer / Astronomy Tool Developer

    Optical Astronomer / Astronomy Tool Developer

    Computational Physics, Inc. • Washington, DC, US
    [job_card.full_time]
    CPI) is seeking a scientific software engineer / developer with a background in space systems, astronomy, or physics to support our customers at the United States Naval Observatory (USNO).The USNO is...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineer / Machine Learning Senior

    Software Engineer / Machine Learning Senior

    iN2STEM Solutions Inc • Fort Belvoir, VA, US
    [job_card.full_time]
    Software Engineer / Machine Learning Senior.The selected candidates will be responsible for the implementation and operation of a life cycle development and sustainment environment for a cloud-base...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer and Technology Lead

    Principal Software Engineer and Technology Lead

    Ten Mile Square Technologies • Arlington, VA, US
    [job_card.full_time]
    Ten Mile Square Technologies is a high-end technology consulting firm based in the Northern Virginia area.Our customers routinely call upon us to solve some of the largest scale and hardest problem...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    SlyFox Solutions LLC • Woodbine, MD, US
    [job_card.full_time]
    The Principal Software Engineer will drive the company's technical vision and provide strategic guidance to the software development team. This senior role is for an individual with deep industr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Neonatologist

    Neonatologist

    Pediatrix Medical Group • Alexandria, US
    [job_card.full_time]
    NICU Excellence + Collegial Team + Home Call - Discover Your Next Career Move.Rapides Women's and Children's Hospital (RWCH). This is more than just a job ? it's a chance to make a meaningful impact...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. AI / ML Engineer II (6182)

    Sr. AI / ML Engineer II (6182)

    Metrostar • Capitol Heights, Maryland, United States
    [job_card.full_time]
    AI / ML models for IC missions—spanning feature engineering, training, evaluation, drift monitoring, and deployment across classified fabrics (MLOps at scale). AI / ML Lead on team consisting of softwar...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Wireless Communications Algorithm Engineer

    Wireless Communications Algorithm Engineer

    The Johns Hopkins University Applied Physics Laboratory • Laurel, MD, United States
    [job_card.temporary]
    Do you have experience solving real world problems related to wireless communications?.Are you searching for meaningful work to solve crucial communications challenges for the special operations an...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. ML Engineer

    Sr. ML Engineer

    Blend360 • Chevy Chase, Maryland, United States
    [filters.remote]
    [job_card.full_time]
    Blend is seeking an experienced Machine Learning Engineer with deep expertise in AWS-based ML pipelines, MLOps best practices, and infrastructure-as-code. This role is focused entirely on pipeline e...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Mammography Tech - $3,139 to $3,234 per week in Silver Spring, MD

    Travel Mammography Tech - $3,139 to $3,234 per week in Silver Spring, MD

    AlliedTravelCareers • Columbia, Maryland, US
    [job_card.full_time]
    Job Description & Requirements.Mammography Tech - (Mam - Mammo Tech) .StartDate : ASAP Available Shifts : 8 D Pay Rate : $3139. Mammo Tech for Silver Spring, MD The Mammo Tech position is locat...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Exceptional Opportunity for Endocrinologist Ready to make a Lasting Impact? Step Up and Make Your Mark

    Exceptional Opportunity for Endocrinologist Ready to make a Lasting Impact? Step Up and Make Your Mark

    SSM Health • Mount Vernon, US
    [job_card.full_time]
    SSM Health is an Equal Opportunity Employer : .Join a thriving community and elevate your career as an Endocrinologist with SSM Health - Illinois! We invite you to take over an established outpatient...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Staff / Principal ML Ops Engineer

    Staff / Principal ML Ops Engineer

    PRAGMATIKE • Washington, DC, US
    [job_card.full_time]
    Cambridge, MA (Eastern Time / UTC -4).Pragmatike is hiring on behalf of a.AI startup recognized as a Top 10 GenAI company by GTM Capital. Staff / Principal ML Ops Engineer.ML infrastructure and prod...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Engineer, C++ Systems Integration (R4018)

    Staff Engineer, C++ Systems Integration (R4018)

    Shield AI • Washington, DC, US
    [job_card.full_time] +1
    Founded in 2015, Shield AI is a venture-backed deep-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include the V-BAT and X-BAT aircr...[show_more]
    [last_updated.last_updated_30] • [promoted]
    14T - THAAD Launching Station Enhanced Operator / Maintainer

    14T - THAAD Launching Station Enhanced Operator / Maintainer

    IDS International • Arlington, VA, US
    [job_card.full_time]
    IDS believes in resolving conflict, building innovative approaches to do so.Combining operational expertise with an intimate understanding of today’s greatest challenges, we bring our custome...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Systems Operations Engineer II

    Systems Operations Engineer II

    InsideHigherEd • Washington D.C., United States
    [job_card.full_time]
    The Talent Acquisition department hires qualified candidates to fill positions which contribute to the overall strategic success of Howard University. Hiring staff “for fit” makes significant contri...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Principal Software Engineer

    Principal Software Engineer

    Capital Technology Group • Washington, DC, US
    [job_card.full_time]
    Capital Technology Group provides expert consulting services software development, digital transformation, human-centered design, data analytics and visualization, and cybersecurity.Our multidiscip...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Principal ML Engineer, ML Platform Engineering

    Principal ML Engineer, ML Platform Engineering

    Xometry • North Bethesda, MD, US
    [job_card.full_time]
    Xometry (NASDAQ : XMTR) powers the industries of today and tomorrow by connecting the people with big ideas to the manufacturers who can bring them to life. Xometry's digital marketplace gives ma...[show_more]
    [last_updated.last_updated_30] • [promoted]