Talent.com
LLMOps Engineer
LLMOps Engineersteampunk • McLean, Maryland, USA
LLMOps Engineer

LLMOps Engineer

steampunk • McLean, Maryland, USA
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Overview

We are looking for an experienced Senior LLMOps Engineer to design implement and maintain production-grade large-language-model (LLM) pipelines deployment architectures and monitoring systems across enterprise environments. The Senior LLMOps Engineer will play a critical role in operationalizing generative AI capabilities ensuring that LLM-based applications are scalable secure reliable and compliant with emerging AI risk and governance frameworks. This role spans the spectrum of model deployment orchestration evaluation and optimization.

Contributions

  • Architect and maintain scalable LLM and RAG pipelines including model hosting inference optimization retrieval layers and context management frameworks.
  • Lead the design and implementation of secure GenAI infrastructure across cloud environments ensuring reliability performance and cost efficiency.
  • Build and manage automated evaluation systems that assess LLM output quality safety latency and adherence to AI governance requirements.
  • Develop CI / CD workflows tailored for LLM- and GenAI-based applications including dataset versioning model lineage and automated testing of prompt and model behaviors.
  • Collaborate with AI Product Engineers and Data Scientists to productionize LLM-based prototypes into enterprise-grade maintainable systems.
  • Integrate vector databases model gateways content filters and guardrail frameworks into end-to-end LLM solutions.
  • Implement observability and monitoring solutions that track performance metrics hallucination rates cost profiles and user interaction patterns.
  • Lead troubleshooting and root-cause analysis for issues related to LLM deployment inference performance or pipeline reliability.
  • Stay current with emerging LLM architectures inference optimizations fine-tuning techniques and relevant MLSecOps patterns.
  • Ensure compliance with data privacy ethical AI and AI-governance frameworks throughout pipeline design and operations.
  • Mentor junior engineers and contribute to Steampunks AI engineering best practices tooling and reusable infrastructure patterns.
  • You will contribute to the growth of our AI & Data Exploitation Practice!

Qualifications

  • Ability to hold a position of public trust with the U.S. government.
  • Bachelors and 8 years of experience.
  • 5 years of experience in software engineering data engineering MLOps or cloud engineering with 2 years focusing specifically on LLM or GenAI operations.
  • Strong experience deploying models using frameworks such as Hugging Face Transformers vLLM TensorRT -LLM or similar.
  • Proficiency in Python and operational tooling such as FastAPI PyTorch LangChain LlamaIndex and vector databases (FAISS Milvus Pinecone or similar).
  • Advanced knowledge of cloud platforms (AWS Azure GCP) including model hosting distributed compute and secure networking patterns.
  • Hands-on experience building CI / CD pipelines automated testing frameworks and environment provisioning for AI / ML workloads.
  • Experience with Docker Kubernetes and infrastructure-as-code (Terraform CloudFormation).
  • Familiarity with MLSecOps AI governance model hardening prompt injection defenses and content safety monitoring.
  • Strong understanding of logging observability and performance profiling for high-throughput LLM inference systems.
  • Excellent written and verbal communication skills with the ability to explain trade-offs and architectural decisions to technical and non-technical stakeholders.
  • Demonstrated ability to balance long-term platform thinking with hands-on operations and rapid problem solving.
  • Experience working in agile teams and using modern project management tools.
  • About steampunk

    Steampunk relies on several factors to determine salary including but not limited to geographic location contractual requirements education knowledge skills competencies and experience. The projected compensation range for this position is $140000 to $190000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunks total compensation package for employees. Learn more about additional Steampunk benefits here.

    Identity Statement

    As part of the application process you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

    Steampunk is a Change Agent in the Federal contracting industry bringing new thinking to clients in the Homeland Federal Civilian Health and DoD sectors. Through our Human-Centered delivery methodology we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges. As an employee owned company we focus on investing in our employees to enable them to do the greatest work of their careers and rewarding them for outstanding contributions to our growth. If you want to learn more about our story visit .

    We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race color religion sex national origin disability status protected veteran status or any other characteristic protected by participates in the E-Verify program.

    Key Skills

    ASP.NET,Health Education,Fashion Designing,Fiber,Investigation

    Employment Type : Unclear

    Experience : years

    Vacancy : 1

    Monthly Salary Salary : 140000 - 190000

    [job_alerts.create_a_job]

    Engineer • McLean, Maryland, USA

    [internal_linking.similar_jobs]
    Solutions Engineer

    Solutions Engineer

    Deltek, Inc. • Herndon, VA, United States
    [job_card.full_time]
    Solution Engineer - Quality & Manufacturing.As the recognized global standard for project-based businesses, Deltek delivers software and information solutions to help organizations achieve their pu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Site Reliability Engineer - Kubernetes

    Site Reliability Engineer - Kubernetes

    Verisign • Reston, VA, United States
    [job_card.full_time]
    Verisign helps enable the security, stability, and resiliency of the internet.We are a trusted provider of internet infrastructure services for the networked world and deliver unmatched performance...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer ((5-Day office, No remote work)

    Senior Software Engineer ((5-Day office, No remote work)

    MCL Systems Limited • Manassas, VA, US
    [filters.remote]
    [job_card.full_time]
    Senior Software Engineer (5-Day office, No remote work) Job Overview A senior self-driven Database / JavaScript developer with experience in one or more JavaScript Frameworks, CSS, HTML5 and having...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Quality Control Analyst II / III, Analytical

    Quality Control Analyst II / III, Analytical

    Precigen, Inc • Germantown, MD, US
    [job_card.full_time]
    Quality Control Analyst II / III- Analytical.Precigen is a dedicated discovery and clinical stage biopharmaceutical company advancing the next generation of gene and cell therapies using precision te...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Software Engineer (Summit)

    Software Engineer (Summit)

    TEKsystems • Reston, VA, United States
    [job_card.full_time]
    Summit experience(test / dev) needed, java8 / 17, C++, selenium(Winium), Oracle, Unix, Autosys, CICD, Agile.A Summit Developer designs, develops, and maintains software, often for financial platforms l...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Embedded Software Engineer

    Senior Embedded Software Engineer

    Leonardo DRS • Frederick, MD, United States
    [job_card.full_time]
    The Leonardo DRS Airborne and Intelligence Systems business is a global leader and strategic partner committed to delivering world-class, full life-cycle defense and intelligence products that prot...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Field Service Engineer III Ashburn VA (Winchester VA / Frederick MD)

    Field Service Engineer III Ashburn VA (Winchester VA / Frederick MD)

    Segra • Frederick, MD, United States
    [job_card.full_time]
    Segra is searching for a dynamic and experienced.Ashburn / Winchester VA; Frederick MD (NOVA).Based on the manager's evaluation of candidate experience and competency, we are open to hiring for this ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Linux Infrastructure-as-Code DevOps Engineer

    Linux Infrastructure-as-Code DevOps Engineer

    The Aerospace Corporation • Chantilly, VA, United States
    [job_card.full_time]
    The Aerospace Corporation is the trusted partner to the nation's space programs, solving the hardest problems and providing unmatched technical expertise. As the operator of a federally funded resea...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Customer Support Engineer

    Customer Support Engineer

    VirtualVocations • Manassas, Virginia, United States
    [job_card.full_time]
    A company is looking for a Customer Support Engineer.Key Responsibilities Provide top-tier support by resolving L3 / L4 technical issues for customers Collaborate with sales, product, and engineer...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Overnight Customer Support Engineer

    Overnight Customer Support Engineer

    VirtualVocations • Manassas, Virginia, United States
    [job_card.full_time]
    A company is looking for an Overnight Customer Support Engineer to join their Customer Support team.Key Responsibilities Provide technical support for Merchants and Partners through the internal ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Refrigerated Truck Driver in Linganore, MD

    Refrigerated Truck Driver in Linganore, MD

    AllTruckJobs • Germantown, US
    [job_card.full_time]
    Competitive weekly pay (inquire for details) .At Marten Transport—a 2025 TCA Elite Fleet—you’ll go the distance with strong pay, flexible home time, and unmatched support.When you’re behind the whe...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Mammography Tech - $3,446 to $3,659 per week in Lutherville Timonium, MD

    Travel Mammography Tech - $3,446 to $3,659 per week in Lutherville Timonium, MD

    AlliedTravelCareers • Germantown, Maryland, US
    [job_card.full_time]
    Job Description & Requirements.Mammography Tech - (Mam - Mammo Tech) .StartDate : 2 / 2 / 2026 Available Shifts : 8 D Pay Rate : $3446. Mammo Tech for Timonium, MD This opening is for a Mammography ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Software Engineer

    Software Engineer

    Arete • Falls Church, VA, US
    [job_card.full_time]
    At Areté, we are on the forefront of utilizing innovative solutions, with great minds from all backgrounds, to help solve the nation's most complex security challenges.We strive for an i...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Writing Consultant

    Remote Writing Consultant

    Outlier • Germantown, MD, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Remote English Writer

    Remote English Writer

    Outlier • Germantown, MD, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $16 USD / hourly and work fully remotely and flexibly.Outlier, a platform owned and operated by Scale AI, is looking for. If you're passionate about improving models and excited by the futu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Classified Linux Engineer

    Classified Linux Engineer

    The Aerospace Corporation • Chantilly, VA, United States
    [job_card.full_time]
    The Aerospace Corporation is the trusted partner to the nation's space programs, solving the hardest problems and providing unmatched technical expertise. As the operator of a federally funded resea...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Embedded Software Engineer

    Embedded Software Engineer

    Leonardo DRS • Frederick, MD, United States
    [job_card.full_time]
    The Leonardo DRS Airborne and Intelligence Systems business is a global leader and strategic partner committed to delivering world-class, full life-cycle defense and intelligence products that prot...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel Mammography Tech - $3,411 to $3,622 per week in Lutherville Timonium, MD

    Travel Mammography Tech - $3,411 to $3,622 per week in Lutherville Timonium, MD

    AlliedTravelCareers • Germantown, Maryland, US
    [job_card.full_time]
    Job Description & Requirements.Mammography Tech - (Mam - Mammo Tech) .StartDate : ASAP Available Shifts : 8 D Pay Rate : $3411. Mammo Tech for Lutherville, MD Travel Mammography Tech jobs in Lut...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]