Talent.com
Senior Agentic DevOps Engineer – Runtime Validation & Governance
Senior Agentic DevOps Engineer – Runtime Validation & GovernanceKeysight Technologies • Calabasas, California, US
Senior Agentic DevOps Engineer – Runtime Validation & Governance

Senior Agentic DevOps Engineer – Runtime Validation & Governance

Keysight Technologies • Calabasas, California, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Overview

Keysight is at the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization. Our ~15, employees create world-class solutions in communications, 5G, automotive, energy, quantum, aerospace, defense, and semiconductor markets for customers in over countries. Learn more about what we do.

Our award-winningculture embraces a bold vision of where technology can take us and a passion for tackling challenging problems with industry-first solutions. We believe that when people feel a sense of belonging, they can be more creative, innovative, and thrive at all points in their careers.

About the Initiative

Keysight’s Applied AI Autonomy Initiative is developing a next-generation agentic orchestration framework that enables AI agents to reason, adapt, and coordinate across complex engineering workflows. Built on LangGraph and reinforcement-inspired feedback mechanisms , this framework transforms prompts and design intents into executable orchestration strategies that evolve autonomously through iterative simulation and validation loops.

Our ambition is not merely to replicate human reasoning, but to push past human limits - enabling agentic systems to explore design spaces, optimize engineering workflows, and evolve orchestration strategies at a scale and speed no human could achieve.

To make this possible, it will require robust runtime governance and regression intelligence layer — one that ensures every autonomous action is verified, reversible, traceable, and safe before it influences live engineering systems.

This role defines that layer : the bridge between autonomy and operational trust , enabling production-scale AI-driven orchestration with assurance and auditability.

What This Role Offers — Optimized for Agentic DevOps

  • A foundational and highly visible role shaping how AI-generated orchestration earns operational trust across Keysight’s engineering ecosystem.
  • The mandate to define the validation, governance, and assurance standards that determine when and how autonomous agent logic may safely enter production.
  • Ownership of the mission-critical regression and verification pipeline , where agent actions, simulation feedback, and safety controls converge — enabling autonomy that is explainable, reversible, measurable, and audit-ready .

Responsibilities

Role Overview

As the Senior Agentic DevOps Engineer , you will architect and implement the runtime validation, control, and feedback systems that govern how agent-generated logic is tested, verified, and promoted into production.

This is not classical DevOps or CI / CD — it is Agentic DevOps : embedding intelligent agents into the deployment fabric with guardrails, feedback loops, rollback capabilities, and telemetry built into every stage.

Your mission is to enable a self-aware orchestration pipeline where agents can act, learn, adapt, and be safely governed , delivering predictable, and stable outcomes across dynamic, high-assurance environments.

Core Engineering Domains

  • Execution Integrity Architecture
  • Design sandboxed and containerized evaluation zones for testing agent-generated logic prior to deployment.
  • Build a multi-stage release pipeline spanning sandbox → validation → gated staging → monitored execution.
  • Define and enforce isolation and containment protocols to prevent propagation of unsafe or misconfigured agent actions.
  • Establish runtime health scoring , confidence thresholds , and promotion gates to control when an agent’s output can advance to production.
  • Regression Intelligence & Continuous Verification
  • Develop regression and validation frameworks tailored for agentic orchestrations to detect drift, instability, or emergent behaviors.
  • Implement baseline comparison and differential validation systems to continuously verify agent outputs against expected outcomes.
  • Construct autonomous CI / CD pipelines integrating both neural (agent-generated) and traditional (human-written) logic with versioning and reproducibility guarantees.
  • Provide predictable replay and audit mechanisms to re-execute orchestration cycles for debugging, validation, and compliance.
  • Observability, Governance & Rollback
  • Engineer always-on telemetry and introspection pipelines capturing every agent decision, validation result, and anomaly.
  • Develop snapshot and rollback frameworks enabling rapid restoration to verified system states.
  • Ensure end-to-end traceability of all orchestration artifacts, mapping which agent produced what output, with what data and under what conditions.
  • Surface trust metrics, validation outcomes, and confidence scores through operator dashboards and governance APIs in collaboration with Dev / UI teams.
  • Key Responsibilities

  • Lead the definition and implementation of validation, governance, and regression standards across Keysight’s agentic orchestration runtime.
  • Architect and deploy a continuous validation pipeline integrating feedback loops, guardrails, telemetry, and rollback systems.
  • Build self-diagnosing runtime logic that enables agents and infrastructure to detect, contain, and recover from instability autonomously.
  • Define and maintain safety certification, auditability, and reproducibility frameworks for agent-generated actions in production.
  • Collaborate with framework architects, safety engineers, ML researchers, and data intelligence teams to align validation infrastructure with orchestration and learning feedback systems.
  • Qualifications

    Required Qualifications

  • PhD or 5+ years of experience in systems engineering , runtime validation , safety-critical infrastructure , or high-assurance deployment frameworks .
  • Proficiency with CI / CD systems (e.g., Jenkins, GitLab CI, GitHub Actions, or ArgoCD) for automation, validation, and controlled deployments.
  • Proven experience designing sandboxed execution environments, controlled-release and CI / CD pipelines , or validated deployment systems at production scale.
  • Strong proficiency in Python and C / C++ , with expertise in sandbox architecture, promotion control, and rollback mechanisms.
  • Demonstrated ability in regression governance, continuous verification , and telemetry-driven runtime monitoring .
  • Proficiency with agentic AI frameworks (e.g., LangGraph, LangChain) and validation mechanisms for multi-agent orchestration and reasoning stability.
  • Preferred Qualifications

  • Experience with simulation orchestration , HPC systems , or digital-twin environments feeding live feedback into control loops.
  • Knowledge of differential validation , golden-run comparison , confidence-scored promotion models , and structured evaluation frameworks.
  • Background in governance frameworks for machine-generated logic or autonomous systems (e.g., AI or robotics).
  • The level of role will be based on applicable experience, education and skills; Most offers will be between the minimum and the midpoint of the Salary Range listed below.

    CA pay range : MIN $,- MAX $,

    Note : For other locations, pay ranges will vary by region

    This role is eligible for our Keysight Results Bonus Program

    US Employees may be eligible for the following benefits :

  • Medical, dental and vision
  • Health Savings Account
  • Health Care and Dependent Care Flexible Spending Accounts
  • Life, Accident, Disability insurance
  • Business Travel Accident and Business Travel Health
  • (k) Plan
  • Flexible Time Off, Paid Holidays
  • Paid Family Leave
  • Discounts, Perks
  • Tuition Reimbursement
  • Adoption Assistance
  • ESPP (Employee Stock Purchase Plan)
  • Restricted Stock Units
  • Careers Privacy Statement

    Keysight is an Equal Opportunity Employer

    Keysight Technologies Inc. is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other protected categories under all applicable laws.

    [job_alerts.create_a_job]

    Validation Engineer • Calabasas, California, US

    [internal_linking.similar_jobs]
    Sr. DevOps Engineer

    Sr. DevOps Engineer

    Client • Westlake Village, CA, US
    [job_card.temporary]
    Location : Westlake Village, CA 91361.Duration : 5 months contract (potential to go PERM eventually).We're looking for an experienced, forward-thinking engineer to strengthen our Platform Engineering...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Software Engineer, Core Experiences - Santa Clarita, USA

    Senior Software Engineer, Core Experiences - Santa Clarita, USA

    Speechify • Santa Clarita, CA, US
    [job_card.full_time]
    Speechify is the easiest way to listen to the world's information.Articles on the web, documents in the cloud, books on your phone. We absorb it all and let you listen to it at your desk, on the...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Advanced Reporting and Visualization Analyst

    Advanced Reporting and Visualization Analyst

    Vallarta Supermarkets • Santa Clarita, California, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Advanced Reporting and Visualization Analyst.Non-exempt - Full-time; $33 - $42 hourly.The Advanced Reporting and Visualization Analyst plays a critical role in transforming complex datasets into cl...[show_more]
    [last_updated.last_updated_variable_days]
    Cloverleaf and Rhapsody Integration Subject Matter Expert

    Cloverleaf and Rhapsody Integration Subject Matter Expert

    Medical Technology Solutions LLC • Valencia, CA, US
    [job_card.full_time]
    Integration Subject Matter Expert.Currently seeking a fully remote, full-time Integration Subject Matter Expert with strong experience in both Rhapsody and Cloverleaf integration engines to assist ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Quality Engineer

    Senior Quality Engineer

    Skylimit Systems • Simi Valley, CA, US
    [job_card.full_time]
    Root Cause and Corrective Action (RCCA).Corrective and Preventive Action (CAPA).This role will be responsible for leading problem-solving efforts, conducting investigations, and driving corrective ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Sr. FPGA Engineer (Contract-Perm)

    Sr. FPGA Engineer (Contract-Perm)

    A2e Technologies • Northridge, CA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Term : Contract-Perm (Perm Potential).Duration : Long-Term (24+ Months).Strong Design skills in VHDL & Verilog.Extensive experience w / Bring-up. Verilog and Python based Simulations.Solid backgroun...[show_more]
    [last_updated.last_updated_30]
    ML OPS ARCHITECT

    ML OPS ARCHITECT

    Purple Drive • Woodland Hills, CA, California, USA
    [job_card.full_time]
    Description : " • Architect and implement scalable AWS ML / AI cloud infrastructure in a multi-tenant SaaS environment.Collaborate with data scientists, data engineers, and IT tea...[show_more]
    [last_updated.last_updated_variable_days]
    Preop Recovery RN

    Preop Recovery RN

    Specialty Surgical Center Of Thousand Oaks, LP • Westlake Village, CA, US
    [job_card.full_time]
    The RN will assist in provision f nursing care to patients in an ambulatory surgical setting.Assumes total responsibility for patient care in accordance with physician's orders and center's...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Test Engineer Manager

    Test Engineer Manager

    Fisica, Inc • Simi Valley, CA, US
    [job_card.full_time]
    Simi Valley, CA (This position is 100% onsite).Employees work 9 out of every14 days – totaling 80 hours worked – and have every other Friday off. Headquartered in San Leandro, California...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Travel CT Tech - $2,617 per week in Simi Valley, CA

    Travel CT Tech - $2,617 per week in Simi Valley, CA

    AlliedTravelCareers • Simi Valley, CA, US
    [job_card.full_time]
    A facility in Simi Valley, CA is seeking its next amazing CT Technologist (Computed Tomography).Read on if this sounds like your perfect fit!. Nurses and allied healthcare professionals are in high ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Test Engineer

    Test Engineer

    Fisica, Inc • Simi Valley, CA, US
    [job_card.full_time]
    Location : Simi Valley, CA (100% onsite).Headquartered in San Leandro, California, with additional operations in Simi Valley, Fisica plays a vital role as a trusted partner to leading defense primes...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead, Systems Engineer

    Lead, Systems Engineer

    Fisica, Inc • Simi Valley, CA, US
    [job_card.full_time]
    Employees work 9 out of every 14 days – totaling 80 hours worked – and have every other Friday off.Headquartered in San Leandro, California, with additional operations in Simi Valley, F...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AWS Cloud Enablement Engineer

    AWS Cloud Enablement Engineer

    Purple Drive • Woodland Hills, CA, California, USA
    [job_card.full_time]
    Job Title : AWS Cloud Enablement Engineer Location : < / stro...[show_more]
    [last_updated.last_updated_variable_days]
    Analytics Specialist

    Analytics Specialist

    Joni and Friends • Agoura Hills, CA, US
    [job_card.full_time]
    Under the supervision of the Data Batching Team Lead, support the overall objectives of Joni and Friends.Perform duties and responsibilities including, but not limited to : .Daily Scanning of Checks ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Quality Engineer II

    Quality Engineer II

    804 Technology • Simi Valley, CA, US
    [job_card.full_time]
    The Quality Engineer 2 with a certain degree of creativity and latitude, monitors, tests, and inspects products to ensure they meet specified standards, are free of flaws, and function as designed....[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Nurse - RN - Endoscopy - $2608.56 / Week - Hiring Now

    Travel Nurse - RN - Endoscopy - $2608.56 / Week - Hiring Now

    TRS Healthcare • Northridge, CA, US
    [job_card.full_time]
    TRS Healthcare is seeking an experienced Endoscopy Registered Nurse for an exciting Travel Nursing job in Northridge, CA. Shift : 5x8 hr days Start Date : 02 / 10 / 2026 Duration : 13 weeks Pay : $2608.TRS ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Speech Language Pathologist (SLP) - $2,488 per week in Granada Hills, CA

    Travel Speech Language Pathologist (SLP) - $2,488 per week in Granada Hills, CA

    AlliedTravelCareers • Granada Hills, CA, US
    [job_card.full_time]
    Travel Rehab : Speech Language Pathology Granada Hills, CA.Location : Granada Hills, CA.Shift Details : 8H Days (8 : 30 AM-5 : 00 PM). Length : 21 WEEKS 21 weeks.Apply for specific faci...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Software Engineer, Core Experiences - Simi Valley, USA

    Senior Software Engineer, Core Experiences - Simi Valley, USA

    Speechify • Simi Valley, CA, US
    [job_card.full_time]
    Speechify is the easiest way to listen to the world's information.Articles on the web, documents in the cloud, books on your phone. We absorb it all and let you listen to it at your desk, on the...[show_more]
    [last_updated.last_updated_30] • [promoted]