Talent.com
Senior Agentic DevOps Engineer – Runtime Validation & Governance
Senior Agentic DevOps Engineer – Runtime Validation & GovernanceKeysight Technologies • Calabasas, California, US
Senior Agentic DevOps Engineer – Runtime Validation & Governance

Senior Agentic DevOps Engineer – Runtime Validation & Governance

Keysight Technologies • Calabasas, California, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Overview

Keysight is at the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization. Our ~15, employees create world-class solutions in communications, 5G, automotive, energy, quantum, aerospace, defense, and semiconductor markets for customers in over countries. Learn more about what we do.

Our award-winningculture embraces a bold vision of where technology can take us and a passion for tackling challenging problems with industry-first solutions. We believe that when people feel a sense of belonging, they can be more creative, innovative, and thrive at all points in their careers.

About the Initiative

Keysight’s Applied AI Autonomy Initiative is developing a next-generation agentic orchestration framework that enables AI agents to reason, adapt, and coordinate across complex engineering workflows. Built on LangGraph and reinforcement-inspired feedback mechanisms , this framework transforms prompts and design intents into executable orchestration strategies that evolve autonomously through iterative simulation and validation loops.

Our ambition is not merely to replicate human reasoning, but to push past human limits - enabling agentic systems to explore design spaces, optimize engineering workflows, and evolve orchestration strategies at a scale and speed no human could achieve.

To make this possible, it will require robust runtime governance and regression intelligence layer — one that ensures every autonomous action is verified, reversible, traceable, and safe before it influences live engineering systems.

This role defines that layer : the bridge between autonomy and operational trust , enabling production-scale AI-driven orchestration with assurance and auditability.

What This Role Offers — Optimized for Agentic DevOps

  • A foundational and highly visible role shaping how AI-generated orchestration earns operational trust across Keysight’s engineering ecosystem.
  • The mandate to define the validation, governance, and assurance standards that determine when and how autonomous agent logic may safely enter production.
  • Ownership of the mission-critical regression and verification pipeline , where agent actions, simulation feedback, and safety controls converge — enabling autonomy that is explainable, reversible, measurable, and audit-ready .

Responsibilities

Role Overview

As the Senior Agentic DevOps Engineer , you will architect and implement the runtime validation, control, and feedback systems that govern how agent-generated logic is tested, verified, and promoted into production.

This is not classical DevOps or CI / CD — it is Agentic DevOps : embedding intelligent agents into the deployment fabric with guardrails, feedback loops, rollback capabilities, and telemetry built into every stage.

Your mission is to enable a self-aware orchestration pipeline where agents can act, learn, adapt, and be safely governed , delivering predictable, and stable outcomes across dynamic, high-assurance environments.

Core Engineering Domains

  • Execution Integrity Architecture
  • Design sandboxed and containerized evaluation zones for testing agent-generated logic prior to deployment.
  • Build a multi-stage release pipeline spanning sandbox → validation → gated staging → monitored execution.
  • Define and enforce isolation and containment protocols to prevent propagation of unsafe or misconfigured agent actions.
  • Establish runtime health scoring , confidence thresholds , and promotion gates to control when an agent’s output can advance to production.
  • Regression Intelligence & Continuous Verification
  • Develop regression and validation frameworks tailored for agentic orchestrations to detect drift, instability, or emergent behaviors.
  • Implement baseline comparison and differential validation systems to continuously verify agent outputs against expected outcomes.
  • Construct autonomous CI / CD pipelines integrating both neural (agent-generated) and traditional (human-written) logic with versioning and reproducibility guarantees.
  • Provide predictable replay and audit mechanisms to re-execute orchestration cycles for debugging, validation, and compliance.
  • Observability, Governance & Rollback
  • Engineer always-on telemetry and introspection pipelines capturing every agent decision, validation result, and anomaly.
  • Develop snapshot and rollback frameworks enabling rapid restoration to verified system states.
  • Ensure end-to-end traceability of all orchestration artifacts, mapping which agent produced what output, with what data and under what conditions.
  • Surface trust metrics, validation outcomes, and confidence scores through operator dashboards and governance APIs in collaboration with Dev / UI teams.
  • Key Responsibilities

  • Lead the definition and implementation of validation, governance, and regression standards across Keysight’s agentic orchestration runtime.
  • Architect and deploy a continuous validation pipeline integrating feedback loops, guardrails, telemetry, and rollback systems.
  • Build self-diagnosing runtime logic that enables agents and infrastructure to detect, contain, and recover from instability autonomously.
  • Define and maintain safety certification, auditability, and reproducibility frameworks for agent-generated actions in production.
  • Collaborate with framework architects, safety engineers, ML researchers, and data intelligence teams to align validation infrastructure with orchestration and learning feedback systems.
  • Qualifications

    Required Qualifications

  • PhD or 5+ years of experience in systems engineering , runtime validation , safety-critical infrastructure , or high-assurance deployment frameworks .
  • Proficiency with CI / CD systems (e.g., Jenkins, GitLab CI, GitHub Actions, or ArgoCD) for automation, validation, and controlled deployments.
  • Proven experience designing sandboxed execution environments, controlled-release and CI / CD pipelines , or validated deployment systems at production scale.
  • Strong proficiency in Python and C / C++ , with expertise in sandbox architecture, promotion control, and rollback mechanisms.
  • Demonstrated ability in regression governance, continuous verification , and telemetry-driven runtime monitoring .
  • Proficiency with agentic AI frameworks (e.g., LangGraph, LangChain) and validation mechanisms for multi-agent orchestration and reasoning stability.
  • Preferred Qualifications

  • Experience with simulation orchestration , HPC systems , or digital-twin environments feeding live feedback into control loops.
  • Knowledge of differential validation , golden-run comparison , confidence-scored promotion models , and structured evaluation frameworks.
  • Background in governance frameworks for machine-generated logic or autonomous systems (e.g., AI or robotics).
  • The level of role will be based on applicable experience, education and skills; Most offers will be between the minimum and the midpoint of the Salary Range listed below.

    CA pay range : MIN $,- MAX $,

    Note : For other locations, pay ranges will vary by region

    This role is eligible for our Keysight Results Bonus Program

    US Employees may be eligible for the following benefits :

  • Medical, dental and vision
  • Health Savings Account
  • Health Care and Dependent Care Flexible Spending Accounts
  • Life, Accident, Disability insurance
  • Business Travel Accident and Business Travel Health
  • (k) Plan
  • Flexible Time Off, Paid Holidays
  • Paid Family Leave
  • Discounts, Perks
  • Tuition Reimbursement
  • Adoption Assistance
  • ESPP (Employee Stock Purchase Plan)
  • Restricted Stock Units
  • Careers Privacy Statement

    Keysight is an Equal Opportunity Employer

    Keysight Technologies Inc. is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other protected categories under all applicable laws.

    [job_alerts.create_a_job]

    Validation Engineer • Calabasas, California, US

    [internal_linking.similar_jobs]
    Sr. DevOps Engineer

    Sr. DevOps Engineer

    Client • Westlake Village, CA, US
    [job_card.temporary]
    Location : Westlake Village, CA 91361.Duration : 5 months contract (potential to go PERM eventually).We're looking for an experienced, forward-thinking engineer to strengthen our Platform Engineering...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Observability Engineer

    Observability Engineer

    Jconnect Inc • Westlake Village, CA, United States
    [job_card.full_time]
    Role Summary : The Observability Engineer will lead the design and implementation of a full-stack business observability solution using New Relic. This includes strategy, architecture design, governa...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Advanced Reporting and Visualization Analyst

    Advanced Reporting and Visualization Analyst

    Vallarta Supermarkets • Santa Clarita, California, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Advanced Reporting and Visualization Analyst.Non-exempt - Full-time; $33 - $42 hourly.The Advanced Reporting and Visualization Analyst plays a critical role in transforming complex datasets into cl...[show_more]
    [last_updated.last_updated_variable_days]
    Sr. FPGA Engineer (Contract-Perm)

    Sr. FPGA Engineer (Contract-Perm)

    A2e Technologies • Northridge, CA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Term : Contract-Perm (Perm Potential).Duration : Long-Term (24+ Months).Strong Design skills in VHDL & Verilog.Extensive experience w / Bring-up. Verilog and Python based Simulations.Solid backgroun...[show_more]
    [last_updated.last_updated_30]
    EPIC Cadence Analyst (REMOTE / NO C2C)

    EPIC Cadence Analyst (REMOTE / NO C2C)

    Amerit Consulting • Santa Clarita, CA, US
    [filters.remote]
    [job_card.permanent]
    Our client, a Medical Center facility under the aegis of a California Public Ivy university and one of largest health delivery systems in California, seeks an accomplished.EPIC Cadence Applications...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    USA_Engineer

    USA_Engineer

    Varite • Woodland Hills, CA, United States
    [job_card.full_time]
    Experience in Cybersecurity and Cloud-native Security Services (at least 3 years in AWS).Hands-on experience in building and deploying Infrastructure-as-Code (IaC) modules.Provisioning, Managing an...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Engineer - Agentic Runtime Safety, Stability & Observability

    Senior Engineer - Agentic Runtime Safety, Stability & Observability

    Keysight Technologies • Calabasas, CA, United States
    [job_card.full_time]
    Keysight is at the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization.Our ~15,000...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Radar Systems Engineer

    Senior Radar Systems Engineer

    HRL Laboratories LLC • Calabasas, CA, United States
    [job_card.full_time]
    Contribute technical expertise and work within a focused team that designs, integrates and tests radar systems operating from HF to 200+ GHz. Work closely with scientists and engineers to develop sp...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Reliability Engineer

    Senior Reliability Engineer

    Medtronic • Northridge, CA, United States
    [job_card.full_time]
    We anticipate the application window for this opening will close on - 7 Jan 2026.At Medtronic you can begin a life-long career of exploration and innovation, while helping champion healthcare acces...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Systems Engineer, Platform (Teradyne, Agoura Hills)

    Systems Engineer, Platform (Teradyne, Agoura Hills)

    Teradyne • Agoura Hills, CA, United States
    [job_card.full_time]
    We are the global test and automation specialists, powering next-generation technologies through sophisticated solutions. Behind every electronic device you use, Teradyne's test technology ensures y...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Sr Observability Engineer

    Sr Observability Engineer

    E-Solutions • Westlake Village, CA, United States
    [job_card.full_time]
    Computer Science, Engineering, or a related field (or equivalent experience).Observability, DevOps, SRE, etc).New Relic platform, including deep knowledge of Dashboards, NRQL, APM and setting up ef...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    AWS Cloud Enablement Engineer

    AWS Cloud Enablement Engineer

    Purple Drive • Woodland Hills, CA, California, USA
    [job_card.full_time]
    Job Title : AWS Cloud Enablement Engineer Location : < / stro...[show_more]
    [last_updated.last_updated_variable_days]
    Onboarding Specialist

    Onboarding Specialist

    Allied Universal • Woodland Hills, CA, United States
    [job_card.full_time]
    Allied Universal, North America's leading security and facility services company, offers rewarding careers that provide you a sense of purpose. While working in a dynamic, welcoming, and collaborati...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Identity & Access Engineer

    Identity & Access Engineer

    United IT Solutions • Santa Clarita, CA, United States
    [job_card.full_time]
    Role - Identity & Access Engineer.Okta, Kerberos-based authentication in Jamf, SAML, OAuth, SCIM, and OIDC protocols.We're seeking an experienced Identity & Access Engineer to lead the strategic tr...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Observability Engineer

    Observability Engineer

    Saxon Global • Agoura Hills, CA, United States
    [job_card.full_time]
    Technical Degree (Computer Science, Engineering, or related field).IT / Engineering xp (Observability, DevOps, SRE, etc). IAC Automation (Terraform / OpenTofu).Dashboard and Alerts development using New...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Engineer, Systems Design Assurance (Valencia (CA), United States)

    Senior Engineer, Systems Design Assurance (Valencia (CA), United States)

    Sonova AG • Santa Clarita, CA, United States
    [job_card.full_time]
    Senior Engineer, Systems Design Assurance.To work as part of a multidisciplinary product development team in a growing company within the expanding cochlear implant industry to ensure the design in...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Electronics Engineer (Test)

    Senior Electronics Engineer (Test)

    Woodward, Inc. • Santa Clarita, CA, United States
    [job_card.permanent]
    Woodward is committed to creating a great workplace for all team members.Our company and its members are committed to acting with integrity, being respectful and accountable to one another, and sta...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Payload Systems Engineer

    Senior Payload Systems Engineer

    Blue Origin • Woodland Hills, CA, United States
    [job_card.permanent]
    Salary range updated, see changes below.Applications will be accepted on an ongoing basis until the requisition is closed. At Blue Origin, we envision millions of people living and working in space ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]