Talent.com
Ontrac Solutions
Senior/Staff QA Engineer – Agentic AI PlatformOntrac Solutions • Chicago, Illinois, United States
Senior/Staff QA Engineer – Agentic AI Platform

Senior/Staff QA Engineer – Agentic AI Platform

Ontrac Solutions • Chicago, Illinois, United States
12 days ago
Job type
  • Full-time
Job description

Overview

We are seeking a highly skilled and experienced Senior/Staff QA Engineer to support a critical customer engagement. This role is ideal for a detail-oriented tester who thrives owning quality end-to-end — someone equally comfortable writing precise manual test cases and building automated coverage for a fast-moving agentic AI product.

The successful candidate will work closely with the Delivery Lead/Solutions Architect and customer engineering stakeholders to ensure product quality from initial test planning through final release.

Required Credentials

  • 5+ years of professional QA experience, with at least 2+ years at a senior or staff level.
  • Demonstrated experience testing production software through a full Application Development Lifecycle (ADLC).

Required Qualifications

  • ADLC Expertise: Strong understanding of the Application Development Lifecycle — from requirements through release and support.
  • UI/UX Acumen: Solid UI/UX understanding, with the ability to evaluate usability and flag design/interaction issues, not just functional bugs.
  • AI Agent Testing: Hands-on experience testing AI Agent use cases — including conversational flows, agent decision-making, tool/function calling, and edge-case or failure-mode behavior.
  • Automation Frameworks: Proven experience with automated testing frameworks and building maintainable, scalable test suites.
  • Infrastructure Management: Ability to stand up and manage a Playwright cluster to run automated end-to-end (E2E) testing against a live agent platform.
  • Autonomy: Ability to independently define clear, well-structured test cases from ambiguous or evolving product requirements.
  • Lifecycle Ownership: Experience driving full E2E QA lifecycle ownership: test planning, execution, defect triage, regression, and sign-off.

Required Technical Stack Experience (Suggested Completion)

  • Automation Frameworks: Deep expertise with Playwright (including cluster management and parallel execution).
  • Languages: Proficiency in JavaScript / TypeScript or Python for writing automation scripts.
  • AI/LLM Tools: Familiarity with testing LLM outputs, prompt evaluation frameworks, or conversational AI testing tools.
  • CI/CD & DevOps: Experience integrating automated test suites into pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and working with Docker containerization.
  • Defect Tracking & Tools: Proficiency with Git, Jira, and modern test management tools.


__________________________________

Ontrac Solutions has partnered with PinpointVerify to help genuine applicants rise above the noise. Today, qualified candidates are too often overshadowed by fake and fraudulent applications. PinpointVerify gives our recruiters confidence that you are exactly who you say you are — and gives you a portable verification credential you can share with any employer.

Applicants who complete verification are prioritized over non-verified candidates with comparable experience. And if you're hired, Ontrac reimburses the full cost of your verification.
Get verified → https://pinpointverify.com/ontrac

Create a job alert for this search

Senior/Staff QA Engineer – Agentic AI Platform • Chicago, Illinois, United States

Similar jobs

QA Engineer

Sound DecisionsChicago, Illinois, USA
Remote
Full-time
Quick Apply

We are a growing technology company in the FinTech and e-commerce space, building secure, enterprise-grade software solutions that power payment and data services.We empower our employees to make a... Show more

Enterprise AI Architect - Remote

Saransh IncChicago, IL, United States
Remote
Full-time

OverviewWe are looking for a seasoned Enterprise AI Architect to spearhead end-to-end assessments for Enterprise-scale AI and Intelligent Automation initiatives at mid-sized clients.Operating as a ... Show more

 • Promoted

VP Business Development

GVW GroupHighland Park, IL, United States
Full-time

Triz Engineering Solutions is a premium product engineering and development company specializing in end-to-end turn-key commercial vehicle development.We provide end to end engineering services for... Show more

 • Promoted

Sr. Manager, AI Platform Engineering

United AirlinesChicago, IL, United States
Full-time

Machine Learning Engineering And GenAI Systems Role.Achieving our goals starts with supporting yours.Grow your career, access top-tier health and wellness benefits, build lasting connections with y... Show more

 • Promoted

AI Enablement Manager

CroweChicago, IL, United States
Full-time

Your Journey at Crowe Starts Here.At Crowe, you can build a meaningful and rewarding career.With real flexibility to balance work with life moments, you're trusted to deliver results and make an im... Show more

 • Promoted

QA Engineer with Gen AI

Raks GroupChicago, IL, Illinois, US
Full-time

Arial, Helvetica, sans-serif"><span style="font-style:normal"><span style="font-variant-ligatures:normal"><span style="white-space:normal">&l... Show more

Senior Software Engineer (Hybrid / Remote) -- Scale AI-SaaS

Bigtime Software IncChicago, IL, United States
Remote
Full-time

An innovative software firm based in Chicago is seeking a Senior Software Engineer to design and develop features in their cloud-based platform.The role involves collaborating with cross-functional... Show more

 • Promoted

Remote Product Tester

OCPAHighland Park, Illinois, US
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home in the UK to fulfill upcoming contracts with local and international companies.We guarantee 15-25 hours per week with an hourly pay of between £18/hr.Th... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersHighland Park, IL
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Lead/Staff Full Stack Engineer, AI Platform & Agents (US/Canada Hybrid/Remote)

Wolters Kluwer DXG U.S., Inc.Chicago, IL, United States
Remote
Full-time

Build the GenAI platform that powers critical decisions in healthcare, legal, tax, and compliance industries.Your work will directly shape the future of these fields, enabling faster, safer, and mo... Show more

 • Promoted

Consumer Insights Analyst

Earn HausFort Sheridan, Illinois, United States
Part-time

We're currently seeking motivated individuals to participate in online surveys and paid gaming opportunities for well-known national brands.If you're looking for a flexible way to earn extra cash f... Show more

 • Promoted

Product Strategy Lead (AI & Agentic Products)

Blue Cross Blue Shield AssociationChicago, IL, United States
Full-time

We are seeking a Product Strategy Lead to define and drive the vision, roadmap, and delivery of the organization's advanced healthcare data and analytics solutions.This role will serve as a thought... Show more

 • Promoted

Consumer Research Associate (Remote)

GL IncZion, Illinois
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Conversational AI and Agentic AI - Manager

PwC (US)Chicago, IL, United States
Full-time

Conversational AI and Agentic AI - Manager.As a Conversational AI and Agentic AI - Manager, you will lead the charge in developing innovative user interaction solutions within our Advisory practice... Show more

 • Promoted

Senior Product Manager, Agentic AI

JerryChicago, IL, United States
Full-time +1

Join a pre-IPO startup with capital ($240M raised), traction (5M+ customers), and runway (we're profitable).Impact: Come lead our customer-facing Agentic AI product leveraging LLMs, agents, and int... Show more

 • Promoted

Senior Analytics AI Engineering Lead - Remote

Dentsu Aegis Network Ltd.Chicago, IL, United States
Remote
Full-time

A leading data-driven marketing firm is looking for an AI Engineering Lead to architect and implement enterprise-scale AI systems.The role emphasizes leadership in AI design and requires strong tec... Show more

 • Promoted

Work-From-Home Product Quality Assurance - $45 per hour

Great LionZion, Illinois
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Engineering and maintenance manager

Michael PageZion, IL, United States
Full-time

Senior Engineering And Maintenance Leader.Our client is a leading manufacturer and supplier of industrial products and infrastructure solutions serving a variety of commercial, industrial, and util... Show more

 • Promoted

Senior Full-Stack Engineer (Product & Architecture Orientation) - Remote / Hybrid

NeolytixChicago, IL, United States
Remote
Full-time

Senior Full-Stack Engineer (Product & Architecture Orientation) Location :Hybrid / Remote (U.Travel : Chicago Office or India-based delivery centers Type : Part or Full-time Role Summary Neolyt... Show more

 • Promoted

VP Business Development

Triz Engineering SolutionsHighland Park, IL, United States
Full-time

Triz Engineering Solutions is a premium product engineering and development company specializing in end-to-end turn-key commercial vehicle development.We provide end to end engineering services for... Show more