We are seeking to fill Quality Assurance Automation Engineer roles (3) local to Hartford, CT.
Position Summary
The Aetna IT Delivery organization, part of CVS Health's Data, Digital, Analytics, Technology (DDAT) division, is seeking a highly skilled Quality Assurance Automation Engineer to design, develop, and maintain automated testing solutions for virtual assistants (agents) to support members and providers by accessing timely, accurate health insurance answers across digital channels.
The ideal candidate will have strong experience in Behavior Driven Development and Test Driven Development methodologies, automation scripting, and healthcare domain knowledge.
Key Responsibilities
- Test Automation Development :
Design, develop, and maintain automated test scripts using industry-standard tools and frameworks (e.g., Selenium, Cypress, Playwright, Appium).
Build and enhance automation frameworks to support functional, regression, and performance testing.Quality Assurance :Collaborate with developers and QA analysts to understand application functionality and define test coverage.
Execute automated test suites and analyze results to identify defects and ensure compliance with quality standards.Continuous Integration & Delivery (CI / CD) :Integrate automated tests into CI / CD pipelines using tools like Jenkins, GitLab CI, or Azure DevOps.
Monitor and maintain test execution in CI environments to ensure timely feedback.Defect Management :Log, track, and verify defects using tools such as JIRA or Azure DevOps.
Work with development teams to reproduce issues and validate fixes.Documentation & Reporting :Prepare detailed test plans, test cases, and automation scripts documentation.
Generate and present test execution reports to stakeholders.Process Improvement :Identify opportunities to improve automation coverage and efficiency.
Stay updated with emerging trends, tools, and best practices in test automation.Required Qualifications
3+ years of experience in QA automation and software testing.Proficiency in programming languages such as Java, Python, or JavaScript.Hands-on experience with automation tools including Hammer On Demand and SeleniumStrong understanding of SDLC, Agile methodologies, and QA principles.Experience with CI / CD tools and version control systems (e.g., Git).Frameworks & Methodologies :BDD (e.g., Cucumber, SpecFlow)
TDDTesting Expertise : Functional, Regression, Integration, and Performance TestingHealthcare Domain Knowledge : Familiarity with HIPAA compliance and healthcare workflowsStrong analytical and problem-solving skillsExcellent communication and collaboration abilitiesConversational AI Testing : Hands-on experience or strong exposure to testing chatbots and voice-based virtual assistants across multiple platforms.AI Model Evaluation : Familiarity with key evaluation metrics such as accuracy, precision, recall, and F1-score for assessing AI model performance.Experience with Agentic IDEs : Familiarity with AI-powered development environments (e.g., Windsurf, Cursor, or similar) for creating, maintaining, and optimizing automated test scripts.Experience with API testing (REST, SOAP)Knowledge of cloud platforms (AWS, GCP, or IBM Cloud)Education
Bachelor's degree in Computer Science, Engineering, or related field.