Primary Skill: Test AI applications, RAG systems, agents, APIs and Data Pipeline using automated development framework
Experience: Minimum 8 years
Roles & Responsibilities
Bachelor's or master's degree in computer science or related field.
Key Responsibilities
Lead Strategy: Design end-to-end test plans for generative AI, LLMs, and machine learning models.
Model Validation: Test models for accuracy, drift, latency, robustness, and security vulnerabilities.
Automation: Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.
Data Quality: Validate training, validation, and test datasets for bias, leakage, and data integrity.
Performance Testing: Evaluate system scalability and response times under heavy concurrent loads.
Team Leadership: Mentor junior engineers and collaborate with data scientists and software developers.
Certifications in Automation