qa engineer (auto) for AI agents

EPAM develops enterprise software products, open source solutions, and accelerators. Its Enterprise Agent Development Platform enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale while standardizing agent development, security, quality, and governance.

• Own functional and regression test suites for agentic memory behavior;
• Design and execute agent memory functional tests covering short-term memory and long-term memory;
• Validate memory extraction to verify Summary and Semantic strategies extract correct facts and preferences;
• Conduct memory retrieval testing to validate agents retrieve relevant context and filter irrelevant memories;
• Perform memory lifecycle testing, including TTL expiration, user deletion, and namespace isolation;
• Run agent regression testing to verify memory does not degrade agent response quality;
• Build Python test automation for memory workflows.

• 3+ Years of experience in QA engineering for AI/ML or conversational AI systems;
• Experience testing stateful agent behaviors, including context retention and personalization;
• Background in functional test automation for API-driven services;
• Knowledge of regression testing methodologies;
• Proficiency in English at a B2+ level;
• Nice to have: Experience testing agent memory frameworks (LangChain, LangGraph), background in conversational AI evaluation, familiarity with AWS AgentCore Memory testing, knowledge of GDPR compliance testing (user deletion validation).

• No conditions specified