Senior/Lead Automation Tester in Python

EPAM is a global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, EPAM empowers clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.

• 3+ years of experience in QA engineering for AI/ML or conversational AI systems
• Experience testing stateful agent behaviors, including context retention and personalization
• Background in functional test automation for API-driven services
• Knowledge of regression testing methodologies
• Proficiency in English at a B2+ level

Nice to have:

• Experience testing agent memory frameworks (LangChain, LangGraph)
• Background in conversational AI evaluation
• Familiarity with AWS AgentCore Memory testing
• Knowledge of GDPR compliance testing (user deletion validation)

• Own functional and regression test suites for agentic memory behavior
• Design and execute agent memory functional tests covering short-term memory (in-session continuity) and long-term memory (cross-session recall)
• Validate memory extraction to verify Summary and Semantic strategies extract correct facts and preferences
• Conduct memory retrieval testing to validate agents retrieve relevant context and filter irrelevant memories
• Perform memory lifecycle testing, including TTL expiration, user deletion, and namespace isolation
• Run agent regression testing to verify memory does not degrade agent response quality
• Build Python test automation for memory workflows

By clicking "Apply" or submitting an application, candidates consent to the processing of their personal data by EPAM Systems (Poland) sp. z o.o. located at Fabryczna 1A, 31-553 Kraków for recruitment purposes according to the Privacy Policy.