Senior/Lead Automation Tester in Python

EPAM is a global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, EPAM empowers clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.

• 3+ years of experience in QA engineering for AI/ML or conversational AI systems
• Experience testing stateful agent behaviors including context retention and personalization
• Background in functional test automation for API-driven services
• Knowledge of regression testing methodologies
• Proficiency in English at B2+ level

Nice to have:

• Experience testing agent memory frameworks (LangChain, LangGraph)
• Background in conversational AI evaluation
• Familiarity with AWS AgentCore Memory testing
• Knowledge of GDPR compliance testing (user deletion validation)

• Own functional and regression test suites for agentic memory behavior
• Design and execute agent memory functional tests covering short-term and long-term memory
• Validate memory extraction to verify Summary and Semantic strategies
• Conduct memory retrieval testing to ensure relevant context retrieval
• Perform memory lifecycle testing including TTL expiration, user deletion, and namespace isolation
• Run agent regression testing to verify memory does not degrade response quality
• Build Python test automation for memory workflows

By applying, candidates agree to the processing of personal data by EPAM Systems (Poland) sp. z o.o. for recruitment purposes as per the Privacy Policy. Benefits listed are available to employees only. EPAM is open to working with Contractors under individually agreed B2B terms. Only selected candidates will be contacted.