Senior/Lead Automation Tester in Python

EPAM is a global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, they empower clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.

• 3+ years of experience in QA engineering for AI/ML or conversational AI systems
• Experience testing stateful agent behaviors, including context retention and personalization
• Background in functional test automation for API-driven services
• Knowledge of regression testing methodologies
• Proficiency in English at a B2+ level

Nice to have:

• Experience testing agent memory frameworks (LangChain, LangGraph)
• Background in conversational AI evaluation
• Familiarity with AWS AgentCore Memory testing
• Knowledge of GDPR compliance testing (user deletion validation)

• Own functional and regression test suites for agentic memory behavior
• Design and execute agent memory functional tests covering short-term memory (in-session continuity) and long-term memory (cross-session recall)
• Validate memory extraction to verify Summary and Semantic strategies extract correct facts and preferences
• Conduct memory retrieval testing to validate agents retrieve relevant context and filter irrelevant memories
• Perform memory lifecycle testing, including TTL expiration, user deletion, and namespace isolation
• Run agent regression testing to verify memory does not degrade agent response quality
• Build Python test automation for memory workflows

Klikając w przycisk „Aplikuj” lub w inny sposób wysyłając zgłoszenie rekrutacyjne, zgadzasz się na przetwarzanie Twoich danych osobowych przez EPAM Systems (Poland) sp. z o.o. z siedzibą w: Fabryczna 1A, 31-553 Kraków (Pracodawca), jako administratora danych osobowych w celu przeprowadzenia rekrutacji na stanowisko wskazane w ogłoszeniu zgodnie Polityką Prywatności.