Senior/Lead Automation Tester in Python

• 3+ years of experience in QA engineering for AI/ML or conversational AI systems
• Experience testing stateful agent behaviors, including context retention and personalization
• Background in functional test automation for API-driven services
• Knowledge of regression testing methodologies
• Proficiency in English at a B2+ level

Nice to have:

• Experience testing agent memory frameworks (LangChain, LangGraph)
• Background in conversational AI evaluation
• Familiarity with AWS AgentCore Memory testing
• Knowledge of GDPR compliance testing (user deletion validation)

• Own functional and regression test suites for agentic memory behavior
• Design and execute agent memory functional tests covering short-term memory (in-session continuity) and long-term memory (cross-session recall)
• Validate memory extraction to verify Summary and Semantic strategies extract correct facts and preferences
• Conduct memory retrieval testing to validate agents retrieve relevant context and filter irrelevant memories
• Perform memory lifecycle testing, including TTL expiration, user deletion, and namespace isolation
• Run agent regression testing to verify memory does not degrade agent response quality
• Build Python test automation for memory workflows