QA Engineer – Agentic Memory Testing
Brak informacji o wynagrodzeniu
MidFull-time·B2B
#442141·Dodano 9 dni temu·10
Źródło: justjoin.itTech Stack / Keywords
PythonQAAI
Firma i stanowisko
Our client is a large global enterprise operating across multiple markets, focused on digital transformation and innovation. They invest in modern cloud, data, and AI capabilities to enable scalable, secure, and highly automated solutions.
Wymagania
- Agent memory functional testing: short-term memory (in-session continuity), long-term memory (cross-session recall).
- Memory extraction validation: verify Summary and Semantic strategies extract correct facts/preferences.
- Memory retrieval testing: validate agents retrieve relevant context and filter irrelevant memories.
- Memory lifecycle testing: TTL expiration, user deletion, namespace isolation.
- Agent regression testing: verify memory does not degrade agent response quality.
- Python test automation for memory workflows.
- 4+ years QA engineering for AI/ML or conversational AI systems.
- Testing stateful agent behaviors including context retention and personalization.
- Functional test automation for API-driven services.
- Regression testing methodologies.
Nice to have:
- Agent memory framework testing (LangChain, LangGraph).
- Conversational AI evaluation.
- AWS AgentCore Memory testing.
- GDPR compliance testing (user deletion validation).
Obowiązki
- Design and execute functional tests for short-term and long-term agent memory.
- Validate in-session context continuity and cross-session memory recall.
- Test memory extraction strategies to ensure summaries, facts, and preferences are captured correctly.
- Validate memory retrieval to ensure agents retrieve relevant context while filtering irrelevant information.
- Test memory lifecycle behaviors, including TTL expiration, deletion, and namespace isolation.
- Develop Python-based automated tests for agent memory workflows and API-driven services.
- Perform regression testing to ensure memory changes do not negatively affect agent response quality.
- Validate stateful agent behaviors including context retention and personalization.
- Test memory isolation to prevent inappropriate context sharing between users, sessions, or agents.
- Validate user deletion and privacy-related memory workflows.
- Integrate memory testing into broader agent quality and regression suites.
- Collaborate with AI and platform engineers to identify memory-related defects and improve agent reliability.
Benefity
- Flexible work schedule.
- Fixed financial bonus issued quarterly, covering average market price of private medical care and sport card under B2B contract.
- Gifts for birthday, wedding, and child birth.
- E-learning accounts for Coursera, O'Reilly, Udemy.
- Corporate language school.
Elastyczne godziny
Inne informacje
Przesyłając ten formularz, wyrażasz zgodę na przetwarzanie Twoich danych osobowych zgodnie z naszą Polityką Prywatności Rekrutacji - https://career.intellias.com/recruitment-privacy-notice. Jeśli chcesz wycofać swoją zgodę lub masz jakiekolwiek pytania dotyczące naszej Polityki Prywatności Rekrutacji, skontaktuj się z nami([email protected])
Intellias
7 aktywnych ofert