Intellias

QA Engineer – Agentic Memory Testing

Brak informacji o wynagrodzeniu

MidZdalnie·PolandFull-time·B2B

#442141·Dodano miesiąc temu·14

Źródło: justjoin.it

Aplikuj teraz

Tech Stack / Keywords

PythonQAAI

Podsumowanie oferty

The role involves validating agent memory capabilities within an enterprise AI Agent Platform. The QA Engineer will focus on functional and regression testing of stateful and personalized agent behaviors, memory extraction, retrieval, and lifecycle. The position supports development of Python-based automated tests for agent memory workflows and APIs.

Wymagania

Agent memory functional testing: short-term memory (in-session continuity), long-term memory (cross-session recall).
Memory extraction validation: verify Summary and Semantic strategies extract correct facts/preferences.
Memory retrieval testing: validate agents retrieve relevant context and filter irrelevant memories.
Memory lifecycle testing: TTL expiration, user deletion, namespace isolation.
Agent regression testing: verify memory does not degrade agent response quality.
Python test automation for memory workflows.
4+ years QA engineering for AI/ML or conversational AI systems.
Testing stateful agent behaviors including context retention and personalization.
Functional test automation for API-driven services.
Regression testing methodologies.

Nice to have:

Agent memory framework testing (LangChain, LangGraph).
Conversational AI evaluation.
AWS AgentCore Memory testing.
GDPR compliance testing (user deletion validation).

Obowiązki

Design and execute functional tests for short-term and long-term agent memory.
Validate in-session context continuity and cross-session memory recall.
Test memory extraction strategies to ensure summaries, facts, and preferences are captured correctly.
Validate memory retrieval to ensure agents retrieve relevant context while filtering irrelevant information.
Test memory lifecycle behaviors, including TTL expiration, deletion, and namespace isolation.
Develop Python-based automated tests for agent memory workflows and API-driven services.
Perform regression testing to ensure memory changes do not negatively affect agent response quality.
Validate stateful agent behaviors including context retention and personalization.
Test memory isolation to prevent inappropriate context sharing between users, sessions, or agents.
Validate user deletion and privacy-related memory workflows.
Integrate memory testing into broader agent quality and regression suites.
Collaborate with AI and platform engineers to identify memory-related defects and improve agent reliability.

Benefity

Flexible work schedule.
Fixed financial bonus issued quarterly, covering average market price of private medical care and sport card under B2B contract.
Gifts for birthday, wedding, and child birth.
E-learning accounts for Coursera, O'Reilly, Udemy.
Corporate language school.

Elastyczne godziny

Inne informacje

Przesyłając ten formularz, wyrażasz zgodę na przetwarzanie Twoich danych osobowych zgodnie z naszą Polityką Prywatności Rekrutacji - https://career.intellias.com/recruitment-privacy-notice. Jeśli chcesz wycofać swoją zgodę lub masz jakiekolwiek pytania dotyczące naszej Polityki Prywatności Rekrutacji, skontaktuj się z nami([email protected])

Intellias

9 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz