Senior Automation Tester in Python (Agentic Gateway testing)

Brak informacji o wynagrodzeniu

SeniorZdalnieFull-time

#464099·Dodano 2 dni temu·0

Źródło: EPAM Systems

Aplikuj teraz

Tech Stack / Keywords

Python pytestMCPLangGraphStrands AgentsAWS AgentCore RuntimeCI/CD LangChainAWS Bedrock AgentsOpenTelemetry

Podsumowanie oferty

You will own functional, security, and performance test suites for an agentic gateway in an Enterprise Agent Development Platform. The platform uses LangGraph and Strands Agents on AWS AgentCore Runtime.

Wymagania

3+ years of QA engineering experience for AI/ML or agent systems.
Hands-on experience testing AI agent systems in a production agentic AI project, such as MCP protocol testing, agent authorization/policy-enforcement testing, or multi-step agent workflow test automation.
Experience testing LLM agent workflows, including tool calling and multi-step reasoning.
Expertise in security testing for authorization and authentication.
Skills in performance benchmarking for cloud services.

Nice to have:

Familiarity with MCP protocol testing.
Background in agent framework testing (LangChain, LangGraph, Crew).
Knowledge of AWS Bedrock Agents testing.
Understanding of chaos engineering for agentic systems.
Familiarity with audit log validation (CloudTrail, OpenTelemetry traces).

Obowiązki

Design and execute test suites for agentic workflows, including tool discovery, tool invocation, and multi-step agent workflows.
Validate MCP protocol behavior, including tool list aggregation, tool call routing, and streaming response handling.
Verify agent authorization mechanisms, including unauthorized tool access attempts and policy enforcement validation.
Conduct agent performance testing covering tool discovery latency, concurrent agent sessions, and agent-to-agent latency.
Build Python-based test automation using pytest with async support, mock MCP servers, and agent workflow simulation.
Validate agentic observability, including trace completeness, agent step logging, and audit trail verification.
Collaborate with engineering teams to define quality standards for agent framework design and runtime architecture.
Support CI/CD automation efforts by integrating test suites into deployment pipelines.

Benefity

Career development programs.
Thought leadership, mentoring, soft skills, and well-being programs.
Certifications in Anthropic, Gemini, GCP, Azure, and AWS.
English classes.
Employee Stock Purchase Plan with a 15% discount.
Health insurance and multisport.
Referral bonuses up to $2,000.
Corporate, social, and well-being events.
Free snacks and coffee.

Spotkania integracyjne

Kursy językowe

Ubezpieczenie

Karta sportowa

Udziały pracownicze

Premie

Darmowe przekąski

Napoje w biurze

Inne informacje

Remote work is available within Poland; the offer also mentions the opportunity to work abroad for up to 60 days annually.
Listed benefits are available to employees only. The company is open to B2B contractors; terms are agreed individually.

EPAM Systems

1596 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz