Senior Software Engineer in Test - Python, AI Agents

Brak informacji o wynagrodzeniu

SeniorFull-time

#412016·Dodano dziś·0

Źródło: YourITeams

Tech Stack / Keywords

PythonAIAutomated TestingTest AutomationCI/CDTestingScriptingAPI

Proven experience in Python development for test automation, scripting and tooling (senior level).
Strong expertise in test automation frameworks and practices, including scenario automation and validation of probabilistic outputs.
Experience with CI/CD systems and integrating automated tests into pipelines.
Practical knowledge of API and integration testing approaches.
Comfortable with Git-based workflows and version control.
Familiarity with Linux/CLI environments and command-line tools.
Experience with containerization technologies such as Docker.
Applied experience with AI, large language models or agentic systems and their evaluation approaches.
Working knowledge of Model Context Protocol (MCP) or equivalent agent interaction protocols is desirable.
Familiarity with Jupyter or other notebook environments for prototyping and metadata analysis.
Ability to design realistic customer scenarios and to reason about non-deterministic system outputs.
Strong communication skills and the ability to collaborate across technical teams.

Develop and maintain Python scripts, test frameworks, and notebooks to validate AI agents and related services.
Design and implement automated test scenarios and validation logic for agentic systems with non-deterministic outputs.
Integrate and execute automated tests in CI/CD pipelines to ensure continuous quality checks.
Perform command-line and Model Context Protocol (MCP) testing of agents and related components.
Prepare, configure and manage test environments, including containerization and orchestration where applicable.
Create realistic customer and user scenarios to exercise end-to-end agent behavior and system integrations.
Build Python notebooks and utilities for metadata extraction, analysis and reporting of test results.
Collaborate with engineering, product and operations teams to define test strategies and acceptance criteria.
Contribute to test tooling, observability and documentation to support reproducible and traceable testing practices.

Opportunities to work on advanced AI agent testing and to influence testing strategy and tooling.
Access to modern development and testing infrastructure, including containerized environments and CI/CD platforms.
Remote work with flexible working arrangements.
Luxmed Gold Extended medical care.
Multisport Plus benefit.

Elastyczne godziny

Opieka zdrowotna

Karta sportowa

YourITeams

67 aktywnych ofert