Senior Python Engineer - AI Coding Agent Evaluation (Freelance)

• 8+ years in software development
• Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
• Experience writing functional and integration tests
• English proficiency B2+

• Build realistic developer environments including codebase, infrastructure, and context such as tickets, docs, and conversations
• Design tasks from intermediate states of these environments, crafting prompts and defining completion criteria
• Write functional and integration tests that validate AI agent solutions
• Iterate on tasks and tests based on QA feedback, reviewing agent solutions and refining tasks to ensure fair and robust evaluation

Please submit your CV in English and indicate your level of English proficiency. Participation requires passing qualification(s) before joining the project.