Senior Software Engineer - AI Coding Benchmarks

• Minimum 5 years of experience in software development.
• Proficient with core technologies including Python (FastAPI), JavaScript, TypeScript (React), Docker, Postgres, Kafka, and Redis.
• Experience writing functional and integration tests.
• English language proficiency at B2 level or higher.

• Build realistic developer environments simulating a virtual company with codebase, infrastructure, and context such as tickets, docs, and conversations.
• Design tasks based on intermediate states of these environments, crafting prompts and defining success criteria.
• Write tests to verify AI agent solutions, accepting all valid approaches and rejecting incorrect ones.
• Iterate on tasks and tests based on QA feedback by reviewing AI agent solutions, analyzing failures, and refining evaluations.

Please submit your CV in English and indicate your level of English proficiency.