Senior Software Engineer - AI Coding Benchmarks

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

• 5+ years in software development.
• Core stack experience with Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis.
• Experience writing functional and integration tests.
• Proficiency in English at B2+ level.

• Build realistic developer environments including codebase, infrastructure, and context such as tickets, docs, and conversations.
• Design tasks from intermediate states of these environments, crafting prompts, defining success criteria, and ensuring solvability by AI agents.
• Write tests that verify AI agent solutions, accepting all valid approaches and rejecting incorrect ones.
• Iterate on tasks and tests based on QA feedback by reviewing agent solutions, analyzing failures, and refining evaluations to ensure fairness and robustness.

Please submit your CV in English and indicate your level of English proficiency.