Senior Software Engineer - AI Coding Benchmarks

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

• 5+ years of experience in software development
• Experience with core stack technologies: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
• Experience writing tests (functional, integration)
• English proficiency at B2+ level

• Build realistic developer environments including codebase, infrastructure, and context (tickets, docs, conversations) that reflect a believable development history
• Design tasks from intermediate states of these environments including crafting prompts, defining solutions, and ensuring solvability by AI agents
• Write tests that verify agent solutions by accepting valid approaches and rejecting incorrect ones appropriately
• Iterate on tasks and tests based on QA feedback by reviewing agent solutions, analyzing failures, and refining evaluation for fairness and robustness

Please submit your CV in English and indicate your level of English proficiency.