Senior Software Engineer - AI Coding Benchmarks

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

• 5+ years in software development
• Experience with Python (specifically FastAPI), JavaScript, TypeScript (using React), Docker, Postgres, Kafka, and Redis
• Experience writing functional and integration tests
• English proficiency at B2 level or higher

• Build realistic developer environments, including codebases, infrastructure, and context such as tickets, documentation, and conversations to simulate development history
• Design tasks from intermediate states of environments by crafting prompts, defining success criteria, and ensuring solvability by AI agents
• Write tests that validate AI agent solutions, accepting all valid approaches and rejecting incorrect ones with appropriate strictness
• Iterate on tasks and tests based on quality assurance feedback, reviewing agent solutions, analyzing failures, and refining evaluations for fairness and robustness

Please submit your CV in English and indicate your level of English proficiency.