Senior Software Engineer - AI Coding Benchmarks

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

• 5+ years in software development experience.
• Core stack experience with Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis.
• Experience writing functional and integration tests.
• English proficiency at B2 level or higher.

• Build realistic developer environments simulating a virtual company with codebase, infrastructure, and context such as tickets, documents, and conversations.
• Design tasks from intermediate states of these environments, crafting prompts and defining criteria for task completion.
• Write tests that verify AI agent solutions, accepting all valid approaches while rejecting incorrect ones.
• Iterate on tasks and tests based on QA feedback by reviewing agent solutions, analyzing failures, and refining evaluations.

Please submit your CV in English and indicate your level of English proficiency.