Senior Software Engineer – AI Coding Benchmarks

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

• 5+ years in software development.
• Core stack experience with Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis.
• Experience writing functional and integration tests.
• English proficiency at B2 level or above.

• Build realistic developer environments including codebase, infrastructure, and context such as tickets, documentation, and conversations.
• Design tasks from intermediate states of environments, defining prompts and success criteria for AI agents.
• Write functional and integration tests that accept all valid AI solutions and reject incorrect ones.
• Iterate on tasks and tests based on QA feedback, reviewing agent solutions and refining evaluations until robust.

This is not a permanent employment position, participation is project-based. Tasks must be submitted by deadlines and meet acceptance criteria to qualify for payment.