Senior Python Engineer (AI evaluations platform)

You will be cooperating with a leading provider of AI evaluation and optimization solutions, trusted by multinational companies to optimize AI agents and detect performance issues in large language models.

• Ability to work 2:00 p.m. - 10:00 p.m. (CEST)
• 5+ years as a Python Engineer
• Experience with frameworks like FastAPI or Django
• Skills in designing REST APIs
• Experience with relational databases (PostgreSQL)
• Experience with cloud environments like AWS

Nice to have:

• BS/MS in Computer Science, Mathematics, Statistics, or a related quantitative field
• Experience with Next.js and Material UI
• Familiarity with vector and columnar databases

• Build high-performance user interfaces for LLM evaluation workflows, advanced analytics, search, and data visualizations
• Build and maintain production agentic systems, including agent loop architecture, tool/function calling integrations, state management, and custom evaluation harnesses
• Design efficient data models and REST APIs
• Architect and implement agentic systems
• Develop internal tools and libraries (e.g., a data visualization library) to improve productivity across the engineering team
• Treat everything as a work in progress — constantly polish features and iterate on customer feedback
• Collaborate closely with cross-functional partners across engineering, design, product, ML, and research

Due to the client’s time zone, we would appreciate a candidate who can work until 10:00 p.m.