Software Engineer 2 (Python) - maternity cover

In our domain, we focus on delivering the core search and retrieval capabilities for the Allegro AI Assistant. We maintain a critical entry point for users looking to discover products, compare offers, and get personalized recommendations through natural conversations. We design, implement, and operate an extensive system combining modern microservice architecture with Large Language Models, high-performance retrievers, and vast data sources. We care about data quality, robust context building, and near real-time accuracy to best guide users through a highly dynamic marketplace via an intelligent, conversational interface.

• Code in Python, Java, and Kotlin.
• Creative approach to search experience challenges.
• Ability to create solid code, accept comments, and share knowledge during code reviews.
• Seek effective solutions to user requirements.
• Desire for continuous development and knowledge update.
• English proficiency at least B2 level.

Nice to have:

• Openness to diverse technologies and workflows including dev-operational tools and working with data.
• Basic experience with LLM tuning (LoRA, PEFT), training and evaluation pipelines for models.
• Experience with frameworks for building AI Agents (Agent Development Kit, LangChain, AutoGen, CrewAI).

Performance & Scale:

• Design, build, and optimize AI-driven systems that process complex natural language interactions.
• Deliver low-latency, high-quality responses from the AI Assistant requiring high-availability and smart optimization of LLM and retrieval workloads.

Modern Tech Stack:

• Work with a cloud-native polyglot environment including Java, Kotlin, Spring, and ADK.
• Utilize Python and LangChain for complex LLM orchestration.
• Use Langfuse for observability, prompt tracking, and evaluation.
• Leverage advanced vector search and modern ML solutions.

True Ownership & Autonomy:

• Join an agile, autonomous team with full ownership of AI microservices and data pipelines from design to deployment.
• Implement improvements based on experiments and AI evaluation metrics.

Complex Challenges:

• Work on LLM orchestration and Retrieval-Augmented Generation (RAG).
• Optimize semantic search.
• Integrate advanced embedding models, prompt pipelines, and vector databases to ensure accurate information retrieval.