ML Engineer

For our IT industry partner, we are seeking an experienced ML/AI Engineer. You will learn the name of your future employer during the very first contact, i.e. in the initial phone conversation, and the recruitment process itself will be efficient and fast.

• Proficiency in deploying and optimizing LLM inference engines in a production environment.
• Ability to build and scale RAG pipelines.
• Data science skills to adapt RAG pipelines to client data.
• Expertise in managing production workloads on Kubernetes.
• Skilled in creating complex workflows, creating and integrating different agents.

Highly Desirable:

• Experience with PEFT techniques like LoRA for model fine-tuning.
• Knowledge of evaluation frameworks to measure and improve RAGs.
• Familiarity with open source LLM models.
• Experience with Apache APISIX for API Gateway management including rate limiting and throttling AI inference.
• Experience with GitOps and ArgoCD in managing Kubernetes deployments.

• Architect, develop and maintain LLM inference services for AIaaS platform based on vLLM.
• Be responsible for the deployment lifecycle, from containerisation to monitoring model performance, token usage, and system reliability in production.
• Implement and optimize RAG pipelines, making them work best with clients' data.
• Create LLM-based agents and agentic workflows to help clients automate their business processes.