AI Inference Engineer

ITRex is an AI-focused company with over 250 employees across the US and Europe, delivering practical AI solutions for clients such as Procter & Gamble and Shutterstock.

• Excellent programming skills in C++; experience in JavaScript is a bonus
• Strong experience with llama.cpp and ggml inference engines for deploying models to specific GPU architectures
• Good understanding of deep learning concepts and model architectures
• Experience with transformers, large language models (LLMs), and diffusion models
• Demonstrated ability to rapidly assimilate new technologies and techniques
• Degree in Computer Science, AI, Machine Learning, or a related field with a solid track record in AI research and development

• Work on deploying machine learning models to edge devices using frameworks such as llama.cpp and ggml
• Collaborate closely with researchers to assist in coding, training, and transitioning models from research to production environments
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning