Backend Software Engineer

• Proven experience building and operating high-throughput, low-latency production backend services.
• Practical familiarity with AI inference patterns including large language models (LLMs), embeddings, multimodal systems, and integration with providers such as OpenAI and Anthropic, as well as open-source models.
• Expertise in debugging distributed backend architectures under heavy load.
• Product-minded approach with a strong bias toward rapid shipping, learning from production metrics, and full system ownership.

Tech Stack:

• Programming languages: Python, Node.js
• AI/ML frameworks and APIs: PyTorch, OpenAI, Anthropic APIs, open-source LLMs
• Data management: SQL and NoSQL databases
• Infrastructure and operations: Kubernetes, Docker, modern cloud architectures

• Design, build, and scale core orchestration layers, service boundaries, and inference pipelines for production AI features on mobile and desktop apps.
• Develop high-reliability, long-running workflows that manage multi-step reasoning, external tool interaction, and persistent context in non-deterministic model environments.
• Optimize performance by driving low latency and high throughput using inference, caching, batching, and streaming strategies.
• Own end-to-end operational quality, including monitoring, logging, alerting, and incident response for high-traffic API endpoints.

At McGregor Boyall Associates we process information about candidates and clients for our legitimate interests, respecting the privacy of both at all times. If you are a candidate we process information about you in order to contact you about suitable employment opportunities that may be of interest to you. If you are a client we process your data so that we may perform a contract for you, for example in order to contact you when suitable candidates are identified. Details of how we respect your privacy are set out in our Privacy Policy below.

If you are a candidate but don’t want to be contacted by us in the future about potential employment opportunities or if you are a client who doesn’t wish to be contacted about candidates, please email [email protected].