Senior Solutions Architect – Large Scale AI Inference

NVIDIA is a leading technology company known for its AI and high-performance computing solutions. This role involves collaboration across EMEA with AI natives, infrastructure providers, and enterprises deploying AI at scale.

• MS or PhD in Computer Science, Engineering, High-Performance Computing, or equivalent professional experience.
• 5+ years of experience in Neural Networks inference optimization.
• Solid understanding of transformer inference optimization: quantization, disaggregated inference, speculative decoding, continuous batching, KV cache optimization.
• Practical experience in MoE inference at scale: expert parallelism, WideEP, all-to-all communication, routing overhead, and load balancing at scale.
• Ability to engage effectively with ML engineers, researchers, and systems architects at a deep technical level.

Nice to have:

• Hands-on experience with NVIDIA Dynamo, NIXL, Grove, or emerging disaggregated inference tooling.
• Understanding of GPU memory hierarchies and high-speed interconnects (NVLink, InfiniBand, RDMA, UCX).
• Contributions to advanced AI labs or large scale AI infrastructure providers performing inference on thousands of GPUs.
• Published work or benchmarks in large-scale AI inference.

• Guide EMEA AI Natives customers in deploying and optimizing large-scale inference workloads on multi-node GPU clusters.
• Architect efficient inference pipelines for dense and sparse/latent Mixture-of-Experts (MoE) models distributing workload among thousands of GPUs.
• Improve inference efficiency across quantization (INT4/FP8), speculative decoding, disaggregated prefill/decode, KV cache management, and WideEP for large MoE deployments.
• Collaborate with NVIDIA product teams (Dynamo, TensorRT-LLM, NIXL) to accelerate customer success.
• Animate the AI inference developer’s community across EMEA through technical workshops, hackathons, and reference architectures.

NVIDIA is an equal opportunity employer and does not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.