Senior Solutions Architect – Large Scale Neural Networks Inference

NVIDIA is a leading technology company specializing in AI and neural network inference solutions for large-scale deployments across EMEA.

• MS or PhD in Computer Science, Engineering, or equivalent experience.
• 8+ years in AI/ML infrastructure with deep expertise in LLM/VLM inference optimization and production deployment.
• Deep understanding of transformer inference acceleration techniques: quantization (INT4/FP8), speculative decoding, disaggregated inference, continuous batching, KV cache optimization, and WideEP for MoE models.
• Understanding of GPU memory hierarchies and low-latency networking impacts on inference performance.
• Proven track record in leading technical initiatives.
• Excellent communication skills with research scientists, infrastructure engineers, and executive teams.

Nice to have:

• Experience with TensorRT-LLM, Triton Inference Server, NIM, and NVIDIA Dynamo.
• Experience with GPU orchestration on Kubernetes.
• Experience operating inference at scale in frontier AI labs or hyperscale inference teams.
• Contributions to open-source inference projects such as vLLM, SGLang, KServe, or NVIDIA Dynamo.

• Lead the inference strategy for a portfolio of EMEA AI Natives customers, guiding engagements from initial proof of concept to production-scale deployments.
• Identify inference challenges across customer deployments including latency, efficiency, cost per token, memory utilization, and low-latency networking.
• Architect and optimize high-performance inference pipelines using NVIDIA Dynamo, TensorRT-LLM, vLLM, SGLang, and other inference backends.
• Translate customer insights and deployment patterns into actionable product feedback to develop the roadmap for NVIDIA stack such as Dynamo, TensorRT-LLM, and NIM.

NVIDIA is an equal opportunity employer with nondiscrimination policies based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or other protected characteristics.