Solutions Architect - Deep Neural Network Evaluation

NVIDIA’s Worldwide Field Operations (WWFO) team is looking for an AI focused Solution Architect with expertise in evaluation of neural networks and agentic pipelines. The role involves working with key model builders and AI application developers across EMEA to improve core models and end-to-end agentic pipelines. The position focuses on evaluation, analysis, and design of agentic AI systems, emphasizing LLMs and retrieval-based architectures.

• MS/PhD or equivalent experience in Computer Science, Data Science, Electrical/Computer Engineering, Physics, Mathematics, or other Engineering fields.
• 5+ years of hands-on experience in building and evaluating Deep Neural Networks.
• Proven academic and/or industry experience in machine learning, deep learning, and/or data science, with preference towards Deep Learning.
• Work experience and knowledge of the latest LLMs, VLMs, and Retrieval Systems.
• Understanding of key libraries used for DNN evaluation like Eval Harness or NVIDIA Evaluation Microservice and agentic pipeline evaluation.
• Good understanding of modern evaluation benchmarks and ability to extend or build new benchmarks.
• Excellent verbal, written communication, and technical presentation skills in English.

Nice to have:

• Experience evaluating models for memorization, security risks, or hidden instructions.
• Experience using evaluation tools with large models at scale.
• Understanding of large-scale distributed training.
• Experience in evaluation approaches for reinforcement learning.

• Work directly with key customers to understand their technology and provide the best solutions.
• Drive adoption of NVIDIA open-source evaluation tools (NeMo) and help develop standard methodology for model robustness measurement.
• Develop and demonstrate solutions based on NVIDIA’s and open-source LLM technology and integrate them into agentic pipelines.
• Partner with engineering, product, and sales teams to develop and plan suitable solutions for customers.
• Enable development and growth of product features through customer feedback and proof-of-concept evaluations.
• Build industry expertise and contribute to integrating NVIDIA technology into Enterprise Computing architectures.

NVIDIA is an equal opportunity employer and does not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.