Sr. ML Engineer

• 4+ years of experience in software engineering or machine learning engineering
• Strong proficiency in Python
• Strong experience with LLM inference systems and performance optimization
• Hands-on experience with system integration and end-to-end workflows
• Experience with inference frameworks such as vLLM, TensorRT, SGLang
• Experience working with GPU/accelerator-based systems

Nice to have:

• Hands-on experience with Dynamo and LLM-D for LLM inference and serving
• Familiarity with Kubernetes and cloud environments

• Build and maintain end-to-end integration flows across the AI inference pipeline (serving, orchestration, APIs, and infrastructure)
• Design, implement, and optimize LLM inference workflows, including prefill and decode stages
• Improve system performance with focus on throughput, latency, and interactivity
• Write production-grade components in Python and integrate them into the broader system
• Contribute to system-level logic such as smart hardware selection and execution strategies
• Integrate models (open source and custom), services, and APIs into cohesive, reliable end-to-end application pipelines