Senior/Lead DevOps Engineer

You'll join a cloud engineering team responsible for designing and deploying AI/ML infrastructure and deployment pipelines for high-profile, security-conscious clients. The client delivers secure, large-scale cloud and AI infrastructure for the enterprise and banking sectors, helping them modernize legacy systems and safely adopt AI/ML technologies.

• 5+ years of experience in DevOps/Cloud Engineering with strong hands-on experience deploying and operating AI/ML models and LLM-based applications in production
• Strong scripting and automation skills with Python, Bash, and Terraform
• Experience with IAM, network security, and compliance frameworks especially in regulated industries like banking/finance
• Demonstrated LLMOps experience including model versioning, inference optimization, production monitoring, evaluation, and lifecycle management of deployed models

Nice to have:

• Familiarity with Kubernetes including deploying, operating, and troubleshooting production clusters
• Exposure to NVIDIA GPU infrastructure and tooling such as NVIDIA NIM and Run: AI
• Cloud provider certifications at Architect, Engineer, or Network Engineer levels

• Design, deploy, and maintain secure cloud infrastructure including landing zones, IAM, network security, and encryption/key management across major cloud providers
• Deploy, serve, and optimize AI/ML models and LLM-based applications in production, including inference pipelines and scaling AI workloads
• Build and operate container platforms, preferably Kubernetes, supporting AI/ML and application workloads
• Build and maintain CI/CD pipelines and infrastructure-as-code using tools like Terraform and Jenkins/GitLab
• Implement cost optimization strategies for production and non-production environments
• Ensure compliance and security best practices for handling sensitive data in regulated industries
• Mentor engineers and act as technical point of contact for client engagements

SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.