[Akamai] Senior II Software Engineer Lead (AI)

The Akamai Inference Cloud team is part of Akamai's Cloud Technology Group. They build AI platforms for efficient, compliant, and high-performing applications supporting customers in running inference models and enabling developers to create advanced AI solutions.

• Broad software engineering experience with proficiency in distributed systems, cloud services, and platform engineering.
• Hands-on experience with AI inference, model serving, or LLM deployment with knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton).
• Expertise in cloud-native architectures including containerization and orchestration technologies like Kubernetes and Docker.
• Proven experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code.
• Broad technical leadership through mentoring, code quality advocacy, and technical problem-solving.
• Knowledge of observability, monitoring, and debugging distributed systems.
• Familiarity with GPU infrastructure and hardware acceleration.

• Lead the design and implementation of critical platform components for Akamai Inference Cloud ensuring performance, scalability, and reliability.
• Drive technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads.
• Mentor and guide engineers through code reviews, design discussions, and technical problem-solving.
• Implement and optimize containerized AI workloads with hardware-specific optimizations and integrate inference frameworks at scale.
• Collaborate across teams to define technical requirements, contribute to platform standards, and ensure operational excellence.