Staff Software Engineer, Load Balancing and Agent Gateway

Google Cloud delivers enterprise-grade solutions leveraging cutting-edge technology to help developers build sustainably. The role involves working on Google Kubernetes Engine (GKE) and contributing to upstream Kubernetes open-source projects, focusing on enhancing performance and scalability for AI workloads.

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++, Java, Python, Kotlin, or Go.
• 5 years of experience in a technical leadership role.
• 3 years of experience with software design and architecture.
• Experience with networking protocols (e.g., TCP/IP, BGP, OSPF, MPLS).

Preferred qualifications:

• Master’s degree or PhD in Engineering, Computer Science, or related technical field.
• 8 years of experience with data structures/algorithms.
• 3 years of experience in a technical leadership role leading project teams and setting technical direction.
• 3 years of experience working in a complex, matrixed organization involving cross-functional or cross-business projects.
• Experience designing and implementing scalable solutions using Kubernetes.

• Design, develop, test, and maintain features for the GKE Agent Gateway, enhancing capabilities for AI/ML workloads and lead contributions to the GKE Gateway controller OSS community on Inference.
• Collaborate with Load Balancing development teams on requirements and integrations with Google Cloud Load Balancers (e.g., Envoy features and Service Extensions).
• Engage with and contribute to the upstream OSS Kubernetes Gateway API project.
• Work with AI/ML platform teams to ensure optimal routing, load balancing, and autoscaling for inference serving.
• Develop solutions spanning both the Kubernetes control plane and the load balancing data plane, improving observability, testability, and reliability of the Inference Gateway.

Google is an equal opportunity workplace and affirmative action employer committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. Qualified applicants are considered regardless of criminal histories, consistent with legal requirements. Accommodations for applicants with disabilities are available upon request.