Senior Staff Software Engineer, AI Agent Platform, Vertex

Google Cloud AI Agent Platform (previously Vertex) focuses on building scalable GenAI products and backend infrastructure serving millions of requests to power next-generation AI-driven applications.

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure including model deployment and fine tuning.
• 5 years of experience in systems architecture and large-scale serving infrastructure.
• Experience delivering technical solutions in a changing environment.
• Experience working in multinational or internationalized organisations on global initiatives.

Preferred qualifications:

• Master’s degree or PhD in Engineering, Computer Science, or related field.
• 8 years of experience with data structures and algorithms.
• 5 years in technical leadership roles leading project teams and setting technical direction.
• 3 years working in complex matrix organisations involving cross-functional, cross-timezone or cross-business projects.
• Experience serving Generative AI models using inference frameworks or hardware accelerators like GPUs and TPUs.

• Architect, develop, and maintain robust, horizontally scalable APIs and backend infrastructure for Generative AI workloads.
• Optimize routing, load balancing, quota management, and data plane mechanisms connecting user API requests to ML serving clusters across TPUs and GPUs.
• Prototype and launch new API products rapidly in a fast-paced, collaborative environment.
• Collaborate with ML researchers, ML serving teams, and product managers to translate AI capabilities into reliable enterprise-grade APIs.
• Define and implement best practices for API security, high availability, fault tolerance, and observability across distributed systems.

Google is an equal opportunity employer committed to diversity and inclusion. Candidates with disabilities or needing accommodation can request it. The job is located onsite in Warsaw, Poland.