Software Engineer III, GenAI, LLM Infrastructure, Cloud AI

Google is a leading technology company developing next-generation technologies that impact billions of users globally. The role is part of the GGC (Gemini On Google Cloud Connected) Management Plane team within the Vertex AI Organization, focusing on deploying and managing Gemini model and other Google models on Google Distributed Cloud (GDC) to support customers with data security, privacy, sovereignty, or residency requirements. The Google Cloud AI Research team works on scientific and real-world AI challenges with applications across multiple industries such as healthcare, finance, and retail.

• Bachelor's degree or equivalent practical experience.
• 2 years of experience with software development in one or more programming languages, or 1 year with an advanced degree.
• 1 year of experience with speech/audio technology, reinforcement learning, ML infrastructure, or specialization in another ML field.
• 1 year of experience with ML infrastructure including model deployment, evaluation, optimization, data processing, or debugging.

Preferred qualifications:

• Master's degree or PhD in Computer Science or related technical fields.
• 2 years of experience with data structures or algorithms.
• Experience developing accessible technologies.
• Experience with Java or C++.

• Engineer and deploy scalable, user-friendly AI/ML platform capabilities.
• Extend the model management and deployment API for Google Distributed Cloud (GDC) environments.
• Extend the gcloud CLI and UI functions for GDC environments.
• Design, implement, and deploy solutions to guarantee reliability, performance, robustness, and quality of AI offerings and serving stack.
• Create systems and automations to improve deployment and testing pipelines.

Google is an equal opportunity employer committed to inclusive hiring practices regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, Veteran status, or criminal history. Accommodations are available upon request for disabilities and special needs.