Software Engineer III, Vertex Inference

Google Cloud AI Research team works on AI challenges motivated by Google Cloud’s mission to bring AI to various industries including tech, healthcare, finance, and retail. The Vertex Inference On Hybrid Clouds team focuses on delivering AI/ML capabilities such as GenAI and MLOps to Google Cloud, specifically developing components for serving first-party models like Gemini.

• Bachelor’s degree or equivalent practical experience.
• 2 years of experience with software development in one or more programming languages, or 1 year with an advanced degree.
• 1 year of experience with ML infrastructure (model deployment, evaluation, optimization, data processing, debugging).
• Experience with GenAI techniques (LLMs, Multi-Modal, Large Vision Models) or related concepts (language modeling, computer vision).

Preferred qualifications:

• Master's degree or PhD in Computer Science or related technical fields.
• 2 years of experience with data structures and algorithms.
• Experience with GenAI serving infrastructure.

• Implement GenAI solutions, utilize ML infrastructure, and contribute to data preparation, optimization, and performance enhancements.
• Write product or system development code.
• Collaborate with peers and stakeholders through design and code reviews to ensure best practices.
• Triage product or system issues and debug/track/resolve by analyzing sources of issues and their impact on hardware, network, or service operations and quality.

Google is an equal opportunity workplace and affirmative action employer committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. They consider qualified applicants regardless of criminal histories, consistent with legal requirements. Accommodations are available for applicants with disabilities or special needs.