Software Engineer III, Agent Quality and Efficiency Optimization

Google Cloud AI Research team focuses on AI challenges related to tech, healthcare, finance, retail, and other industries. The team works on research topics to advance AI and collaborates with product teams to realize innovations with real-world impact.

• Bachelor’s degree or equivalent practical experience.
• 2 years of software development experience in languages such as Go, C++, or Python, or 1 year with an advanced degree.
• 2 years of experience with machine learning, large language models (LLMs), or applied AI.

Preferred qualifications:

• Master’s degree or PhD in Computer Science, Machine Learning, or related field.
• Experience building, deploying, or optimizing LLM applications or agentic frameworks like Agent Development Kit, LangGraph, LangChain.
• Experience with model serving optimization, inference caching, model routing, or LLM cost and latency profiling.
• Experience instrumenting, benchmarking, or evaluating ML systems in production.
• Experience in technical leadership, mentoring engineers, or driving cross-team engineering initiatives.

• Design, build, and ship agent efficiency systems, cost and quality telemetry, smart model routing, deferred execution, and continuous optimization into the Agent Development Kit and Vertex AI serving stack.
• Measure cost and latency data and translate findings into targeted engineering work.
• Shape the team's efficiency roadmap and set technical direction for enterprise agents in production.
• Benchmark efficiency techniques on open source and enterprise workloads to ensure cost and latency improvements without accuracy regressions.
• Partner with evaluation engineers, model-serving teams, and product teams to close optimization loops and implement changes across the Agent Platform.

Google is an equal opportunity employer committed to equal employment regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. Accommodations are available for applicants with disabilities.