Senior/Staff Software Engineer, GenAI Infrastructure

Google Cloud specializes in AI/ML infrastructure, delivering enterprise-grade solutions to customers in more than 200 countries and territories. The Cloud AI team in Poland focuses on designing, building, and maintaining scalable backend infrastructure for GenAI systems, particularly the middleware layer between user-facing APIs and ML models/data stores.

• Bachelor's degree or equivalent practical experience.
• 5 years of software development experience in Java, Kotlin, or equivalent languages.
• 3 years of experience testing, maintaining, or launching software products.
• 1 year of experience with software design and architecture.
• 3 years of experience building large-scale infrastructure, distributed systems, networks, or experience with compute technologies, storage, or hardware architecture.
• Preferred: Experience designing and building RESTful or gRPC APIs.
• Preferred: Knowledge of model serving frameworks (TensorFlow Serving, TorchServe, Triton Inference Server, Vertex AI Prediction).
• Preferred: Familiarity with Google Cloud Platform services relevant to AI/ML infrastructure (Vertex AI, GKE, Cloud Storage, BigQuery).
• Preferred: Excellent ownership, problem-solving skills, and familiarity with system design.

• Architect and implement backend libraries, services, and systems to support AI/ML workflows, including agentic frameworks, model serving platforms, feature stores, data pipelines, and API gateways.
• Optimize performance, latency, throughput, and resource utilization of middleware components.
• Ensure infrastructure scalability, high availability, and fault tolerance.
• Collaborate with ML engineers, data scientists, and application developers to integrate models and data sources.
• Automate deployment, testing, and operational tasks related to AI/ML infrastructure (MLOps practices).

Google is an equal opportunity employer committed to equal employment regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. They consider qualified applicants regardless of criminal histories and provide accommodations for applicants with disabilities.