Senior Data Engineer with DevOps
Tech Stack / Keywords
Firma i stanowisko
Our client is one of the largest game studios known for their very successful MOBA and FPS franchises. The role is within the Data Operations team focused on modernizing the Analytics Platform and building services, tooling, and infrastructure supporting data ingestion, schema management, and delivery into Databricks.
Wymagania
- Minimum of 5 years commercial work experience in software engineering, data engineering, or platform engineering
- Bachelor's or higher degree in Computer Science, Software Engineering, or related field
- Coding skills with commercial experience in Java, Python, and Golang
- Knowledge of Infrastructure as Code tooling such as Terraform
- Experience with CI/CD tooling like GitHub Actions, Jenkins, and Docker
- Experience with streaming and schema-driven systems, e.g., Kafka, Protobuf, JSON Schema, or schema registries
- Commercial experience with Airflow and DBT (Data Build Tool)
- Commercial experience with Databricks
- Commercial experience with Spark and PySpark
Nice to have:
- Experience migrating legacy services or frameworks to modern application stacks
- Experience with Databricks Delta Live Tables and Unity Catalog
- Experience with AWS, especially Kafka/MSK, S3, IAM, and VPC/networking
- Experience with Buf, Protobuf tooling, or JSON-to-Protobuf migration
- Familiarity with Golang for internal tooling or automation
- Experience with infrastructure monitoring and on-call tools like Datadog and PagerDuty
- Experience working with cross-discipline organizations building data products
- Experience in gaming industry, particularly online multiplayer games
- Proficient in large-scale data manipulation across data types
- Demonstrated ability to troubleshoot and optimize complex ETL pipelines
Obowiązki
- Design, build, and operate services and pipelines that power analytics data ingestion, schema management, and delivery into Databricks
- Modernize legacy platform components by migrating services, libraries, and deployment workflows to modern Java and application standards
- Build automation, CI/CD flows, and scenario/integration test coverage to make platform changes safe and repeatable
- Design and maintain production infrastructure in AWS using Infrastructure as Code tooling such as Terraform
- Improve data quality through stronger schema validation, metadata capture, lineage tracking, and operational guardrails
- Build tooling and paved paths that help internal customers migrate to new ingestion and schema standards
- Collaborate with cross-functional teams to prepare design docs, rollout plans, and implementation strategies for platform changes
- Monitor live systems, investigate incidents, and be part of on-call team providing 3rd line support to live analytics services
- Support performance, reliability, and cost optimization across ingestion and processing flows
Inne informacje
Klauzula informacyjna o przetwarzaniu danych osobowych dla kandydatów zgodnie z RODO i przepisami Kodeksu pracy. Dane osobowe będą przetwarzane w celu rekrutacji oraz mogą być przekazywane do państwa trzeciego, tj. Stanów Zjednoczonych, przy zachowaniu odpowiednich zabezpieczeń. Podanie danych jest dobrowolne, lecz niezbędne do uwzględnienia kandydatury. Przysługują prawa dostępu, poprawiania i cofnięcia zgody na przetwarzanie danych osobowych.
Appliscale
6 aktywnych ofert