Senior Data Engineer (GCP)

140 - 165 PLN/ godz./ godz.B2BB2B (netto)

SeniorZdalnie·WarszawaFull-time·B2B

#475904·Dodano wczoraj·2

Źródło: nofluffjobs.com

Aplikuj szybko

Tech Stack / Keywords

Google Cloud Platform ETL Airflow Python SQL Spark DevOps CI/CD KubernetesMLOpsAIScala REST API TerraformVertexAI

Podsumowanie oferty

Build and scale reliable data platforms for high-volume production environments, including real-time pipelines, ML infrastructure and attribution data processing. The role focuses on large-scale advertising data pipelines and attribution processing, using GCP, Apache Spark, Python, SQL and Apache Airflow.

Wymagania

Over 3 years of experience in Data Engineering and building production-scale data platforms.
Strong programming skills in Python and SQL.
Advanced experience with data modeling, ETL development, and multiple data formats.
Strong knowledge of Google Cloud Platform and cloud-native architecture design.
Expert knowledge of Apache Airflow for workflow orchestration and automation.
Hands-on experience with Apache Spark for batch and high-volume streaming workloads.
Good understanding of CI/CD and DevOps tools such as GitHub Actions or Kubernetes.

Nice to have:

Experience with MLOps and ML deployment in production, preferably with Vertex AI.
Practical experience with Terraform for Infrastructure as Code.
Experience building scalable REST APIs for data or ML services.
Strong testing practices, including TDD and unit/integration tests for Spark and Airflow.
Knowledge of Scala for high-performance data processing.

Obowiązki

Build and maintain large-scale advertising data pipelines for clicks, impressions, attribution, and event processing.
Improve attribution modeling logic to support better optimization and business decisions.
Ensure high availability, performance, stability, and scalability of real-time data workflows.
Design and support production-grade ML model serving infrastructure.
Develop and manage dbt datasets for model training, experimentation, and Feature Store integration.

Benefity

Sport subscription.
Training budget.
Private healthcare.

Karta sportowa

Dofinansowanie szkoleń

Opieka zdrowotna

DS STREAM

6 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj szybko