Experis

Senior Data Engineer GCP (M/K)

Brak informacji o wynagrodzeniu

SeniorOn-site·WarszawaFull-time

#456786·Dodano 21 dni temu·1

Źródło: Experis

Aplikuj teraz

Tech Stack / Keywords

BigQuerydbtApache AirflowCloud ComposerPython PySpark SQL Terraform GitHub ActionsDataplex

Firma i stanowisko

Experis to światowy lider rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz ciekawe projekty IT skierowane zarówno do ekspertów z wieloletnim doświadczeniem, jak i osób, które dopiero zaczynają swoją przygodę w branży IT.

Wymagania

5+ years of experience in Data Engineering including hands-on production experience with GCP
Strong project experience with BigQuery data layer modeling, partitioning, clustering, and cost optimization
Experience with dbt models, tests, and documentation
Experience with Apache Airflow / Cloud Composer
Proficient in Python and PySpark
Proficient in SQL
Experience with Terraform
Experience building lakehouse / data warehouse solutions using medallion architecture
Experience with CI/CD (preferably GitHub Actions), Git, and pipeline testing and monitoring
Practical knowledge of data security on GCP including IAM, policy tags / column-level security, and row-level security
Very good command of English

Nice to have:

Experience with Dataplex / Data Catalog, data lineage, and metadata management
Familiarity with Cloud DLP / Sensitive Data Protection
Experience with Dataproc and Pub/Sub
Experience in banking sector or regulated industries
Experience working in platform-oriented model (Hub & Spoke, data mesh, data products)
Google Professional Data Engineer certification

Obowiązki

Build and maintain data pipelines using dbt and orchestrate workflows with Apache Airflow / Cloud Composer
Develop data processing components in Python and PySpark
Design and develop the Gold and Platinum layers of the medallion architecture in BigQuery
Optimize BigQuery performance and costs through partitioning, clustering, and FinOps practices
Build and maintain CI/CD pipelines using GitHub Actions and manage infrastructure as code with Terraform
Implement the data security model including IAM, RBAC/ABAC, policy tags, and DLP
Contribute to Data Governance standards, including Dataplex, metadata management, and data lineage
Conduct code reviews and help define team engineering standards and best practices
Provide technical guidance to domain teams within the Hub & Spoke model and promote data engineering best practices on GCP

Benefity

Benefit package including medical care, sport, lunch subsidy, and life insurance
Opportunity to be part of a dynamic and fast-growing team reshaping financial and insurance services landscape in Poland
Work in a high-performance environment with personal and professional growth opportunities
Collaborate with senior leaders and industry experts
Competitive compensation package including performance-based incentives and benefits

Opieka zdrowotna

Karta sportowa

Experis

336 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz