Link Group

Senior Data Engineer with GCP

28k - 32k PLN28 000 - 32 000 PLN/ mies./ mies.B2BB2B (netto)

SeniorHybryda·WarszawaFull-time·B2B

#475071·Dodano 9 dni temu·7

Źródło: nofluffjobs.com

Aplikuj teraz

Tech Stack / Keywords

GCP BigQueryIAMTerraformInfrastructure as CodeApache Spark PySpark Apache Airflow SQL Git CI/CD GitHub ActionsCommunication skillsScala JavaBIData visualization

Podsumowanie oferty

Support a data platform modernization project, migrating on-premise solutions to Google Cloud Platform. Design and optimize data pipelines and develop data-processing solutions using Spark, PySpark, and Airflow.

Wymagania

Hands-on experience with GCP, particularly BigQuery, IAM, Dataproc, and GCS.
Knowledge of Terraform and Infrastructure as Code.
Strong experience with Apache Spark and PySpark (3.5).
Experience with Apache Airflow (3.x).
Good SQL skills and experience with data transformation.
Familiarity with Git, CI/CD, and GitHub Actions.
Ability to translate business requirements into technical solutions.
Strong analytical and communication skills.
Proactive, collaborative approach and fluent English.

Nice to have:

Experience with Scala or Java.
Familiarity with BI and data visualization tools.
Previous experience in banking or financial services.

Obowiązki

Design and implement data pipeline migration from on-premise environments to GCP.
Analyze existing workflows and recommend improvements and cloud-native solutions.
Collaborate with engineers and architects on technical design and implementation.
Develop and optimize data processing solutions using Spark, PySpark, and Airflow.
Estimate workloads and report delivery progress and potential risks.
Work with business stakeholders to clarify requirements and recommend suitable technical solutions.

Link Group

532 aktywne oferty

Zobacz wszystkie oferty

Aplikuj teraz