New

Senior Data Engineer with GCP

28k - 32k PLN28 000 - 32 000 PLN/ mies./ mies.

SeniorHybrydaFull-time

#475087·Dodano dziś·0

Źródło: LinkGroup

Aplikuj teraz

Tech Stack / Keywords

GCP BigQuery Apache Spark PySpark Apache Airflow Terraform SQL GitHub ActionsIAMDataproc

Podsumowanie oferty

Support a data platform modernization project migrating on-premise solutions to Google Cloud Platform. Design and optimize data pipelines using Spark, PySpark, and Airflow, and collaborate on technical solutions with engineers, architects, and business stakeholders.

Wymagania

Hands-on experience with GCP, particularly BigQuery, IAM, Dataproc, and GCS.
Knowledge of Terraform and Infrastructure as Code.
Strong experience with Apache Spark and PySpark (3.5).
Experience with Apache Airflow (3.x).
Good SQL skills and experience with data transformation.
Familiarity with Git, CI/CD, and GitHub Actions.
Ability to translate business requirements into technical solutions.
Strong analytical and communication skills.
Proactive, collaborative approach and fluent English.

Nice to have:

Experience with Scala or Java.
Familiarity with BI and data visualization tools.
Previous experience in banking or financial services.

Obowiązki

Design and implement data pipeline migration from on-premise environments to GCP.
Analyze existing workflows and recommend improvements and cloud-native solutions.
Collaborate with engineers and architects on technical design and implementation.
Develop and optimize data processing solutions using Spark, PySpark, and Airflow.
Estimate workloads and report delivery progress and potential risks.
Work with business stakeholders to clarify requirements and recommend suitable technical solutions.

Link Group

560 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz