ITDS

Senior PySpark Data Engineer – Big Data & Cloud Integration

~18.7k - 22.5k PLN18 700 - 22 500 PLN/ mies./ mies.B2BB2B (netto)

Brak informacji o wynagrodzeniu

SeniorHybryda·KrakówFull-time·B2B·Umowa o pracę

#424041·Dodano dwa miesiące temu·1

Źródło: ITDS

Aplikuj teraz

Tech Stack / Keywords

Google Cloud Platform Hadoop PySpark Spark SQL YARN

Firma i stanowisko

The role is for a Kraków-based client specializing in large-scale data engineering and cloud integration, focusing on transforming experimental insights into scalable, high-performance data workflows.

Wymagania

5+ years of experience in data engineering and PySpark/Spark development.
Strong SQL skills and experience with Spark optimization techniques.
Hands-on experience with the Hadoop ecosystem, especially Spark on YARN.
Knowledge of cloud platforms, preferably Google Cloud Platform (GCP), is a strong plus.

Nice to have:

Certifications or additional experience in cloud computing or big data solutions.
English language proficiency with communicative skills.

Obowiązki

Convert experimental code into scalable, efficient workflows and modules.
Develop and optimize data pipelines using PySpark and Spark on YARN.
Collaborate with data scientists and engineers to productionize analytical solutions.
Ensure code quality, perform performance tuning, and implement best data engineering practices.
Maintain and improve performance of data workflows in a large-scale environment.
Integrate data pipelines within cloud ecosystems, primarily Google Cloud Platform (GCP).
Support continuous improvement through performance monitoring and optimization.

Inne informacje

Only candidates with an existing legal right to work in the European Union will be considered for this role.

ITDS

343 aktywne oferty

Zobacz wszystkie oferty

Aplikuj teraz