RemoDevs

Senior Data Engineer (Databricks)

24k - 29k PLN24 000 - 29 000 PLN/ mies./ mies.B2BB2B (netto)

SeniorZdalnie·GdyniaFull-time·B2B

#462733·Dodano 15 dni temu·3

Źródło: justjoin.it

Aplikuj teraz

Tech Stack / Keywords

Databricks Apache PySpark

Podsumowanie oferty

Join a long-term project for a client in the financial services industry as a Senior Data Engineer. You will build and maintain scalable data solutions using Databricks, PySpark, Python, and SQL.

Wymagania

Must-have requirements:

5+ years of commercial experience in Data Engineering.
Minimum 3 years of hands-on experience with Databricks.
Strong practical knowledge of Apache Spark and PySpark.
Advanced SQL and Python programming skills.
Experience designing and implementing ETL/ELT pipelines.
Solid understanding of Delta Lake and Lakehouse architecture.
Knowledge of data modeling, data warehousing, and data integration.
Experience optimizing data processing performance and managing large datasets.
English proficiency at C1 level.

Nice to have:

Previous experience in banking or financial services.
Experience with Azure Data Factory.
Experience with CI/CD pipelines and Infrastructure as Code.
Databricks certifications.
Understanding of data governance, security, and regulatory requirements in financial environments.

Obowiązki

Key Responsibilities:

Design, develop, and maintain scalable data pipelines using Databricks.
Build and optimize ETL/ELT processes for large-scale data processing.
Develop data transformation solutions using PySpark, Python, and SQL.
Implement and optimize Delta Lake architectures.
Design and maintain reliable data ingestion and integration processes.
Improve data quality, performance, and reliability across data platforms.
Collaborate with Data Architects, Analysts, and business stakeholders to deliver data solutions.
Ensure data security, governance, and compliance with financial industry standards.
Troubleshoot and optimize existing data engineering workflows.

RemoDevs

20 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz