OPTIVEUM SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ

Azure Databricks Engineer

135 - 160 PLN/ godz./ godz.B2BB2B (netto)

SeniorHybryda·KrakówFull-time·B2B

#472512·Dodano 13 dni temu·2

Źródło: justjoin.it

Aplikuj teraz

Tech Stack / Keywords

Azure DatabricksLakeHousePython SQL

Podsumowanie oferty

You will design and build big data solutions for batch and real-time analytics for a global investment bank. The work focuses on Azure Databricks, Delta Lake, PySpark and Kafka, using Lakehouse / Medallion architecture.

Wymagania

Bachelor's degree or higher in Computer Science, Engineering or Science.
8–10 years of experience, including 5+ years with Azure cloud-native services.
Strong hands-on experience with Azure Databricks, Delta Lake, Python / PySpark and Spark.
Knowledge of Lakehouse, Data Mesh, Data Virtualisation, dimensional modelling and data aggregation techniques.
Experience building distributed data platforms at large scale, e.g. Spark, Kafka, Flink or HBase.
Experience with Hadoop-based implementations, SQL / T-SQL, Unix and Hive.
Experience with Azure Data Factory, ADLS Gen2 and Azure SQL Database.
Good understanding of RDBMS, Data Lake, Data Warehouse, Lakehouse and Medallion Architecture.
Experience with at least one workflow orchestration tool, such as Apache Airflow, Luigi, Oozie, AWS Glue or similar.
Knowledge of Microsoft Fabric and basic understanding of data quality dimensions.
Fluent English.

Obowiązki

Design and implement big data solutions in Azure Databricks for batch and real-time analytics use cases.
Build Spark pipelines that populate downstream data marts for BI and generate feeds for Data Science.
Integrate real-time services that process business events from Kafka and persist them in ADLS Gen2 using Databricks.
Develop near real-time stream processing to derive features for ML model inference.
Optimise Databricks performance, including liquid clustering, vacuum and Z-ordering.
Work with DevOps teams to drive operationally excellent infrastructure.

Inne informacje

Candidates must live in or near Kraków.
Candidates must have Polish or EU citizenship, or a permanent residence / work permit valid for at least 12 months.
The recruitment process includes one interview with the IT services partner, followed by 1–3 interviews with the bank.
Technical tasks are completed live; candidates must have their programming environment set up and tested beforehand. AI tools, coding assistants and code generators are not allowed during interviews.
The selected candidate will undergo a background check by an external company, covering identity, right to work, education and employment history.
Candidates who took part in a recruitment process for this IT services partner or the bank in the last 12 months cannot be considered.
The name in the application and CV must match the official ID document exactly; Polish citizens must include all first names.

OPTIVEUM SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ

169 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz