Link Group

Azure Data Engineer with Databricks

120 - 130 PLN/ godz./ godz.B2BB2B (netto)

MidZdalnie·WarszawaFull-time·B2B

#461632·Dodano 26 dni temu·2

Źródło: justjoin.it

Aplikuj teraz

Tech Stack / Keywords

PySpark AzureAzure Data FactoryDatabricks SQL

Podsumowanie oferty

Develop and implement scalable data processing solutions and data pipelines on Azure, contributing to end-to-end data platform solutions. The role focuses on data engineering with Databricks, Azure Data Factory, SQL and PySpark.

Wymagania

Hands-on experience implementing solutions with data lakes and pipelines using Databricks and Azure Data Factory.
Proven experience designing and implementing solutions in the Azure cloud; knowledge of AWS or GCP is an additional advantage.
Proficiency in SQL, PySpark, data modeling (3NF, star/snowflake schemas) and ELT/ETL design patterns; knowledge of popular ETL tools, including Azure Data Factory.
Experience with Python or similar scripting languages for data transformation, orchestration and automation.
Familiarity with advanced Databricks features: Unity Catalog, MLflow, Jobs and Pipelines.
Understanding of cloud data architecture principles, including data lakehouse concepts, Medallion architecture, API integration and event-driven architecture.
Experience with CI/CD and DevOps practices for data workflows (Git, Azure DevOps) and analytics integration (e.g. Power BI).
Excellent communication and client-facing skills, including the ability to explain technical concepts clearly to team members and stakeholders.
Strong collaboration skills across multidisciplinary teams.

Obowiązki

Develop and implement scalable data processing solutions on Azure, transforming and cleaning large structured and unstructured datasets.
Design, build and maintain data pipelines integrating data from databases, APIs and streaming platforms.
Collaborate with data engineers, data scientists and cloud architects to deliver end-to-end data platform solutions.
Engage with business analysts, source system experts, data architects, engineers and product owners at critical stages of project development.
Communicate and document technical work, considering performance and cost in design decisions.

Link Group

532 aktywne oferty

Zobacz wszystkie oferty

Aplikuj teraz