F/M: Data Engineer

160 - 180 PLN/ godz./ godz.B2BB2B (netto)

MidOn-siteFull-time·B2B

#430653·Dodano dwa miesiące temu·3

Źródło: PeopleVibe

Aplikuj teraz

Tech Stack / Keywords

Apache SparkAPIPython SQL CI/CD kafka Azure DatabricksIACData LakeUnity Catalog

Podsumowanie oferty

We are looking for a Data Engineer with strong experience in the Azure and Databricks ecosystem to develop modern data processing solutions. The role involves working on Data Lake systems, developing data processing workflows, and collaborating within a Scrum team. English proficiency at the C1 level is required, and the contract is on a B2B basis with 100% remote work.

Wymagania

Minimum 2.5 years of experience developing Data Lake.
Minimum 1.5 years of experience working with Azure Databricks.
English language proficiency at C1 level for effective communication.

Nice to have:

Experience with Apache Spark.
Experience with Unity Catalog.
Experience building and maintaining CI/CD pipelines using Azure DevOps, GitHub, or similar.
Experience with Infrastructure as Code (IaC) and configuration management, especially Terraform.
Programming skills in Python.
Experience with SQL.
Experience working in projects using Scrum methodology.
Experience ingesting and processing streaming data from Kafka sources.
Integration with and development of API.
Experience with dbt solutions.
Experience in projects related to the energy sector, especially network operations.
Experience with transmission system operator (TSO) projects.

Certifications (preferred but not required):

Microsoft Certified: Azure Developer Associate
Microsoft Certified: Fabric Data Engineer Associate
Microsoft Certified: Azure Database Administrator Associate
Databricks Certified Associate Developer for Apache Spark
Databricks Certified Data Analyst Associate
Databricks Certified Data Engineer Professional
Databricks Certified Generative AI Engineer
Databricks Certified ML Engineer Professional
Databricks MVP
Microsoft Azure MVP
Microsoft Data Platform MVP
dbt Architect Certification
dbt Analytics Engineering Certification

Obowiązki

Develop and maintain Data Lake solutions.
Work with Azure Databricks to build data processing solutions.
Design, implement, and develop data processing pipelines.
Collaborate with the team using Scrum methodology.
Ensure quality, scalability, and reliability of solutions.

PeopleVibe

95 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz