F/M: Data Engineer
160 - 180 PLN/ godz.B2B
MidFull-time·B2B
#430653·Dodano 17 dni temu·2
Źródło: PeopleVibeTech Stack / Keywords
Apache SparkAPIPythonSQLCI/CDkafkaAzure DatabricksIACData LakeUnity Catalog
Wymagania
- Minimum 2.5 years of experience developing Data Lake.
- Minimum 1.5 years of experience working with Azure Databricks.
- English language proficiency at C1 level for effective communication.
Nice to have:
- Experience with Apache Spark.
- Experience with Unity Catalog.
- Experience building and maintaining CI/CD pipelines using Azure DevOps, GitHub, or similar.
- Experience with Infrastructure as Code (IaC) and configuration management, especially Terraform.
- Programming skills in Python.
- Experience with SQL.
- Experience working in projects using Scrum methodology.
- Experience ingesting and processing streaming data from Kafka sources.
- Integration with and development of API.
- Experience with dbt solutions.
- Experience in projects related to the energy sector, especially network operations.
- Experience with transmission system operator (TSO) projects.
Certifications (preferred but not required):
- Microsoft Certified: Azure Developer Associate
- Microsoft Certified: Fabric Data Engineer Associate
- Microsoft Certified: Azure Database Administrator Associate
- Databricks Certified Associate Developer for Apache Spark
- Databricks Certified Data Analyst Associate
- Databricks Certified Data Engineer Professional
- Databricks Certified Generative AI Engineer
- Databricks Certified ML Engineer Professional
- Databricks MVP
- Microsoft Azure MVP
- Microsoft Data Platform MVP
- dbt Architect Certification
- dbt Analytics Engineering Certification
Obowiązki
- Develop and maintain Data Lake solutions.
- Work with Azure Databricks to build data processing solutions.
- Design, implement, and develop data processing pipelines.
- Collaborate with the team using Scrum methodology.
- Ensure quality, scalability, and reliability of solutions.
PeopleVibe
91 aktywnych ofert