Data Engineer with MS Fabric (f/m/x)
Brak informacji o wynagrodzeniu
MidFull-time·B2B
#413263·Dodano 2 dni temu·0
Źródło: justjoin.itTech Stack / Keywords
PythonSQLMicrosoft FabricGitPySparkActive DirectoryCI/CDAgile/Scrum methodologies
Firma i stanowisko
Sii is hiring for a long-term data processing and analytics project based in Warsaw, focusing on designing and implementing data pipelines using Microsoft Fabric.
Wymagania
- Minimum 3 years of experience as a Data Engineer in production projects
- Proficiency in Python (PySpark) and SQL for handling large datasets
- Practical experience with cloud data processing platforms such as Microsoft Fabric, Azure Synapse, or Databricks
- Familiarity with layered data architecture (medallion or similar) and Delta/Parquet formats
- Experience working with Git in a team environment
- Ability to integrate diverse sources, including Excel files from business users
- Willingness to sign an NDA and undergo security verification
- Fluent Polish
Nice to have:
- DP-600 or DP-700 certification
- Experience in the finance sector or other highly regulated environments
- Knowledge of R (the model uses Python and R)
- Previous work with CI/CD for data platforms
- Familiarity with data quality frameworks
- Experience with Agile and Scrum methodologies
Obowiązki
- Designing and implementing data pipelines in Data Factory and PySpark notebooks in Microsoft Fabric
- Onboarding file and database sources, including technical validation and format standardization
- Transforming and preparing batch data for analysis
- Implementing data quality validation rules and error reporting mechanisms
- Versioning datasets and recording metadata of the process (parameters, sources, versions)
- Working in a Git environment, managing code repositories, CI/CD deployments, and conducting code reviews
- Collaborating with the Risk Team to establish transformation rules
- Ensuring compliance with data privacy regulations and integrating company security standards into the Azure environment
- Optimizing processes for performance and cost efficiency
Inne informacje
Wyrażam zgodę na przetwarzanie moich danych osobowych zamieszczonych w niniejszym CV przez Sii sp. z o.o. z siedzibą przy Al. Niepodległości 69, 02-626 Warszawa („Sii”) dla celów procesów rekrutacyjnych prowadzonych przez Sii.
Sii
439 aktywnych ofert