Sii
Sii
New

Data Engineer with MS Fabric (f/m/x)

Brak informacji o wynagrodzeniu
MidFull-time·B2B
#413263·Dodano 2 dni temu·0
Źródło: justjoin.it
Aplikuj teraz

Tech Stack / Keywords

PythonSQLMicrosoft FabricGitPySparkActive DirectoryCI/CDAgile/Scrum methodologies

Firma i stanowisko

Sii is hiring for a long-term data processing and analytics project based in Warsaw, focusing on designing and implementing data pipelines using Microsoft Fabric.

Wymagania

  • Minimum 3 years of experience as a Data Engineer in production projects
  • Proficiency in Python (PySpark) and SQL for handling large datasets
  • Practical experience with cloud data processing platforms such as Microsoft Fabric, Azure Synapse, or Databricks
  • Familiarity with layered data architecture (medallion or similar) and Delta/Parquet formats
  • Experience working with Git in a team environment
  • Ability to integrate diverse sources, including Excel files from business users
  • Willingness to sign an NDA and undergo security verification
  • Fluent Polish

Nice to have:

  • DP-600 or DP-700 certification
  • Experience in the finance sector or other highly regulated environments
  • Knowledge of R (the model uses Python and R)
  • Previous work with CI/CD for data platforms
  • Familiarity with data quality frameworks
  • Experience with Agile and Scrum methodologies

Obowiązki

  • Designing and implementing data pipelines in Data Factory and PySpark notebooks in Microsoft Fabric
  • Onboarding file and database sources, including technical validation and format standardization
  • Transforming and preparing batch data for analysis
  • Implementing data quality validation rules and error reporting mechanisms
  • Versioning datasets and recording metadata of the process (parameters, sources, versions)
  • Working in a Git environment, managing code repositories, CI/CD deployments, and conducting code reviews
  • Collaborating with the Risk Team to establish transformation rules
  • Ensuring compliance with data privacy regulations and integrating company security standards into the Azure environment
  • Optimizing processes for performance and cost efficiency

Inne informacje

Wyrażam zgodę na przetwarzanie moich danych osobowych zamieszczonych w niniejszym CV przez Sii sp. z o.o. z siedzibą przy Al. Niepodległości 69, 02-626 Warszawa („Sii”) dla celów procesów rekrutacyjnych prowadzonych przez Sii.

Sii

Sii

439 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz