Mid/Senior Data Engineer Microsoft Fabric [K/M]

Fabrity S.A. is a dynamic technology company specializing in software engineering, generative artificial intelligence, and industrial Internet of Things (IoT). The company creates comprehensive solutions to help enterprises automate processes, increase operational efficiency, and make critical decisions through effective data analysis. They work with leading platforms such as ServiceNow, Microsoft Power Platform, and their proprietary low-code product Fastive. Fabrity supports organizations across various industries including pharmaceuticals, healthcare, financial services, manufacturing, automotive, and retail, with clients like ABB, Bayer, Carrefour, PKO BP, Dormakaba, Sanofi, Toyota Bank, Frontex, Liebherr, Pepsico, and Saint-Gobain.

• Minimum 3 years of experience as a Data Engineer.
• Strong knowledge of Python (including PySpark) and SQL.
• Experience with Microsoft Fabric, Azure Synapse Analytics, or Databricks.
• Familiarity with data architectures such as Medallion Architecture or similar.
• Experience with data formats like Delta Lake and Parquet.
• Practical knowledge of Git.
• Experience integrating data from multiple sources.
• Experience processing data from files and databases.
• Understanding of security principles and data protection.

Nice to have:

• Certification DP-600 or DP-700.
• Knowledge of the R programming language.
• Experience in the financial sector.
• Experience with CI/CD for data platforms.
• Knowledge of Data Quality tools.
• Experience working in Agile/Scrum environments.

• Design and develop data pipelines utilizing Microsoft Fabric and Azure Data Factory.
• Create and maintain PySpark notebooks responsible for data processing and transformation.
• Integrate and onboard new data sources, including file and database sources.
• Prepare and develop ETL/ELT processes and batch data processing.
• Implement data quality validation mechanisms and error reporting.
• Manage metadata, data versioning, and process tracking.
• Work with Git repositories and participate in CI/CD processes.
• Collaborate with business teams to define data processing rules.
• Ensure compliance with security requirements and data protection regulations.
• Optimize processes for performance and cloud environment cost efficiency.

Klauzula informacyjna dotycząca przetwarzania danych osobowych zgodnie z przepisami RODO, w tym zakresu, celów, praw osób, których dane dotyczą oraz okresu przechowywania danych, udostępniania danych podmiotom współpracującym oraz zasad podania danych i wycofania zgody.