Microsoft Fabric Data Engineer

emagine Polska is hiring to support the delivery of enterprise data and AI capabilities for a client in the utilities industry.

• Minimum 5 years relevant data engineering experience including substantial hands-on experience with Microsoft Fabric.
• Strong Microsoft Fabric data engineering skills including Data Pipelines, Lakehouse, OneLake, and Data Warehouse.
• Strong SQL/T-SQL and PySpark skills.
• Experience with data modelling, dimensional modelling, and supporting Power BI semantic models and Direct Lake.
• Experience with Git, CI/CD, data security, and access controls.
• Experience with data quality, metadata, lineage, monitoring, and production support.
• Experience with performance and capacity optimization of data solutions.
• Strong technical documentation and knowledge-transfer skills.

Desirable:

• Microsoft Certified: Fabric Data Engineer Associate / DP-700.
• Experience with Azure Data Factory, Azure Synapse, and/or Databricks.
• Experience with Kusto Query Language (KQL) and Fabric Real-Time Intelligence.
• Experience with Fabric administration, capacity management, and platform/solution architecture.
• Power BI development experience.
• Experience with data migration, modernisation, and AI/ML data platforms.
• Experience working in regulated, critical infrastructure, or similarly governed environments.

Microsoft Fabric Data Engineering:

• Design, build, test and deploy enterprise data engineering solutions using Microsoft Fabric.
• Develop scalable data ingestion, transformation, and orchestration pipelines.
• Implement Fabric Lakehouse and Data Warehouse solutions.
• Develop notebooks and data transformations using PySpark and SQL.
• Implement robust data loading patterns including full, incremental, and change-based processing.
• Develop reusable data engineering patterns and frameworks.
• Support structured and unstructured data requirements for AI and analytics use cases.
• Implement error handling, monitoring, validation, and recovery mechanisms.

OneLake and Data Architecture:

• Design and implement data solutions using Microsoft OneLake.
• Apply Lakehouse, Warehouse, Delta, and OneLake architecture patterns.
• Develop reusable data products and curated datasets for analytics and AI consumption.
• Implement Bronze, Silver, and Gold data patterns.
• Use OneLake shortcuts, mirroring, and other Fabric capabilities.
• Contribute to enterprise data architecture and Fabric platform design decisions.

Data Modelling and Analytics Enablement:

• Design and implement dimensional and analytical data models.
• Develop fact and dimension structures and semantic layers.
• Support development and optimization of Power BI semantic models.
• Implement and optimize Direct Lake solutions.
• Collaborate with analytics engineers, BI developers, and business stakeholders.
• Support Power BI and Direct Lake enablement.

Data Security and Governance:

• Implement secure data solutions aligned with security and governance standards.
• Apply workspace, item, table, column, and row-level security controls.
• Support OneLake security and Fabric access-control patterns.
• Work with Cyber Security, DPO & Legal, and Architecture teams for data protection.
• Implement data quality, metadata, lineage, and governance requirements.
• Ensure compliance with information governance, privacy, and security requirements.

DevOps and CI/CD:

• Implement source control and CI/CD practices for Fabric solutions.
• Use Git-based development and branching strategies.
• Support automated deployment across environments.
• Implement code review, testing, and release processes.
• Develop automated validation and testing for data pipelines.
• Support deployment pipelines and environment promotion.

Performance and Cost Optimisation:

• Monitor and optimize Fabric workloads and data pipelines.
• Identify and resolve performance bottlenecks in Spark, SQL, Lakehouse, Warehouse, and semantic workloads.
• Optimize data structures, queries, transformations, and pipeline execution.
• Monitor Fabric capacity utilization and identify optimization opportunities.
• Recommend architectural or engineering changes for scalability and cost efficiency.

Production Support and Service Transition:

• Support transition of Fabric solutions into operational service.
• Monitor production data pipelines; investigate incidents and failures.
• Perform root-cause analysis and corrective actions.
• Develop operational documentation, runbooks, and support procedures.
• Ensure monitoring, alerting, and recovery mechanisms.
• Support knowledge transfer to teams and support functions.

Migration and Modernisation:

• Support migration of existing data workloads to Microsoft Fabric.
• Assess existing data platforms and recommend Fabric migration approaches.
• Support migration from Azure Data Factory, Azure Synapse, SQL Server, Databricks, and traditional data warehouses.
• Validate and optimize migrated workloads for Fabric native capabilities.

AI and Data Enablement:

• Provide data engineering capability supporting AI use cases.
• Develop trusted and governed datasets for AI and analytics.
• Support data integration for AI applications and automation.
• Collaborate with AI Engineers, Architects, and Data/Analytics specialists.
• Help establish reusable data patterns for future AI use cases.

Informujemy, że administratorem danych jest emagine z siedzibą w Warszawie, ul.Domaniewskiej 39A (dalej jako "administrator"). Masz prawo do żądania dostępu do swoich danych osobowych, ich sprostowania, usunięcia lub ograniczenia przetwarzania, prawo do wniesienia sprzeciwu wobec przetwarzania, a także prawo do przenoszenia danych oraz wniesienia skargi do organu nadzorczego. Dane osobowe przetwarzane będą w celu realizacji procesu rekrutacji. Podanie danych w zakresie wynikającym z ustawy z dnia 26 czerwca 1974 r. Kodeks pracy jest obowiązkowe. W pozostałym zakresie podanie danych jest dobrowolne. Odmowa podania danych obowiązkowych może skutkować brakiem możliwości przeprowadzenia procesu rekrutacji. Administrator przetwarza dane obowiązkowe na podstawie ciążącego na nim obowiązku prawnego, zaś w zakresie danych dodatkowych podstawą przetwarzania jest zgoda. Dane osobowe będą przetwarzane do czasu zakończenia postępowania rekrutacyjnego i przez okres możliwości dochodzenia ewentualnych roszczeń, a w przypadku wyrażenia zgody na udział w przyszłych postępowaniach rekrutacyjnych - do czasu wycofania tej zgody. Zgoda na przetwarzanie danych osobowych może zostać wycofana w dowolnym momencie. Odbiorcą danych jest serwis Just Join IT oraz inne podmioty, którym powierzyliśmy przetwarzanie danych w związku z rekrutacją.