Data Engineer (Microsoft Fabric)

Company: ITFS

• Minimum 5 years experience in a similar role, including at least 3 years as a Data Engineer in production projects
• Very good knowledge of Python (PySpark) and SQL, with experience handling large datasets
• Practical experience with Microsoft Fabric, Azure Synapse, or Databricks
• Knowledge of layered data architecture (medallion or similar) and Delta/Parquet formats
• Experience integrating diverse data sources including Excel files
• Experience working with Git in a team
• Willingness to sign NDA and undergo security verification

Nice to have:

• DP-600 or DP-700 certification
• Experience in the financial sector or other high-audit-demand environments
• Knowledge of R
• Experience with CI/CD for data platforms
• Experience with data quality frameworks
• Experience with Agile and Scrum methodologies

• Designing and implementing pipelines in Data Factory and PySpark notebooks within Microsoft Fabric
• Onboarding and integration of file-based and database sources with technical validation and data standardization
• Transformation and preparation of batch data
• Implementing data quality validation rules and error reporting mechanisms
• Working with Git, CI/CD, code reviews, and versioning datasets and metadata
• Collaborating with the Risk Team to establish transformation rules
• Ensuring compliance with data security and privacy requirements
• Optimizing processes for performance and cost

Candidate must pass security clearance and sign NDA.