Senior Data Engineer (Azure/Databricks)

Diverse CG Sp. z o.o. Sp.k. is a recruitment company focused on providing experienced professionals and continuous support to its partners through a management style and partnership approach. The company is engaged in numerous recruitment projects and is currently expanding its team.

• Minimum 5 years of experience in IT, including at least 3.5 years of commercial experience working with data in the cloud on production-grade projects
• Strong expertise in Azure Cloud data services: Azure Data Factory, Azure Data Lake, Azure SQL Server, Azure Synapse Analytics, and Power BI
• Strong experience with Azure Databricks, focusing on Delta Lake, Delta Live Tables, and Unity Catalog
• Experience designing architectures such as Data Lake, Delta Lake, Data Lakehouse, DWH, and Data Marts
• Knowledge of CI/CD, Azure DevOps, and Git
• Hands-on experience with on-premise to cloud migrations of various types
• Understanding of secure data storage and processing in cloud environments
• Ability to work effectively in a low-process, rapidly changing environment
• English proficiency at minimum B2+ level for daily work in an international environment

Nice to have:

• Assertive, proactive, and communicative
• Comfortable working in a "controlled chaos" environment
• Able to clearly communicate issues and blockers
• Does not rely on fully defined processes or complete documentation

• Design, development, and maintenance of data platform solutions in Azure cloud
• Working with large-scale datasets using Azure Databricks, including the latest platform features
• Building and evolving data architecture such as Data Lake, Delta Lake, Lakehouse, DWH, and Data Marts
• Implementation and maintenance of data pipelines (ETL/ELT) in Azure Data Factory and Databricks
• Designing and modifying data models aligned with business needs
• Supporting data and solution migrations from on-premise to cloud
• Ensuring data security and compliance with regulatory and cloud best practices
• Collaboration with technical and business stakeholders in a fast-changing environment
• Proactively identifying risks, communicating blockers, and proposing solutions
• Working with code repositories and CI/CD processes