Data Engineer (Databricks)

In Cyclad we work with top international IT companies focusing on IT Services projects. The client project involves building and optimizing modern data platforms on Azure and Databricks.

• Minimum 4 years of experience in Data Engineering
• 2+ years hands-on experience with Databricks and Delta Lake in production
• 2+ years experience developing and maintaining Azure Data Factory (ADF) pipelines
• Very strong Python, Spark SQL, and PySpark programming skills
• Experience with Azure Data Lake Storage Gen2 (ADLS Gen2)
• Knowledge of Medallion architecture and dimensional models
• Experience with REST APIs, batch, and streaming ingestion
• Familiarity with GitHub Copilot, CI/CD pipelines, and Azure DevOps or similar
• Strong understanding of data quality, performance tuning, and scalability
• Strong understanding of data modeling, ETL/ELT processes, and modern data architecture principles
• Very good English skills

Nice to have:

• PostgreSQL integration
• Time-series data processing (GPS/parameter data)
• Slowly Changing Dimensions (SCD) patterns
• Spark performance tuning (SLA-driven optimization)
• Adaptive Query Execution (AQE) configuration
• CDC (Change Data Capture) and incremental loading
• SSIS migration patterns

• Build and optimize modern data platforms on Azure and Databricks
• Design, develop, and maintain scalable data pipelines
• Build and optimize data lakehouse solutions supporting analytics, reporting, and regulatory needs
• Implement data ingestion from multiple sources (databases, APIs, files, messaging/event streams)
• Perform data transformation, validation, and quality checks across end-to-end data flows
• Collaborate with Business Analysts and stakeholders to translate requirements into data solutions
• Support production environments, handle incident analysis, and contribute to performance optimization
• Ensure compliance with data governance, security, and regulatory standards

Only candidates with citizenship in the European Union and residence in Poland are eligible.