Data Engineer (Databricks)

Cyclad works with top international IT companies to deliver cutting-edge technologies shaping the future. The position is for a client project focused on building and optimizing modern data platforms on Azure and Databricks. The project is based in Wrocław - Swojczyce with a hybrid work model.

• Minimum 4 years of experience in Data Engineering
• 2+ years of hands-on experience with Databricks and Delta Lake in production
• 2+ years developing and maintaining Azure Data Factory pipelines
• Strong programming skills in Python, PySpark, and Spark SQL
• Experience with Azure Data Lake Storage Gen2
• Knowledge of Medallion architecture and dimensional models
• Experience with REST APIs, batch and streaming ingestion
• Familiarity with GitHub Copilot, CI/CD pipelines, and Azure DevOps or similar tools
• Strong understanding of data quality, performance tuning, scalability, and modern data architecture principles
• Very good English language skills

Nice to have:

• PostgreSQL integration
• Time-series data processing (GPS/parameter data)
• Slowly Changing Dimensions (SCD) patterns
• Spark performance tuning (SLA-driven optimization)
• Adaptive Query Execution (AQE) configuration
• Change Data Capture (CDC) and incremental loading
• SSIS migration patterns

• Build and optimize modern data platforms on Azure and Databricks
• Design, develop, and maintain scalable data pipelines
• Build and optimize data lakehouse solutions supporting analytics, reporting, and regulatory needs
• Implement data ingestion from multiple sources including databases, APIs, files, and event streams
• Perform data transformation, validation, and quality checks across end-to-end data flows
• Collaborate with Business Analysts and stakeholders to translate requirements into data solutions
• Support production environments, handle incident analysis, and contribute to performance optimization
• Ensure compliance with data governance, security, and regulatory standards

Only candidates with citizenship in the European Union and residence in Poland are eligible.