Data Engineer (Databricks)

Cyclad cooperates with top international IT companies delivering cutting-edge technologies. The role is part of a client project focused on building and optimizing modern data platforms using Azure and Databricks.

• Minimum 4 years of experience in Data Engineering
• At least 2 years of hands-on experience with Databricks and Delta Lake in production environments
• At least 2 years developing and maintaining Azure Data Factory (ADF) pipelines
• Very strong Python, Spark SQL, and PySpark programming skills
• Experience with Azure Data Lake Storage Gen2 (ADLS Gen2)
• Knowledge of Medallion architecture and dimensional models
• Experience with REST APIs, batch and streaming ingestion
• Familiarity with GitHub Copilot, CI/CD pipelines, Azure DevOps or similar
• Strong understanding of data quality, performance tuning, and scalability
• Strong understanding of data modeling, ETL/ELT processes, and modern data architecture principles
• Very good English language skills

Nice to have:

• PostgreSQL integration
• Time-series data processing (GPS/parameter data)
• Slowly Changing Dimensions (SCD) patterns
• Spark performance tuning (SLA-driven optimization)
• Adaptive Query Execution (AQE) configuration
• CDC (Change Data Capture) and incremental loading
• SSIS migration patterns

• Build and optimize modern data platforms on Azure and Databricks
• Design, develop, and maintain scalable data pipelines
• Build and optimize data lakehouse solutions supporting analytics, reporting, and regulatory needs
• Implement data ingestion from multiple sources (databases, APIs, files, messaging/event streams)
• Perform data transformation, validation, and quality checks across end-to-end data flows
• Collaborate with Business Analysts and stakeholders to translate requirements into data solutions
• Support production environments, handle incident analysis, and contribute to performance optimization
• Ensure compliance with data governance, security, and regulatory standards

Only candidates with citizenship in the European Union and residence in Poland are eligible.