Data Engineer (Databricks)

Cyclad is an international consulting company specializing in IT/ICT sectors, delivering outsourcing services in HR and IT. They serve diverse industries including Banking, Aviation, Travel, Cybersecurity, and BPO, tailoring solutions to each sector's needs.

• Minimum 4 years of Data Engineering experience.
• At least 2 years of production experience with Databricks and Delta Lake.
• At least 2 years building and maintaining Azure Data Factory pipelines.
• Strong skills in Python, Spark SQL, and PySpark.
• Experience with Azure Data Lake Storage Gen2, Medallion architecture, and dimensional models.
• Familiarity with REST APIs, batch and streaming ingestion.
• Knowledge of GitHub Copilot, CI/CD, Azure DevOps, or similar tools.
• Strong understanding of data quality, performance optimization, scalability, data modeling, ETL, ELT, and modern data architecture principles.
• Very good English language skills.
• EU citizenship and residence in Poland required.

Nice to have:

• PostgreSQL integration.
• Experience with time series processing (GPS and parameter data) and Slowly Changing Dimensions.
• Skills in Spark performance tuning and Adaptive Query Execution.
• Knowledge of Change Data Capture, incremental loading, and SSIS migration patterns.

• Build and optimize Azure and Databricks data platforms, lakehouses, and analytics solutions.
• Design and maintain scalable data pipelines ingesting from databases, APIs, files, and event streams.
• Transform, validate, and quality check end-to-end data flows.
• Collaborate with Business Analysts and stakeholders to translate requirements into data solutions.
• Support production environments, analyze incidents, optimize performance.
• Follow governance, security, and regulatory standards.
• Work hybrid with 2 office days per week in Wrocław Swojczyce.
• Participate in a project lasting until end of 2026 with possible extension.

European Union citizenship and residence in Poland are required for this role.