Senior Data Engineer (Azure | Databricks)

1dea is a consulting recruitment company providing IT talent acquisition services for its clients. It has been operating in the Polish market for over 8 years and is gradually expanding its services to Western European markets.

• Minimum 5 years of experience as a Data Engineer focusing on ETL and cloud tools.
• Mandatory certifications: Certified Azure Data Engineer and Databricks Certified Data Engineer.
• Excellent knowledge of Azure Data Factory, Azure Databricks, PySpark, Spark SQL, ADLS, MS Cloud SQL Server.
• Very good knowledge of Python, Java or Scala, and advanced SQL.
• Familiarity with PowerBI, SSIS, and SQL Server Reporting Services.
• Experience with CI/CD in data processes.
• Analytical thinking, good communication skills, and teamwork orientation.
• Proficiency in English for daily work (spoken and written).

• Build and optimize scalable batch and real-time data pipelines.
• Design notebooks, data integration, formats, and Ingestion Framework using Databricks and Azure.
• Migrate and clean data from legacy systems to Data Lake Core.
• Manage databases and SQL including DDL, tables, views in MS SQL Server cloud and query optimization.
• Collaborate with analysts and architects following Agile/Scrum methodologies.
• Automate workflows, perform testing, and ensure Data Governance.
• Prepare technical documentation and prototypes according to business requirements.

Work location is hybrid with 2 days per week in Wrocław. The recruitment process is conducted remotely. CV must be submitted in English.