Data Engineer (Azure Databricks)

We are looking for an experienced Data Engineer with strong PySpark skills to join a large-scale Azure data platform project. You will work in a distributed environment, focusing on building and optimizing data pipelines.

• 5+ years of experience in Data Engineering
• Strong hands-on experience with PySpark (DataFrames, optimization techniques), Databricks, and SQL
• Experience with Azure services: Data Factory, Azure SQL, and Storage
• Knowledge of cloud environments, preferably Azure
• Strong problem-solving skills and ability to work independently
• Good communication skills in English (B2+)

Nice to have:

• Power BI
• Azure certifications (AZ-900 or similar)
• Databricks certification

• Develop and maintain data pipelines using PySpark and SQL
• Work with Azure Databricks for large-scale data processing
• Build and maintain ingestion and data transformation workflows
• Perform data wrangling and integrate multiple data sources
• Optimize Spark jobs (DataFrames, partitioning, clustering, SparkSQL)
• Work with data formats such as Delta, Parquet, and CSV
• Collaborate with stakeholders across multiple time zones
• Create and maintain technical documentation