Senior Data Engineer (Databricks)

SpyroSoft S.A. is the employer offering this Senior Data Engineer role, located in Wrocław, Poland.

• 5+ years of experience in Data Engineering
• 2+ years of commercial experience with Databricks
• Strong knowledge of PySpark and Spark SQL
• Excellent SQL skills
• Strong Python programming skills
• Experience building ETL/ELT pipelines
• Experience working with Delta Lake
• Good understanding of Medallion Architecture
• Experience with cloud environments (Azure, AWS, or GCP)
• Experience with Git and CI/CD
• Understanding of data modelling principles
• Good communication skills
• Fluent English (C1)

Nice to have:

• Experience with Unity Catalog
• Experience with Kafka or Structured Streaming
• Experience with Airflow or Databricks Workflows
• Databricks certification
• Experience with performance tuning and cost optimization

• Design, develop and maintain scalable ETL/ELT pipelines
• Build reliable batch and streaming data processing solutions
• Develop data pipelines using Databricks and Apache Spark
• Optimize Spark jobs and improve platform performance
• Work with Delta Lake and Medallion Architecture
• Build and maintain data models for analytics and reporting
• Ensure data quality, monitoring and observability
• Collaborate with Architects, Data Scientists and Analytics teams
• Participate in code reviews and technical improvements
• Contribute to CI/CD processes and engineering best practices