Senior Data Engineer (Databricks)

Spyrosoft is a software engineering company established in 2016, recognized by the Financial Times among the fastest growing technology companies in Europe in 2021 and 2022. The company specializes in technology solutions for Industry 4.0, automotive, geospatial, healthcare & life sciences, employee experience & education, and financial services industries.

• 5+ years of experience in Data Engineering
• 2+ years of commercial experience with Databricks
• Strong knowledge of PySpark and Spark SQL
• Excellent SQL skills
• Strong Python programming skills
• Experience building ETL/ELT pipelines
• Experience working with Delta Lake
• Good understanding of Medallion Architecture
• Experience with cloud environments (Azure, AWS, or GCP)
• Experience with Git and CI/CD
• Understanding of data modelling principles
• Good communication skills
• Fluent English (C1)

Nice to have:

• Unity Catalog experience
• dbt
• Kafka or Structured Streaming
• Airflow or Databricks Workflows
• Databricks certification
• Experience with performance tuning and cost optimization

• Design, develop and maintain scalable ETL/ELT pipelines
• Build reliable batch and streaming data processing solutions
• Develop data pipelines using Databricks and Apache Spark
• Optimize Spark jobs and improve platform performance
• Work with Delta Lake and Medallion Architecture
• Build and maintain data models for analytics and reporting
• Ensure data quality, monitoring and observability
• Collaborate with Architects, Data Scientists and Analytics teams
• Participate in code reviews and technical improvements
• Contribute to CI/CD processes and engineering best practices