Databricks Architect (Data Engineering)

Spyrosoft is a software engineering company established in 2016, recognized as one of the fastest growing technology companies in Europe in 2021 and 2022 by the Financial Times. The company bridges technology and business, specializing in solutions for industry 4.0, automotive, geospatial, healthcare & life sciences, employee experience & education, and financial services industries.

• 7+ years of experience in Data Engineering
• 3+ years of hands-on experience with Databricks
• Strong expertise in Apache Spark (PySpark and/or Spark SQL)
• Excellent knowledge of Delta Lake and Lakehouse Architecture
• Experience designing enterprise-scale data platforms
• Strong understanding of Medallion Architecture
• Experience with Unity Catalog and data governance
• Experience with cloud platforms (Azure, AWS, or GCP)
• Knowledge of orchestration tools (Azure Data Factory, Airflow, Databricks Workflows or similar)
• Experience with CI/CD pipelines and Git-based development
• Strong SQL and Python skills
• Excellent communication and stakeholder management skills

Nice to have:

• Databricks certifications
• Experience with dbt
• Experience with Kafka or other streaming technologies
• Terraform or other Infrastructure as Code tools
• Experience designing AI/ML-ready data platforms

• Design end-to-end Data Lakehouse architectures based on Databricks
• Define data platform architecture, integration patterns, and governance standards
• Lead architecture decisions around ETL/ELT, batch and streaming data processing
• Design scalable solutions using Delta Lake, Unity Catalog, and Medallion Architecture
• Collaborate with Data Engineers, Data Scientists, Architects, and business stakeholders
• Define security, data governance, and access management strategies
• Optimize platform performance and cloud costs
• Support CI/CD implementation and Infrastructure as Code practices
• Review solution designs and mentor engineering teams
• Drive adoption of modern Data Engineering best practices