Databricks Architect (Data Engineering)
140 - 190 PLN/ godz.
SeniorFull-time
#384790·Dodano wczoraj·0
Źródło: SpyrosoftTech Stack / Keywords
DatabricksArchitectureETLUnitySecurityCloudCI/CDApache Spark
Firma i stanowisko
SpyroSoft S.A.
Wymagania
- 7+ years of experience in Data Engineering
- 3+ years of hands-on experience with Databricks
- Strong expertise in Apache Spark (PySpark and/or Spark SQL)
- Excellent knowledge of Delta Lake and Lakehouse Architecture
- Experience designing enterprise-scale data platforms
- Strong understanding of Medallion Architecture
- Experience with Unity Catalog and data governance
- Experience with cloud platforms (Azure, AWS, or GCP)
- Knowledge of orchestration tools (Azure Data Factory, Airflow, Databricks Workflows or similar)
- Experience with CI/CD pipelines and Git-based development
- Strong SQL and Python skills
- Excellent communication and stakeholder management skills
- Fluent English
Nice to have:
- Databricks certifications
- Experience with dbt
- Experience with Kafka or other streaming technologies
- Terraform or other Infrastructure as Code tools
- Experience designing AI/ML-ready data platforms
Obowiązki
- Design end-to-end Data Lakehouse architectures based on Databricks
- Define data platform architecture, integration patterns, and governance standards
- Lead architecture decisions around ETL/ELT, batch, and streaming data processing
- Design scalable solutions using Delta Lake, Unity Catalog, and Medallion Architecture
- Collaborate with Data Engineers, Data Scientists, Architects, and business stakeholders
- Define security, data governance, and access management strategies
- Optimize platform performance and cloud costs
- Support CI/CD implementation and Infrastructure as Code practices
- Review solution designs and mentor engineering teams
- Drive adoption of modern Data Engineering best practices
Spyrosoft
153 aktywne oferty