Databricks Data Engineer/Architect

140 - 180 PLN/ godz.B2B (netto)
SeniorFull-time·B2B
#341004·Dodano dziś·0
Źródło: nofluffjobs.com
Aplikuj teraz

Tech Stack / Keywords

Data engineeringBig dataDatabricksData pipelinesUNITYPythonSQLETLData LakeData warehousesPublic cloudAWSGCPStorageKanban

Firma i stanowisko

Spyrosoft is an authentic, cutting-edge software engineering company, established in 2016. In 2021 and 2022, it was among the fastest growing technology companies in Europe, according to the Financial Times. Founded by a group of tech experts with established backgrounds in software engineering, it created an ‘engineer-to-engineer’ workplace. The company specializes in technology solutions for industry 4.0, automotive, geospatial, healthcare & life sciences, employee experience & education, and financial services industries.


Wymagania

  • At least 8 years in Data Engineering, with a minimum of 2 years specifically in Big Data environments.
  • 4+ years of hands-on experience with Databricks services, including data pipelines and Unity Catalog.
  • Expert-level skills in Python and SQL.
  • Strong background in Data Warehousing, ETL, and distributed data processing.
  • Deep understanding of Data Lakes, Data Warehouses, and Data Mesh concepts.
  • Experience with at least one public cloud (Azure, AWS, or GCP) and strong design skills for both relational and non-relational storage.
  • Analytical mindset capable of troubleshooting complex issues in a big data landscape.
  • Very good verbal and written English B2/C1.
  • Experience working in Agile (Scrum/Kanban) environments.

Obowiązki

  • Design and maintain robust data pipelines and distributed data processing systems using Databricks.
  • Implement and manage data governance and security frameworks via Unity Catalog.
  • Develop sophisticated data models (Relational and Non-Relational) to support complex analytical requirements.
  • Improve the performance and reliability of Big Data workflows and ETL processes.
  • Work within an Agile environment, integrating DevOps and CI/CD principles into the data lifecycle.
  • Act as a subject matter expert, guiding the team through complex big data challenges and architectural decisions.
Spyrosoft

Spyrosoft

117 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz