Senior Data Engineer (f/m/x)
Brak informacji o wynagrodzeniu
SeniorFull-time·B2B
#436787·Dodano 16 dni temu·0
Źródło: justjoin.itTech Stack / Keywords
DatabricksApache SparkData Built ToolSnowflakePythonDelta LakeApache IcebergHDFS (Hadoop Distributed File System)Great ExpectationsDeequ
Firma i stanowisko
Sii is hiring an experienced Data Engineer to join a data engineering team in a dynamic environment where data is the main product. The team is responsible for developing and maintaining data pipelines on the Azure platform using Databricks, supporting all key business functions. The role involves collaborating with engineers, data analysts, and product owners to deliver comprehensive solutions from data acquisition to delivery to the end client.
Wymagania
- Minimum 8 years of experience in data engineering
- Strong knowledge of Apache Spark, Databricks, Snowflake, dbt, and Python
- Previous experience designing solutions based on Delta Lake, Apache Iceberg, HDFS or related data storage technologies
- Ability to lead complex data engineering projects independently and collaborate with business stakeholders
- Experience in technical leadership and mentoring team members
- Very good command of English at C1 level
- Willingness to visit the office in Kraków once a month
Nice to have:
- Experience working with financial data or ETF products
- Knowledge of Data Modeling, Great Expectations, or Deequ
Obowiązki
- Design and develop advanced data pipelines in the Azure Databricks environment
- Create scalable data architecture using lakehouse technologies
- Define standards and best practices in Data Engineering
- Collaborate with Data Analytics, Data Science, and Product teams to deliver comprehensive solutions
- Mentor and provide technical support to less experienced engineers
- Optimize performance, reliability, security, and cost efficiency of the data platform
Inne informacje
Consent for personal data processing by Sii sp. z o.o. located in Warsaw for recruitment purposes.
Sii
409 aktywnych ofert