Data Engineer (m/f/n)
do 20.2k PLNdo 20 160 PLN/ mies.B2B
MidFull-time·B2B
#411161·Dodano 8 dni temu·1
Źródło: Shimi⚠️Uwaga: ta oferta może już nie być aktualna. Sprawdź na stronie pracodawcy, czy rekrutacja jest nadal otwarta.
Tech Stack / Keywords
RedshiftApache AirflowSQLApacheData Warehousing
Firma i stanowisko
SHIMI Sp. z o.o.
Wymagania
- Experience with Amazon S3 and Amazon Redshift.
- Proficient with dbt and Apache Airflow.
- Advanced SQL skills including inner, self, left, right, and full outer joins.
- Knowledge of data warehousing concepts.
- Experience implementing fact and dimension tables.
- Understanding of Type 1 & Type 2 Slowly Changing Dimensions.
- Working knowledge of Kimball Dimensional Modeling.
- Familiarity with Cloudera, MinIO, and Apache Iceberg.
- Experience in ELT/Data Pipeline Development.
Obowiązki
- Develop and maintain ELT pipelines from source systems (Cloudera/MinIO) to Amazon S3 and Amazon Redshift.
- Build and maintain data warehouse layers including Staging, Intermediate, Business View, and Dimensional Models.
- Implement fact tables (Transactional, Accumulating Snapshot, Periodic Snapshot) and Type 1 & Type 2 Slowly Changing Dimensions as per data models.
- Develop data transformations using dbt and orchestrate workflows using Apache Airflow.
- Write, optimize, and troubleshoot SQL queries including inner, self, and outer joins.
- Load, transform, and optimize performance on Amazon Redshift.
- Manage data stored in Amazon S3 and Apache Iceberg tables on the MinIO platform.
- Support migration of data pipelines from Cloudera to MinIO.
- Collaborate with architects, data modelers, and business teams to deliver reliable data solutions.
Benefity
- Contract type: B2B with SHIMI.
- Rate: 120 zł/h netto + VAT.
- Remote work.
- Contract end date: 31.12.2027 with optional extension.
SHIMI sp. z o.o.
62 aktywne oferty