DS STREAM

Senior Data Engineer

150 - 180 PLN/ godz./ godz.B2BB2B (netto)

SeniorZdalnie·WarszawaFull-time·B2B

#374312·Dodano 4 miesiące temu·7

Źródło: nofluffjobs.com

Aplikuj teraz

Tech Stack / Keywords

Python Docker SQL Databricks PySpark CI/CD GCP Airflow BigQueryAPIFastAPI Azure Databricks Azure AWS Kubernetes

Firma i stanowisko

DS STREAM is expanding its AI Data Engineering Team, focusing on a mature, high-availability data hub built within Azure Databricks using Unity Catalog, Spark Structured Streaming, and Asset Bundles. The project employs the Medallion Architecture framework to provide a scalable foundation for ingesting, transforming, and integrating new data sources into the existing ecosystem.

Wymagania

At least 5 years of commercial experience in Data Engineering with a focus on large-scale data pipelines
Proven experience with advanced solutions in Azure cloud and Databricks
Previous exposure to GCP infrastructure and tools such as Airflow, Pub/Sub, BigQuery, VertexAI
Knowledge of Spark Structured Streaming
Proficiency in Python and SQL
Ability to build pipelines using GitHub or similar tools

Nice to have:

Ability to build enterprise API integrations with FastAPI or similar
Experience in leading or mentoring engineers

Obowiązki

Develop programs for processing large volumes of data
Ingest data from APIs
Develop Databricks pipelines using PySpark and SQL
Handle Spark Structured Streaming pipelines
Design and manage objects in Unity Catalog according to Medallion Architecture
Use Agile and Scrum methodologies

Benefity

100% remote work with the possibility to use an office in Warsaw
Flexible working hours
Engaging company events
Access to Azure, GCP, and Databricks certifications
Possibility to use an in-house incubator to develop personal ventures
Supportive community of 50+ senior data consultants experienced in Data Warehouse and Big Data
Sport subscription
Training budget
Private healthcare
Free coffee and beverages
Bike parking
In-house trainings and hack days
Modern office environment
Flat organizational structure
Small teams
International projects
Startup atmosphere
No dress code

Elastyczne godziny

Karta sportowa

Dofinansowanie szkoleń

Opieka zdrowotna

Napoje w biurze

Darmowe przekąski

Parking dla rowerów

Szkolenia wewnętrzne

Spotkania integracyjne

Inne informacje

This is a 100% remote role within Poland only.

DS STREAM

5 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz