Addepto

Senior Data Engineer (Spark)

21k - 28.6k PLN21 000 - 28 560 PLN/ mies./ mies.B2BB2B (netto)

SeniorZdalnie·WarszawaFull-time·B2B

#465446·Dodano 12 dni temu·6

Źródło: nofluffjobs.com

Aplikuj teraz

Tech Stack / Keywords

Python SQL Spark Airflow AWS CI/CD Kubernetes KafkaNiFiJava Scala Docker Databricks DevOpsIcebergCloudera

Podsumowanie oferty

As a Senior Data Engineer, you will work on data-platform projects, including a platform processing vehicle data for a global automotive company. The work includes designing and developing data pipelines for streaming and batch processing with Spark, Python, Airflow, and AWS.

Wymagania

At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance, and data management processes.
Strong programming skills in Python (or Java/Scala), including clean code and OOP design.
Hands-on experience with Big Data technologies including Spark, Cloudera, Data Platform, Airflow, Iceberg, Kafka, and CI/CD.
Excellent understanding of dimensional data and data modeling techniques.
Experience implementing and deploying solutions in cloud environments.
Consulting experience, with communication and client management skills and prior direct client interaction as a consultant.
Ability to work independently and take ownership of project deliverables.
Fluent English (at least C1 level).
Bachelor’s degree in technical or mathematical studies.

Obowiązki

Develop and maintain a high-performance data processing platform for automotive data, ensuring scalability and reliability.
Design and implement data pipelines for large volumes of data in streaming and batch modes.
Optimize data workflows for data ingestion, processing, and storage using Spark, Cloudera, and Airflow.
Work with data lake technologies such as Iceberg to manage structured and unstructured data.
Collaborate with cross-functional teams to understand data requirements and integrate data sources.
Monitor and troubleshoot the platform to ensure availability, performance, and accuracy of data processing.
Use AWS cloud services to manage infrastructure and scale processing workloads.
Write and maintain code in Python (or Java/Scala) for data processing and automation.

Benefity

Medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.
Language classes.
Sponsored training and conferences, including access to training materials and certifications through partnerships with Databricks and Anthropic.
Training budget and in-house training.
Team-building events and an integration budget.
Work equipment, including a laptop and other necessary devices.
A dedicated onboarding buddy.
Referral bonus.
Paid leave.
Free coffee.

Opieka zdrowotna

Karta sportowa

Kursy językowe

Dofinansowanie szkoleń

Budżet konferencyjny

Szkolenia wewnętrzne

Spotkania integracyjne

Premie

Płatny urlop

Napoje w biurze

Addepto

56 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz