B3 CONSULTING POLAND sp. z o.o.

Data Lakehouse Developer

Brak informacji o wynagrodzeniu

SeniorOn-site·WrocławFull-time

#458581·Dodano 11 dni temu·0

Źródło: B3 Consulting Poland

Aplikuj teraz

Tech Stack / Keywords

Python PySparkSpark-SQLMongoDBApache IcebergJenkins Kubernetes Docker Prometheus Grafana

Firma i stanowisko

We are part of an international organization listed on Nasdaq Stockholm, operating in 11 countries. In Poland, we work with full autonomy, choosing technologies, processes, and ways of working independently while maintaining high professional standards. We deliver IT projects in Poland and internationally across multiple domains and technologies to allow consultants to develop aligned with their professional ambitions. Our collaboration is built around the CARE philosophy: responsible project matching, transparent cooperation, and long-term professional growth.

Wymagania

4+ years of hands-on production experience in data engineering.
Strong proficiency in Python, PySpark, Spark-SQL, DataFrames, and Structured Streaming.
Proven experience with MongoDB (Spark Connector, indexing) and Apache Iceberg (table versioning, upserts/merges).
Hands-on background in CI/CD automation (Jenkins) and containerized deployments on Kubernetes.
Requirement to live in Poland and/or be eligible to work there.

Obowiązki

Data Lakehouse & Architecture:

Design and maintain versioned data layers (Bronze, Silver, Gold) using Apache Iceberg, Delta Lake, or Apache Hudi, including CI/CD for schema evolution.

Spark & MongoDB Integration:

Build PySpark/Spark-SQL pipelines for data reconciliation between MongoDB and source systems, optimizing reads using partitioning and match push-down.

Performance & Cost Tuning:

Optimize Spark jobs (AQE, caching, broadcast joins) to lower latency and minimize Data Lakehouse processing costs.

Quality, Monitoring & SLAs:

Implement automated data quality checks, SLA/SLO tracking, and distributed monitoring for batch/streaming pipelines using Prometheus, Grafana, and Dynatrace.

Kubernetes & Automation:

Automate Spark application deployments on Kubernetes using Docker, Spark Operator, and CI/CD pipelines.

Delivery & Collaboration:

Diagnose data discrepancies, maintain technical runbooks, conduct code reviews, and collaborate in Agile teams (Scrum/Kanban).

Benefity

Work in a Scandinavian culture built on logic and dialogue.
Health and sports benefits tailored to individual needs.
Speed Coaching providing new perspectives and solutions.
Sports training, internal team engagement, and competition participation opportunities.
Team events and development-focused meetups.

Inne informacje

You need to live in Poland and/or be eligible to work here.

B3 CONSULTING POLAND sp. z o.o.

59 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz