Link Group

Senior Data Engineer – Python, Spark, AWS

35k - 40k PLN35 000 - 40 000 PLN/ mies./ mies.

SeniorOn-site·WarszawaFull-time

#265563·Dodano 22.05.2025·13

Źródło: LinkGroup

Aplikuj teraz

Tech Stack / Keywords

Python Spark AWS Databricks UnityArchitectureCloudPySpark

Firma i stanowisko

LinkGroup is hiring a Senior Data Engineer to join their team working on a scalable, multitenant data platform that supports data ingestion, transformation, cataloging, and distribution. The platform is built on AWS and integrates modern data lakehouse components.

Wymagania

5+ years of experience in Python and strong software engineering skills
Solid knowledge of AWS cloud services and best practices
Experience building scalable Spark pipelines in PySpark or Scala
Practical experience with Spark Streaming for low-latency pipelines
Familiarity with Delta Lake and modern data lakehouse architectures
Hands-on experience with Kubernetes and container orchestration
Experience with MongoDB and other NoSQL data stores
Understanding of microservices and event-driven architecture
Excellent communication skills and ability to work in a collaborative, global team
Commitment to high standards of ethics, quality, and delivery

Nice to have:

Familiarity with Machine Learning, AI models, or Data Science workflows

Obowiązki

Design and build scalable data ingestion pipelines in AWS
Work extensively with Databricks, including Unity Catalog, streaming, Delta Lake, and data transformation tools
Lead technical delivery and implementation of core platform components across raw, normalized, operational, and historical layers
Collaborate with engineering managers and cross-functional teams across the US and Poland
Drive technical excellence by improving team processes, architecture standards, and engineering best practices
Support and consult with stakeholders to ensure successful delivery of data-driven solutions
Contribute to the growth and maturity of the team’s cloud and data engineering capabilities

Link Group

556 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz