Data Engineer - Senior

Brak informacji o wynagrodzeniu

SeniorZdalnie·WarszawaFull-time

#472699·Dodano 2 dni temu·3

Źródło: SOFTSWISS

Aplikuj teraz

Tech Stack / Keywords

Apache Spark KafkaDelta LakeScala Java PythonSpark StreamingKafka StreamsPrometheus Grafana

Podsumowanie oferty

Join the Data Platform team to build data infrastructure that powers analytics and insights across SOFTSWISS. Build business-critical data products and pipelines using Apache Spark, Kafka and Delta Lake.

Wymagania

5+ years of software engineering experience with expertise in development, deployment and integration.
Proficiency in at least one high-level programming language: Scala, Java, Python or equivalent.
Experience with data environments such as data lakes, data warehouses and data marts, data transformation concepts, and large data volumes.
Experience building ETL pipelines for feature engineering on large-scale datasets using Apache Spark and Delta Lake.
Experience sourcing and modelling data from application APIs.
Experience building stream-processing applications using Spark Streaming, Kafka Streams or other tools.
Experience designing and implementing monitoring, alerting and observability solutions for data pipelines using Prometheus, Grafana, Alertmanager or other tools.
Strong analytical and problem-solving skills.
Upper-intermediate proficiency in English and strong command of Russian.

Nice to have:

Experience with workflow orchestration tools such as Apache Airflow.
Experience with Kubernetes and containerization.
Familiarity with cloud platforms (AWS, GCP, Azure, OCI).
Familiarity with CDC and Debezium.
Familiarity with ClickHouse.
Familiarity with data quality validation frameworks for data pipelines.
Familiarity with data lineage.
Familiarity with low-latency NoSQL datastores such as HBase, Cassandra and MongoDB, relational databases such as MySQL and Postgres, and search systems such as Elasticsearch and Solr.
Master’s, PhD or equivalent experience in Software Engineering, Mathematics or Computer Science.

Obowiązki

Build business-critical, robust and self-service data products using Apache Spark, Kafka, Delta Lake and other big data technologies.
Ensure pipeline performance and data quality through scalable architecture and optimization.
Refine data solutions as business requirements and technical constraints evolve.
Collaborate with teams to understand data needs and support adoption of data products across the company.

Benefity

Private health insurance.
Sports benefits.
Comprehensive Mental Health Program.
Free online English lessons.
Local language courses.
Paid time off.
Maternity leave support.
Referral program rewards.
Upskilling, internal workshops, and participation in professional conferences and corporate events.

Opieka zdrowotna

Karta sportowa

Kursy językowe

Płatne święta

Szkolenia wewnętrzne

Spotkania integracyjne

Inne informacje

Applicants must be located in Poland.

SOFTSWISS

22 aktywne oferty

Zobacz wszystkie oferty

Aplikuj teraz