Addepto

Senior Data Engineer (Databricks)

21k - 28.6k PLN21 000 - 28 560 PLN/ mies./ mies.B2BB2B (netto)

SeniorZdalnie·WarszawaFull-time·B2B

#465896·Dodano 12 dni temu·0

Źródło: justjoin.it

Aplikuj teraz

Tech Stack / Keywords

Airflow Apache KafkaDBTAzure Databricks SQL Python Big Data Apache Spark

Podsumowanie oferty

As a Senior Data Engineer, you will design and build scalable data platforms and processing pipelines for projects across aerospace, energy management, and automotive. You will work with a team of technology experts using Databricks, Apache Airflow, and other data engineering technologies.

Wymagania

At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.
Strong Python programming skills, including clean code and OOP design.
Strong SQL skills, including performance tuning and query optimization, and experience with data warehousing solutions.
Experience designing and implementing data governance and data management processes.
Deep expertise in Big Data technologies, including Databricks, Spark, Kafka, EventHub, Airflow, Dagster, and other modern data orchestration and transformation tools.
Experience implementing and deploying solutions in cloud environments, preferably Azure.
Knowledge of building and deploying Power BI reports and dashboards for data visualization.
Excellent understanding of dimensional data and data modeling techniques.
Consulting experience and the ability to guide clients through architectural decisions, technology selection, and best practices.
Ability to work independently and take ownership of project deliverables.
Master’s or Ph.D. in Computer Science, Big Data, Mathematics, Physics, or a related field.

Obowiązki

Design and optimize scalable data processing pipelines for streaming and batch workloads using Databricks, Apache Airflow, and Dagster.
Architect and implement end-to-end data platforms, ensuring high availability, performance, and reliability.
Lead the development of CI/CD and MLOps processes to automate deployments, monitoring, and model lifecycle management.
Develop and maintain applications for aggregating, processing, and analyzing data from diverse sources.
Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment.
Design and manage complex data transformations using Databricks, DBT, and Apache Airflow, ensuring data integrity and consistency.
Translate business requirements into scalable and efficient technical solutions while ensuring optimal performance and data quality.
Ensure data security, compliance, and governance best practices across data pipelines.

Benefity

Language classes.
Sponsored training and conferences, including access to training materials and certifications through partnerships with Databricks and Anthropic.
Team-building events and an integration budget.
Medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.
Full work equipment, including a laptop and other necessary devices.

Kursy językowe

Budżet konferencyjny

Dofinansowanie szkoleń

Spotkania integracyjne

Opieka zdrowotna

Karta sportowa

Addepto

56 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz