EagerDevs

Data Engineer

Brak informacji o wynagrodzeniu

MidZdalnie·WarszawaFull-time

#413633·Dodano dwa miesiące temu·6

Źródło: EagerDevs

Aplikuj teraz

Tech Stack / Keywords

Databricks SQL Apache Spark ETL AWS Azure GCP Python

Podsumowanie oferty

We are looking for a Data Engineer to support the team in designing, building, and optimizing data pipelines, focusing on performance and maintaining clean data architecture. The role involves working with platforms like Databricks and technologies such as SQL and Apache Spark. Collaboration with analytical and business teams is also a key component of the position.

Wymagania

Minimum 3 years of experience as a Data Engineer or similar role.
Very strong knowledge of SQL and experience designing complex data transformations.
Experience with Databricks platform and Apache Spark.
Knowledge of views and materialized views concepts in data warehouses.
Practical knowledge of ETL tools and data modeling principles.
Experience integrating data from various structured and unstructured sources.
Ability to write optimal and efficient code for large data volumes.
Very good command of English (working in an international environment).

Nice to have:

Experience with cloud technologies (AWS, Azure, GCP).
Knowledge of Python and/or Scala in the context of data processing.
Experience with code versioning tools (e.g., Git).

Obowiązki

Designing and developing data pipelines on the Databricks platform.
Implementing data transformations using SQL (views, materialized views).
Creating and optimizing Apache Spark notebooks.
Ensuring high performance and scalability of data processing.
Integrating various data sources, creating data models, and ensuring compliance with business requirements.
Monitoring, maintaining, and optimizing existing ETL solutions.
Collaborating with analytical and business teams to understand data needs.

EagerDevs

31 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz