EagerDevs

Data Engineer

Brak informacji o wynagrodzeniu

SeniorZdalnie·WarszawaFull-time

#413632·Dodano dwa miesiące temu·50

Źródło: EagerDevs

Aplikuj teraz

Tech Stack / Keywords

ETL Python Scala Spark Hive Airflow Kubernetes Docker

Firma i stanowisko

Data Engineer responsible for designing, building, and maintaining infrastructure, tools, and processes enabling the organization to collect, store, process, and analyze large volumes of data.

Wymagania

Minimum 5 years of experience as a Data Engineer.
Proficiency in Python and Scala programming.
Experience working with Spark and messaging systems.
Knowledge of Hadoop.
Practical experience with Kubernetes.
Strong programming skills and knowledge of software engineering best practices.
Experience with version control systems (preferred Git).
Ability to communicate with clients, identify needs, and propose solutions.

Obowiązki

Develop and maintain ETL and data processing platforms using Python, Scala, Spark, HDFS, and Hive.
Develop applications supporting data access for business users with Airflow, JupyterHub, Trino, Superset, and MLFlow using Kubernetes, Docker, ArgoCD.
Automate CI/CD processes using GitLab-CI.
Monitor platform using Prometheus.
Research, develop, and maintain platform components.
Execute strategic policies related to technologies and work organization.

EagerDevs

31 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz