Python Developer (Data Engineering, AI)
Brak informacji o wynagrodzeniu
MidFull-time
#316488·Dodano miesiąc temu·28
Źródło: emagineTech Stack / Keywords
AIKubernetesSparkETL
Firma i stanowisko
The role focuses on designing, managing, and optimizing scalable data pipelines to support AI-driven services for Nordic clients within a small, remote-first team in the technology industry.
Wymagania
- Strong hands-on experience with on-prem data platforms.
- Proficiency in designing and operating Kubernetes.
- Experience managing distributed data processing frameworks (e.g., Spark).
- Familiarity with Cloudera for storage and data services.
- Ability to deliver end-to-end code in hybrid environments.
Nice to have:
- Hands-on experience with Airbyte.
- Experience with dbt for development & data transformations.
- Familiarity with ETL/ELT orchestration and modern data tooling.
Obowiązki
- Build, maintain, and optimize scalable data pipelines (Kubernetes-based).
- Work with distributed data processing tools (e.g., Spark).
- Design and implement robust data architectures in hybrid/on-prem environments.
- Work with storage technologies including Cloudera and MinIO.
- Deliver end-to-end code across multiple environments.
- Collaborate closely with a small, senior engineering team.
- Participate in building AI-driven data products for Nordic clients.
emagine
201 aktywnych ofert