Senior DataOps Engineer
~150 - 170 PLN/ godz.B2B
SeniorFull-time·B2B
#431223·Dodano 4 dni temu·2
Źródło: nofluffjobs.comTech Stack / Keywords
PythonETLKubernetes
Wymagania
- 4+ years of experience in Data Engineering in a similar role
- Very good knowledge of Spark, Scala, and Python
- Experience building and maintaining complex ETL pipelines
- Experience with large datasets
- Practical knowledge of cloud solutions
- Experience with orchestration tools such as Airflow
- Practical experience with Kubernetes and GKE (Google Kubernetes Engine)
- Experience maintaining and operating production data infrastructure on GKE
- Experience with CI/CD tools like Jenkins and Git
- Strong understanding of software engineering principles
- Independence, ownership, and very good communication skills
- Advanced proficiency in English
Obowiązki
- Maintain and develop pipelines ingesting billions of events daily within defined SLA
- Develop tools and frameworks for the data platform
- Support teams building and optimizing complex data pipelines
- Identify and resolve platform issues collaboratively with engineering teams
- Support Data Scientists and Data Analysts in production workloads
- Participate in ML Platform and streaming initiatives
- Develop best practices in software engineering and data development
Arche Solutions
13 aktywnych ofert