DevOps Engineer
4000 - 4900 USD/ mies.B2B
MidFull-time·B2B
#451082·Dodano 3 dni temu·8
Źródło: justjoin.itTech Stack / Keywords
KubernetesOpenShiftHelmDockerGitlab CIArgoCDApache SparkApache AirflowLinuxBash
Firma i stanowisko
We are looking for a DevOps Engineer (Kubernetes/OpenShift) to join a Polish IT consulting company and work on a new data platform for one of its enterprise clients. The platform runs on on-premises OpenShift clusters connected to a hybrid cloud environment. The client's data engineering teams will use it to deploy and run their batch, streaming, and orchestration jobs. The platform is built from open-source components, including Apache Spark, Apache Flink, Apache Airflow, and Trino.
Wymagania
- 3+ years hands-on production experience with Kubernetes or OpenShift, including operators, CRDs, networking, and storage
- Experience with on-premises or bare-metal clusters beyond managed services (e.g. EKS, AKS, GKE)
- Ability to write complex Helm charts from scratch
- Experience building and hardening Docker images
- Experience with GitLab CI, designing reusable pipeline templates
- Practical GitOps experience with ArgoCD or Flux
- Experience deploying and operating data tools on Kubernetes, such as Apache Spark (Spark Operator), Apache Airflow, or Trino
- Hands-on experience with authentication and access control in Kubernetes: EntraID (Azure AD), OIDC or LDAP, RBAC, secrets, and TLS certificates
- Good Linux (RHEL) skills including Bash or Python scripting
- Ability to design processes, write documentation, and teach other engineers
- Based in Poland with the right to work and able to travel to Warsaw office biweekly
- Strong English communication skills for daily client interaction
Nice to have:
- Experience with OKDP (Open Kubernetes Data Platform)
- Experience with Apache Flink and the Flink Kubernetes Operator
- Experience with JFrog Artifactory
- Experience with Apache Iceberg, Apache Polaris, or S3-compatible object storage like MinIO or Ceph
- Observability with Prometheus, Grafana, or OpenTelemetry
- CKA, CKAD, CKS, or Red Hat OpenShift certifications (e.g., EX280)
Obowiązki
- Install, configure, and upgrade the data platform on on-premises OpenShift clusters across dev, test, and production
- Integrate new operators and data processing components, such as the Apache Flink Kubernetes Operator
- Design and maintain Helm charts for platform components and ETL workloads
- Build, harden, and publish container images for Spark, Flink, and Airflow
- Integrate the platform with the hybrid cloud environment and EntraID single sign-on, including RBAC and multi-tenancy
- Build reusable GitLab CI templates for building, testing, and releasing ETL workloads
- Automate deployments with Flux and ArgoCD, promoting from dev to production
- Design onboarding process for new teams and ETL workloads including namespaces, quotas, access, secrets, data contract validation, and catalog registration
- Define reference patterns for Spark batch jobs, Flink streaming jobs, Airflow orchestration, and Trino access
- Write documentation, runbooks, onboarding guides, and run workshops for platform users
- Support data engineering teams with troubleshooting and pipeline reviews
- Monitor platform health, plan capacity, and resolve incidents with infrastructure teams
Inne informacje
Based in Poland, with the right to work there, and able to travel to the Warsaw office once every two weeks.
DevsData LLC
20 aktywnych ofert