Senior Data Engineer - Real Time Streams

Globaldev Group is a team of professionals specializing in creating engineering teams for technological businesses across Western Europe, Israel, and the USA. Founded in 2010 in Kharkiv, with offices in Berlin and development hubs in Israel, Ukraine, Portugal, and Poland, the company currently employs around 220 people and focuses on long-term product teams using modern technology stacks.

• 5+ years of professional software/data engineering experience with strong Java expertise.
• Production experience with Apache Flink and stateful real-time streaming pipelines.
• Strong Apache Kafka experience including Kafka Connect, consumer groups, partitions, delivery guarantees, and schema management.
• Hands-on CDC experience using Debezium or Flink CDC.
• Experience designing and operating Kafka → Flink → database/data warehouse pipelines in production.
• Strong understanding of PostgreSQL and experience with at least one analytical database like ClickHouse or BigQuery.
• Experience with Kubernetes and deploying/operating production data workloads.
• Proven troubleshooting and optimization skills for production streaming systems addressing backpressure, checkpoint failures, state growth, latency, lag, and sink performance.
• Strong knowledge of data consistency, idempotency, schema evolution, and observability.
• Ability to independently own a data platform component end-to-end from design through production operation.

Nice to have:

• Experience with TimescaleDB, hypertables, and time-series data.
• Experience with PostGIS and geospatial/spatial query optimization.
• Deep ClickHouse performance tuning including MergeTree and partitioning strategies.
• Strong BigQuery optimization and data modeling skills.
• Experience with Flink Kubernetes Operator and Flink autoscaler tuning.
• Familiarity with ArgoCD, Helm, GKE, Prometheus, and Grafana.
• Experience designing high-throughput, low-latency real-time systems at scale.
• Knowledge of MQTT or IoT/event-driven systems.
• Familiarity with Kafka Schema Registry, Avro, Protobuf, and advanced schema evolution.
• Experience mentoring engineers and leading streaming architecture technical decisions.
• Relevant background in routing, logistics, delivery, mobility, or location-based platforms.

• Designing, implementing, and operating stateful Apache Flink streaming pipelines including keyed state, windowing, watermarks, timers, side outputs, and custom sources/sinks.
• Designing, developing, deploying, and maintaining Change Data Capture (CDC) pipelines using Flink CDC or Debezium with snapshot and incremental handling, schema evolution, and downstream idempotency.
• Building and operating Kafka and Kafka Connect pipelines with topic/partition design, source/sink connectors in distributed mode, schema and converter management, and deadletter routing.
• Owning the full data path from Kafka to Flink to Postgres / TimescaleDB / ClickHouse / BigQuery, including schema design, idempotency, batch tuning, and observability.
• Diagnosing and fixing production issues such as checkpoint failures, backpressure, state growth, sink slowness, autoscaler oscillation, and restart loops.
• Hardening platform reliability including delivery guarantees, watermarks, dead letter queue handling, schema migrations, and alerting coverage.
• Conducting code reviews and mentoring mid-level engineers.
• Contributing to deployment processes using Helm, ArgoCD, GKE, Grafana, and Prometheus.
• Influencing architectural choices such as state backend selection, schema migrations, and pipeline redesigns.