Data Engineer (Apache Flink & Kafka / Confluent Platform)

Brak informacji o wynagrodzeniu
SeniorFull-time
#355226·Dodano dziś·0
Źródło: nofluffjobs.com
Aplikuj teraz

Tech Stack / Keywords

Apache FlinkFlink SQLStateful stream processingFlink KubernetesKafkaConfluent Platform EcosystemAvroSchema RegistryKubernetesStreaming data architecturesAsyncAPIKafka Connect SMTXML-to-AvroGitOpsCI/CD PipelinesAgroCDJenkinsGitHub ActionsAI

Firma i stanowisko

The project is a high-priority initiative in the logistics sector focused on building and extending a real-time data streaming platform using Apache Flink and Kafka/Confluent technologies.


Wymagania

  • Strong commercial experience with Apache Flink, including Flink SQL, Stateful stream processing, and Flink Kubernetes Operator
  • Proven experience with Kafka / Confluent Platform ecosystems
  • Hands-on knowledge of Avro and Schema Registry
  • Practical experience with Kubernetes in production environments
  • Experience in building or maintaining streaming data architectures
  • Strong understanding of distributed systems and event-driven architecture
  • Ability to work independently in a remote delivery model

Nice to have:

  • Experience with AsyncAPI
  • Development of Kafka Connect SMT plugins
  • Experience with XML-to-Avro transformations
  • Knowledge of GitOps and CI/CD pipelines (e.g., ArgoCD, Jenkins, GitHub Actions)
  • Exposure to agentic AI engineering / AI-assisted software delivery practices

Obowiązki

  • Design and implement real-time streaming solutions using Apache Flink (including Flink SQL and Stateful Stream Processing)
  • Develop and maintain data pipelines on Kafka / Confluent Platform
  • Build and integrate Kafka Connect SMTs, including XML-to-Avro transformation logic
  • Implement and maintain Schema Registry integration (Avro-based schemas)
  • Develop Flink-based filtering and projection frameworks for streaming data
  • Contribute to consumer self-service workflows using YAML-based configuration
  • Support deployment and orchestration of streaming components on Kubernetes (including Flink Kubernetes Operator)
  • Collaborate in designing and implementing CI/CD and GitOps-based delivery pipelines
  • Actively participate in an AI-assisted / agentic engineering delivery model

Oferta

  • Sport subscription
  • Private healthcare
Karta sportowa
Opieka zdrowotna
SQUARE ONE RESOURCES

SQUARE ONE RESOURCES

146 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz