Data Platform Engineer (Kafka/Streaming)

100 - 120 PLN/ godz./ godz.UoPUmowa o pracę (brutto)

MidFull-time·Umowa o pracę

#412372·Dodano 3 dni temu·0

Źródło: nofluffjobs.com

Tech Stack / Keywords

PythonKafkaSpringGraphQLJava

Minimum 3 years of experience in production environments.
Knowledge of brokers, topics, partitioning, schemas, and replication in Kafka.
Proficient in Kafka Streams and kSQL.
Experience configuring and developing Kafka Connect connectors (ready-made and custom).
Proficiency in Java and Spring framework (Boot, Cloud, Security, Data).
Design of document schemas, indexing, and query optimization.
Implement GraphQL services (Spring GraphQL or other), defining schemas and resolvers.
Basic knowledge of table formats and metadata management.
Knowledge of Java and Python.
Familiarity with Prometheus, Grafana, and OpenTelemetry.
Understanding of TLS, SASL, ACL mechanisms, and encryption principles for data at rest and in transit.
Experience working in Scrum/Kanban and knowledge of Jira and Confluence tools.

Analyze business requirements and interact with analysts and IT teams to understand business processes and data.
Create functional documentation (use cases, user stories) and technical documentation (data diagrams, field mapping).
Design Kafka topics including naming, partitioning, and Avro schemas.
Define collection structures in MongoDB, GraphQL models, and Iceberg tables.
Build microservices with Spring Boot as producers/consumers and for stream processing.
Implement GraphQL layer (schemas, resolvers) exposing data from MongoDB.
Configure and develop Kafka Connect connectors, including custom Single Message Transforms and converters.
Implement metrics with Prometheus and Grafana, logging with Vector and ELK, and tracing with OpenTelemetry and Dynatrace.
Diagnose replication issues, latencies, and data inconsistencies.
Optimize configurations for Kafka, MongoDB, and Iceberg for performance and cost.
Work in Agile teams using Scrum/Kanban with Data Engineers, DevOps, analysts, and testers.
Share knowledge through workshops, documentation, and code reviews.

Opieka zdrowotna

Karta sportowa

SQUARE ONE RESOURCES

192 aktywne oferty