Senior Data Engineer
160 - 170 PLN/ godz.B2B
SeniorInne·B2B
#377601·Dodano dziś·0
Źródło: justjoin.itTech Stack / Keywords
Apache FlinkKafkaKubernetes
Firma i stanowisko
SNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.
Wymagania
- Strong hands-on experience with Apache Flink.
- Expertise in Flink SQL including filtering, payload projections, and joins.
- Experience with Flink Kubernetes Operator and stateful stream processing.
- Strong knowledge of Apache Kafka and Confluent Platform.
- Experience with Kafka Connect administration and connector development.
- Experience developing and managing SMT (Single Message Transform) plugins.
- Knowledge of Confluent Schema Registry and schema governance concepts.
- Experience with Avro schema design and schema evolution.
- Hands-on experience deploying and operating workloads on Kubernetes.
- Knowledge of CI/CD and GitOps deployment approaches.
- Proven experience using AI-assisted development tools across design, development, testing, documentation, and delivery.
Nice to have:
- Experience with Flink Table API.
- Experience designing self-service platform capabilities.
- Background in large-scale event-driven architectures.
Obowiązki
- Design and implement streaming solutions using Apache Flink and Apache Kafka.
- Develop Flink SQL-based capabilities including filtering, payload projections, and topic joins.
- Deploy, configure, and operate Flink workloads using Flink Kubernetes Operator.
- Build and maintain Kafka Connect integrations and transformation logic.
- Develop XML-to-Avro transformation capabilities and custom Kafka Connect SMT plugins.
- Collaborate with internal teams on schema governance and self-service deployment frameworks.
- Support CI/CD and GitOps deployment processes.
- Deliver solutions using AI-assisted engineering practices throughout the software development lifecycle.
- Optimize platform performance, scalability, and operational efficiency.
- Contribute to stream-processing architecture and engineering best practices.
Inne informacje
I consent to processing of my personal data by SNI sp. z o.o. for the purpose of the recruitment process, in accordance with Data Privacy Policy. I also consent to being contacted or the purpose of providing information about future recruitment processes. Your data will be stored only for this purpose for 5 years or until consent is withdrawn.
SNI
26 aktywnych ofert