Kafka Engineer

YourITeams is an IT service provider founded in 2022 with 51-200 employees, operating as an agency.

• Minimum 4 years hands-on experience with Apache Kafka.
• Strong expertise with Confluent Platform (Enterprise) and Confluent Cloud.
• Experience with cluster migration and replication technologies: MirrorMaker 2, Cluster Linking, and Confluent Replicator.
• Practical experience with AWS services: VPC, IAM, EC2, EKS, MSK, S3, KMS, and Secrets Manager.
• Skilled in designing and maintaining hybrid on-premises and cloud environments.
• Preferred experience with Terraform, including module development and testing.
• Familiarity with CI/CD platforms such as GitHub Actions, GitLab CI, or Jenkins.
• Proficiency in automation scripting with Python, Ansible, and Bash.
• Hands-on experience with monitoring and observability tooling mentioned.
• Strong understanding of security concepts for messaging platforms.
• Experience working in Agile teams using Scrum and/or Kanban, and tools like Jira and Confluence.

• Design, deploy and support Kafka-based solutions on AWS including MSK, EKS, and Aurora.
• Implement and maintain data replication between on-premises and AWS Kafka clusters using MirrorMaker 2, Cluster Linking, and Confluent Replicator.
• Create and operate CI/CD pipelines and Infrastructure as Code practices.
• Lead cluster migrations and replication projects ensuring data integrity and performance.
• Develop automation for Kafka integration tests and continuous validation of deployments.
• Implement and maintain monitoring and observability for Kafka using Prometheus, Grafana, Confluent Control Center, OpenTelemetry, and the Elastic Stack.
• Apply security best practices for Kafka and cloud services, including TLS, SASL, ACLs, RBAC, and encryption.
• Collaborate with cross-functional teams using Agile methodologies, contributing to design reviews, runbooks, and incident response.