Kafka Engineer

Upvanta is recruiting a Kafka Engineer for their Data Platform team responsible for developing and maintaining a hybrid Kafka environment combining on-premise infrastructure with AWS.

• Minimum 4 years of experience with Apache Kafka.
• Strong knowledge of Confluent Platform (Enterprise) and Confluent Cloud.
• Experience in hybrid on-premise and AWS environment design and maintenance.
• Practical experience with Kafka cluster data replication tools such as MirrorMaker 2, Cluster Linking, or Confluent Replicator.
• Proficiency with AWS services including VPC, IAM, EC2, EKS, MSK, S3, KMS, and Secrets Manager.
• Experience in Terraform for Infrastructure-as-Code module creation and development.
• Knowledge of Ansible for automation.
• Familiarity with CI/CD tools such as GitHub Actions, GitLab CI, or Jenkins.
• Scripting skills in Python, Bash, or Ansible for automation.
• Experience with Prometheus and Grafana for monitoring.
• Familiarity with Confluent Control Center.
• Knowledge of Kafka security concepts: TLS, SASL, ACL, RBAC, and data encryption.
• Experience automating integration tests for Kafka.
• Understanding of Scrum/Kanban methodologies and tools like Jira and Confluence.

Nice to have:

• Experience with OpenTelemetry or Elastic Stack.

• Develop and maintain a hybrid Kafka environment combining on-premise and AWS infrastructure.
• Manage replication and migration of Kafka clusters using tools like MirrorMaker 2, Cluster Linking, or Confluent Replicator.
• Collaborate with Data Engineering, DevOps, and Security teams.
• Optimize and troubleshoot production environments independently.
• Share knowledge and support less experienced team members.