Senior Kafka Engineer | Confluent & AWS

Upvanta is hiring a Senior Kafka Engineer to join their Data Platform team working on building a modern, hybrid Kafka environment combining on-premise and AWS.

• Minimum 4 years experience with Apache Kafka
• Strong knowledge of Confluent Platform and Confluent Cloud
• Practical experience with MirrorMaker 2, Cluster Linking, or Confluent Replicator
• Experience building or maintaining hybrid on-premise and AWS environments
• Familiarity with AWS VPC, IAM, EC2, EKS, MSK, S3, KMS, and Secrets Manager
• Proficient with Terraform and Infrastructure-as-Code principles
• Experience with CI/CD tools such as GitHub Actions, GitLab CI, or Jenkins
• Knowledge of Python, Bash, or Ansible
• Experience with Prometheus and Grafana monitoring
• Understanding of Kafka security features: TLS, SASL, ACL, RBAC
• Ability to independently troubleshoot and optimize production environments

Nice to have:

• Experience with Kubernetes/EKS
• Familiarity with Schema Registry, Flink, Confluent Control Center, OpenTelemetry, Elastic Stack
• Experience with automation of Kafka integration tests

• Designing and developing hybrid Kafka architecture on-premise and AWS
• Building and configuring Kafka clusters, MSK, and Confluent Cloud environments
• Implementing data replication between clusters using MirrorMaker 2, Cluster Linking, or Replicator
• Configuring Confluent components such as Schema Registry, Flink, Control Center, and Tableflow
• Creating AWS infrastructure with Terraform
• Developing and evolving CI/CD pipelines
• Automating deployments and Kafka integration tests
• Configuring monitoring and observability with Prometheus and Grafana
• Optimizing performance, reliability, and latency of Kafka environments
• Participating in incident resolution and runbook creation
• Collaborating with Data Engineering, DevOps, and Security teams
• Sharing knowledge and mentoring less experienced team members