Like Minded People
Work Together

Back to Career

Kafka Lead

Location: Hyderabad

Work Experience: 8–12 years

Requirements:

  • Hands-on experience in software development/middleware.
  • Strong hands-on expertise in Apache Kafka.
  • Experience with Kafka Streams, Kafka Connect, and Schema Registry.
  • Strong programming experience in Java / Scala / Python.
  • Good understanding of distributed systems and event-driven architecture.
  • Experience with Zookeeper / KRaft architecture.
  • Hands-on experience in performance tuning and cluster optimization.
  • Knowledge of message serialization frameworks (Avro, Protobuf, JSON).
  • Experience with monitoring tools like Prometheus, Grafana, and ELK.
  • Familiarity with Linux, Shell scripting, CI/CD pipelines.
  • Experience with cloud platforms (AWS / Azure / GCP) is a plus.
  • Experience with Confluent Kafka Platform.
  • Knowledge of microservices architecture.
  • Exposure to Docker / Kubernetes.
  • Strong problem-solving and leadership skills.
  • Excellent communication and stakeholder management skills.

Qualifications: Bachelor’s degree in Computer Science, Engineering, or a related field.

Job Description:

  • Design, develop, and maintain Kafka-based real-time data streaming solutions.
  • Lead architecture discussions and provide technical guidance to the team.
  • Configure, deploy, monitor, and optimize Apache Kafka clusters.
  • Develop and manage Kafka producers, consumers, brokers, topics, partitions, and replication.
  • Ensure high availability, fault tolerance, and scalability of Kafka infrastructure.
  • Troubleshoot and resolve Kafka performance and operational issues.
  • Integrate Kafka with distributed systems, databases, and cloud platforms.
  • Implement security, monitoring, alerting, and disaster recovery for Kafka environments.
  • Collaborate with cross-functional teams, including developers, architects, and DevOps.
  • Review code, enforce best practices, and mentor junior team members.