Senior Kafka Developer - CDOT

Senior Kafka Developer - CDOT

Required Nos.: 01

Location: Delhi

Skills, Role & Responsibilities:

• Design, deploy, and manage Kafka clusters to ensure high availability, scalability, and reliability
• Develop and maintain data pipelines using Kafka for real-time data processing and integration
• Monitor and optimize Kafka performance, including tuning brokers, producers, and consumers
• Implement and enforce security measures for Kafka clusters, including access control, encryption, and auditing
• Create and maintain comprehensive documentation for Kafka deployment, configuration, and operational procedures
• Working closely with cross-functional teams to ensure data systems are reliable, scalable, and performant

Requirements:

• Bachelor's degree. (Candidate having graduation/ Post graduation in Engineering/ Science/ Technology in relevant field would be given added advantage)
• Minimum 2-3 years of hands-on experience with Apache Kafka, including setup, configuration, and management of Kafka clusters
• Proficiency in Kafka core concepts, such as producers, consumers, brokers, and zookeeper. Experience with Kafka Connect, Kafka Streams is a plus.
• Strong programming skills in languages such as Java, Python, C or Scala, with experience in building and deploying data-driven applications
• Experience with Kafka monitoring tools (e.g., Confluent Control Center, Prometheus) and performance tuning.
• In-depth knowledge of Kafka security features, including configuring SSL/TLS for encryption, SASL for authentication, ACLs for authorization, and integration with external security tools
• Excellent analytical and troubleshooting skills with a strong focus on reliability and performance.
• Familiarity with other components of the Big Data ecosystem (e.g., Hadoop, Spark) and Steam processing engines (e.g. Flink, Kafka Streams, Kinesis etc) is a plus
• Experience with deployment automation and infrastructure-as-code tools such as Terraform, Ansible, or Kubernetes for managing Kafka deployments and configurations