Kafka Administrator

We have a job opening for Kafka Admin with our client at Mumbai or Pune.

Position: Kafka Admin

Location: Mumbai or Pune

Experience: 5 + years

Client: A Swiss Bank

Payroll Company: IND Velloni

Job Summary:

We are seeking an experienced Apache Kafka Engineer to join our team. The ideal candidate will have a strong background in distributed systems and a deep understanding of Apache Kafka to design, implement, and manage scalable data streaming solutions. As a Kafka Engineer, you will be responsible for building and maintaining Kafka-based messaging systems, ensuring high availability and performance, and integrating Kafka with various data processing applications.

Key Responsibilities:

• Design and Implementation:

• Design and implement Kafka-based messaging systems to support real-time data streaming and processing.
• Develop and deploy Kafka producers and consumers for various data sources and sinks.

• System Maintenance and Optimization:

• Monitor Kafka clusters to ensure optimal performance and availability.
• Troubleshoot and resolve issues related to Kafka brokers, topics, and data flow.
• Optimize Kafka configurations for performance, scalability, and fault tolerance.

• Integration and Development:
• Integrate Kafka with other data systems such as databases, data lakes, and big data platforms.
• Develop and maintain data pipelines using Kafka Streams, Kafka Connect, or other related technologies.

• Collaboration and Support:

• Work closely with data engineers, software developers, and system administrators to ensure seamless integration of Kafka with applications.
• Provide technical support and guidance to teams using Kafka for data streaming.

• Documentation and Best Practices:

• Document Kafka architecture, configurations, and processes.
• Promote and enforce best practices for Kafka usage and data streaming.

Experience:

• Proven experience with Apache Kafka in a production environment.
• Strong understanding of Kafka architecture, including brokers, topics, partitions, and replication.
• Experience with Kafka Streams, Kafka Connect, and schema registries is highly desirable.
• Knowledge of distributed systems and data streaming principles.

• Skills:

• Proficiency in Java, Scala, or Python for Kafka development and integration.
• Experience with cloud platforms (AWS, Azure, GCP) and their Kafka-related services.
• Familiarity with monitoring and logging tools (e.g., Prometheus, Grafana, ELK Stack).

Soft Skills:

Strong problem-solving and analytical skills.

Excellent communication and teamwork abilities.

Ability to work independently and manage multiple priorities effectively.