Kafka Architect (15-22 yrs)

About the Role :

We are seeking a highly skilled and experienced Kafka Architect to join our growing team.

In this role, you will be responsible for designing, developing, and implementing robust and scalable Kafka based streaming platforms.

You will play a critical role in defining and driving the evolution of our data streaming architecture, ensuring high availability, performance, and security.

Responsibilities :

- Design, develop, and implement high-performance, scalable, and fault-tolerant Kafka clusters.

- Define and implement best practices for Kafka architecture, including topic partitioning, replication, and consumer groups.

- Integrate Kafka with various data sources and sinks, such as databases, message queues, and streaming applications.

- Develop and maintain Kafka connectors and custom serializers/deserializers.

- Troubleshoot and resolve Kafka-related issues, including performance bottlenecks and data integrity problems.

- Work closely with development teams to integrate Kafka into their applications.

- Provide guidance and mentorship to junior engineers on Kafka-related technologies.

- Stay abreast of the latest advancements in Kafka and related technologies.

- Collaborate with other architects and engineers to design and implement overall data architecture.

- Ensure data security and compliance with relevant regulations.

Required Skills :

- Strong experience in designing, developing, and deploying Kafka clusters.

- In-depth knowledge of Kafka internals, including topics, partitions, replication, and consumer groups.

- Experience with Kafka Streams, Kafka Connect, and other Kafka ecosystem components.

- Experience with ZooKeeper administration and configuration.

- Strong understanding of data streaming concepts and best practices.

- Experience with data integration patterns and technologies.

- Proficiency in Java, Python, or other relevant programming languages.

- Experience with cloud platforms such as AWS, Azure, or GCP (optional but preferred).

- Excellent communication and collaboration skills.

- Strong analytical and problem-solving skills.

Desired Skills :

- Experience with API management platforms (e., Apigee, Kong).

- Experience with containerization technologies such as Docker and Kubernetes.

- Experience with stream processing frameworks such as Apache Flink or Spark Streaming.

- Experience with data security and compliance best practices.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on challenging and rewarding projects.

- Collaborative and supportive team environment.

- Opportunities for professional growth and development