NICE - Senior Kafka Architect - Managed Streaming Services (3-5 yrs)

Responsibilities :

- Manage and maintain our large-scale, multi-node Kafka clusters deployed on AWS, ensuring optimal performance, high availability, and disaster recovery.

- Perform day-to-day operational tasks for the Kafka cluster, including maintenance, support, and upgrades.

- Proactively monitor cluster health and implement robust alerting mechanisms to identify and address potential issues promptly.

- Research and recommend innovative solutions to optimize Kafka performance and automate key administrative tasks, improving operational efficiency.

- Provide expert guidance in the creation and modification of standards and procedures for Kafka management within the organization.

- Configure and manage Kafka topics, redundancy clusters, and monitoring tools to ensure comprehensive oversight of the Kafka ecosystem.

- Deploy and utilize management tools to streamline Kafka administration and troubleshooting.

- Offer technical expertise and guidance to support teams in effectively utilizing the Kafka platform for production applications.

- Stay up-to-date with the latest advancements in Kafka technologies (open-source and AWS MSK) and best practices for security, scalability, and disaster recovery.

Technical Skills (Must-Have) :

- 3+ years of experience in administering Apache Kafka, particularly in managing critical 24/7 applications.

- Proven experience in operating and creating AWS MSK clusters.

- In-depth knowledge of open-source Kafka components (Kafka Connect, Schema Registry, KSQL, REST Proxy).

- Experience with Kafka MirrorMaker for data replication across clusters.

- Familiarity with container orchestration platforms like Kubernetes and Helm (experience with ArgoCD is a plus).

- Solid understanding of high availability cluster setup, maintenance, and ongoing 24/7 support principles.

- Strong grasp of security best practices, performance optimization techniques, and disaster recovery strategies for Kafka deployments.

Technical Skills (Good to Have) :

- Experience with cloud-based monitoring and logging solutions (e.g, Prometheus, Grafana) is a plus.

- Experience with scripting languages (e.g, Python, Bash) for automation tasks is a plus