Pine Labs - Kafka Engineer (3-5 yrs)

Job Description - Kafka Engineer

We at Pine Labs are looking for those who share our core belief - "Every Day is Game day". We bring our best selves to work each day to realize our mission of enriching the world through the power of digital commerce and financial services.

Role Purpose :

We are seeking an experienced Kafka engineer to join our growing team. As a Kafka Engineer, you will be responsible for building & Maintaining scalable, high-performance data streaming solutions using Apache Kafka.

The ideal candidate will have hands-on experience in designing, implementing, and maintaining Kafka-based event-driven architectures.

Responsibilities we entrust you with :

- Design and develop Kafka-based solutions for real-time data processing.

- Build and maintain Kafka producers, consumers, and topics.

- Optimize Kafka cluster performance, scalability, and reliability.

- Troubleshoot and resolve issues related to Kafka brokers, producers, and consumers.

- Integrate Kafka with other systems like databases, microservices, and third-party APIs.

- Develop efficient data pipelines for processing large volumes of streaming data.

- Ensure data integrity and fault tolerance in Kafka systems.

- Collaborate with cross-functional teams to design and implement event-driven architectures.

- Monitor and manage Kafka clusters and ensure optimal health and performance.

- Work with DevOps teams for deployment and continuous integration/continuous delivery (CI/CD) pipelines.

Relevant work experience :

- Strong experience with Apache Kafka and Kafka Connect.

- Hands-on experience with Kafka Producers and Consumers.

- Proficiency in programming languages like Java, Python.

- Familiarity with Kafka Streams .

- Experience with Kafka management tools (e.g., Confluent Control Center, Kafka Manager).

- Solid understanding of distributed systems and messaging queues.

- Knowledge of cloud platforms (AWS) and containerization (Docker, Kubernetes).

- Understanding of data serialization formats like Avro, JSON, or Protobuf.

- Experience with event-driven architectures and microservices is a plus.

- Strong troubleshooting and problem-solving skills.

What we Value in Our people :

You take the shot : You Decide Fast and You Deliver Right

You are the CEO of what you do : you show ownership and make things happen

You own tomorrow : by building solutions for the merchants and doing the right thing

You sign your work like an artist : You seek to learn and take pride in the work you do