Kafka Integration

Job Description:

We are seeking a seasoned Solutions IT Developer with a strong background in Apache Kafka to join our developer advocacy function in our event streaming team. The ideal candidate will be responsible for Kafka code reviews with clients, troubleshooting client connection issues with Kafka and supporting client onboarding to Confluent Cloud. This role requires a mix of software development expertise along with a deep understanding of Kafka architecture, components, and tuning.

Responsibilities:

1. Support for Line of Business (LOB) Users: 

   - Assist LOB users with onboarding to Apache Kafka (Confluent Cloud/Confluent Platform), ensuring a smooth integration process and understanding of the platform's capabilities.

2. Troubleshooting and Technical Support:

  - Resolve connectivity issues, including client and library problems, to ensure seamless use of our Software Development Kit (SDK), accelerators and Kafka client libraries.

  - Address network connectivity and access issues

  - Provide a deep level of support for Kafka library, offering advanced troubleshooting and guidance.

  -  Java 11, 17 and Spring Boot (Spring Kafka, Spring Cloud Stream Kafka Spring Cloud Stream) experience

3. Code Reviews and Standards Compliance:

  - Perform thorough code reviews to validate client code against our established coding standards and best practices.

  - Support the development of Async specifications tailored to client use cases, promoting effective and efficient data handling.

4. Developer Advocacy:

  - Act as a developer advocate for all Kafka development at TD, fostering a supportive community and promoting best practices among developers.

5. Automation and APIs:

  - Manage and run automation pipelines for clients using REST APIs as we build out GitHub Actions flow.

6. Documentation and Knowledge Sharing:

  - Update and maintain documentation standards, including troubleshooting guides, to ensure clear and accessible information is available.

  - Create and disseminate knowledge materials, such as how-tos and FAQs, to answer common client questions in general chats related to Kafka development.

Role Requirements:

Qualifications:

- Bachelors degree in Computer Science

- Proven work experience as a Solutions Developer or similar role with a focus on Kafka design and development

Skills:

- In-depth knowledge of Java 11, 17 and Spring Boot (Spring Kafka, Spring Cloud Stream Kafka Spring Cloud Stream)

- Deep knowledge of Apache Kafka, including Kafka Streams and Kafka Connect experience

- Strong development skills in one or more high-level programming languages (Java, Python).

- Familiarity with Kafka API development and integration.

- Understanding of distributed systems principles and data streaming concepts.

- Experience with source control tools such as Git, and CI/CD pipelines.

- Excellent problem-solving and critical-thinking skills.

Preferred:

- Kafka certification (e.g., Confluent Certified Developer for Apache Kafka).

- Experience with streaming data platforms and ETL processes.

- Prior work with NoSQL databases and data warehousing solutions.

Experience:

- Minimum of 4 years of hands-on experience with Apache Kafka.

- Experience with large-scale data processing and event-driven system design.

Other Requirements:

- Good communication skills, both written and verbal.

- Ability to work independently as well as collaboratively.

- Strong analytical skills and attention to detail.

- Willingness to keep abreast of industry developments and new technologies.