Centific - Data Engineer - Java/Kafka (6-8 yrs)

Key Responsibilities :

- Design and develop real-time data pipelines using Apache Kafka and Java.

- Build and maintain Kafka producers and consumers for efficient data ingestion and distribution.

- Perform data transformations and cleansing within the data pipeline.

- Utilize SQL for data warehousing and querying real-time data.

- Monitor and troubleshoot data pipelines to ensure data quality and timely delivery.

- Work with data scientists and engineers to understand data requirements.

- Stay up-to-date on the latest advancements in real-time data processing technologies.

Required Skills :

- 6+ years of experience in software development with a focus on data engineering.

- Strong proficiency in Java programming language.

- In-depth knowledge of Apache Kafka and its ecosystem (producers, consumers, connectors).

- Experience with SQL for data manipulation and querying.

- Excellent analytical and problem-solving skills.

- Ability to work effectively in a team environment.

Bonus Points :

- Experience with other real-time data processing frameworks (e.g, Apache Spark Streaming, Flink).

- Experience with cloud platforms (AWS, GCP, Azure) for data pipelines (a plus).

- Familiarity with data streaming APIs and messaging protocols