Cocolevio - Cloudera Data Engineer (5-8 yrs)

About the job :

Requirements :

We are seeking a Cloudera Data Engineer to design, build, and optimize real-time data pipelines using the Cloudera Platform and Cloudera Streams Messaging (CSM) deployed on AWS.

The role requires strong client-facing experience and excellent communication skills, as the engineer will be working as part of a mixed client and consulting team.

Key Responsibilities :

- Design and develop real-time data ingestion and transformation pipelines.

- Optimize streaming data jobs for performance, reliability, and scalability.

- Collaborate with cross-functional teams to implement data solutions.

- Work closely with stakeholders in financial services (retail and commercial banking) to deliver business-driven data solutions.

- Ensure code quality by running analysis tools such as SonarQube.

Required Skills Experience :

- Hands-on experience with the Cloudera Platform and Cloudera Streams Messaging (CSM) using Kafka.

- Expertise in real-time data ingestion and transformation.

- Proficiency in Python and PySpark (Streaming).

- Strong experience in Kafka, NiFi, and EKS.

- Exposure to HBase for data storage solutions.

- Familiarity with software development principles (GIT).

Preferred Skills :

- Experience in financial services, particularly retail and commercial banking.

- Strong understanding of real-time data processing best practices.

- Ability to work effectively in a client-facing environment with strong communication skills