Data Engineer - Python Programming (5-6 yrs)

Job Description :

Key Skills : Python, PySpark, Kafka, Debezium, SQL, DataBricks/Deltalake or similar.

- 5+ years of experience in the data engineering field.

- Proficiency in Python, PySpark for data transformation.

- Experience with Kafka and debezium to create and deploy data pipelines.

- Strong SQL skills, particularly in complex data aggregation and transformation queries.

- Experience with delta lake and data bricks

- Understanding of all stages of SDLC; prior experience with Agile/SCRUM methodology.

Good to have :

- Understanding of machine learning algorithms

- Familiarity with ETL tools and processes such as Matillion and Google Data Studio

- Experience in creating BI reports with tools like Looker or Tableau

- Familiarity to write APIs to extract data from database