Databricks - Walk-In Drive in Pune - Feb 1st /Saturday

Role: Databricks

Location: Walk-In Drive in Pune - Feb 1st /Saturday - COG Deccan Campus Cognizant Technology Solutions India Private Limited, Plot No.16, Phase III, Rajiv Gandhi Infotech Park, Hinjewadi, Pune MH 411057

Fulltime

Role & responsibilities

Azure Databricks Data Engineer:

Looking for a skilled Data Engineer to join our team. The ideal candidate should have experience in Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF). The candidate should be able to design, develop, and maintain data pipelines and data streams. The candidate should also be able to move/transform data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark.

Responsibilities:
• Design and build modern data pipelines and data streams.
• Move/Transform data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark.
• Develop and maintain data pipelines and data streams.
• Work with stakeholders to understand their data needs and provide solutions.
• Collaborate with other teams to ensure data quality and consistency.
• Develop and maintain data models and data dictionaries.
• Develop and maintain ETL processes.
• Develop and maintain data quality checks.
• Develop and maintain data governance policies and procedures.
• Develop and maintain data security policies and procedures.
• Provide technical guidance and mentorship to junior data engineers