Data Engineer - Azure Databricks (5-7 yrs)

Job opportunity for data engineers for Gurgaon location.

Experience : 5+ years.

Should have good experience in databricks.

Role & Responsibilities Overview :

- A seasoned data team member with a good grasp of both business and technical aspects.

- Familiarity with data stack.

- Interact with the other members of the data governance team,business teams to understand requirements and also collaborate with stewards / data custodians end users etc.

- Demonstrated experience of building efficient data pipelines using tools or technologies likeSpark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio etc.

- Understand the need for both batch and stream ingestion of the data from source databases like SQLServer, Oracle, MySQL etc.and build scripts logics for reusable data transformations.

- Specialize in performance tuning of parked jobs, Databricks clusters and ETL processes leveraging advance features to enhance overall system efficiency.

- Conduct code reviews to ensure adherence to best practices, coding standards within Databricks notebooks and scripts.

- Lead Data Engineering Projects to manage and implement datadriven communication systems.

- Proficient in data engineering , data management principles.

- Good combination of technical skills, communication skills, and business acumen.