Data Engineer - Azure Databricks (8-12 yrs)

Job Title : Data Engineer with Databricks/Python Background

Location : Bangalore

Experience : 8+ Years

Notice Period : Immediate to 15 Days

Position : C2H

Job Description :

We are seeking a dynamic and experienced Data Engineer with a proactive attitude and willing to learn. This role requires expertise in analyzing designing and implementing pipelines using Azure Databricks and Python but also to ensure we follow all the expected best practices and quality measures. The ideal candidate will also have a background in DBT framework.

This position combines some aspects of DevOps engineers, Data Engineers and Business Analyst. We are looking for a candidate who excels in automation and development, rather than merely operational tasks.

- Identify key uses cases, and apply end to end data flow within ZIDP, from ingestion, storage, transformation and catalog

- Democratize the access to the data ensuring security aspects through dashboards and API

- Follow Zurich best practices and quality guidelines.

- Develop and maintain data analytics solutions, including data pipelines and ETL processes.

- Write, optimize, and manage SQL queries and databases and be aware of the results

- Ensure security and compliance of cloud environments.

- Collaborate on designing and implementing CI/CD DevOps pipelines.

- Conduct performance tuning, troubleshooting, and root cause analysis.

- Implement and manage monitoring, logging, and alerting systems.

Soft Skills :

- Customer oriented attitude to our customer willing to provide solutions for any challenge our customer is facing by having "all-ears" to any suggestion. This is really something interesting

- Strong problem-solving skills and ability to work independently. This is a must

- Proactive attitude and excellent communication skills. This is a must

- Not fear of asking or taking challenges.