Wipro - Senior Databricks Engineer - Azure Data Services (4-6 yrs)

Responsibilities :

1. Role : Senior Databricks Engineer

2. Skills and Experience :

- Extensive expertise in Databricks and Azure Data Factory (ADF).

- Good understanding of Azure Synapse Analytics, ADLS, Azure SQL Server, Azure Logic Apps, APIs, Unity Catalog, Delta Lake, T-SQL, and Python.

- Knowledge of Power BI connectors.

3. Responsibilities :

- Design, develop, and maintain robust data pipelines using Databricks and ADF.

- Integrate Databricks with Azure SQL Server for seamless data flow and advanced analytics.

- Implement ETL processes to extract, transform, and load data from various sources into Azure data stores.

- Maintain dashboards and reports in Power BI, leveraging its connectors to Databricks.

- Optimize and troubleshoot existing ETL workflows for performance, reliability, and cost.

- Ensure data quality and implement data governance practices.

4. Desirable Skills :

- Experience with Delta Lake for data management in Databricks.

- Familiarity with data lake architectures and data warehousing concepts.

- Knowledge of CI/CD pipelines and DevOps practices for data engineering.

- Certification in Azure or related cloud technologies.

Note : If shortlisted, you will be invited for initial rounds on 30th November'24 in Bengaluru