Diagonal - Practice Lead - Azure Databricks (7-8 yrs)

Overview :

Diagonal Consulting is all about creating a lasting outcome for our customers by tapping into our collective passion for Data Analytics.

We empower organizations to enhance their business efficiency by designing and executing simple, innovative Data Strategies We see ourselves as a trusted solution partner.

About the job :

Role Description :

This is a full-time hybrid role for a Practice Lead - Databricks at Diagonal consulting. The role will be part of our Data Engineering practice and will be focused on building the Databricks practice.

The candidate will also be part of the practice team and contribute to competency development & driving innovation through various internal initiatives within Diagonal.

- Lead the design, development, and implementation of data solutions using Databricks and Apache Spark.

- Develop and deliver training programs to enhance the skills of the engineering team on Databricks and related technologies.

- Provide technical leadership and mentorship to junior engineers, fostering a culture of continuous learning and improvement.

- Optimize data workflows and ensure performance efficiency in data processing tasks.

- Stay updated with the latest trends and advancements in data engineering and Databricks technologies, and evaluate their potential application in our projects.

- Troubleshoot and resolve data-related issues, ensuring high availability and reliability of data solutions.

Qualifications and Skills required :

- 6+ years of experience in data engineering or a related role, with a strong focus on Databricks and Apache Spark.

- Proven experience leading teams and managing projects in a fast-paced environment.

- Strong programming skills in languages such as Python/Scala

- Deep understanding of data architecture, data modeling, ETL and ML processes.

- Experience with cloud platforms (AWS/Azure/GCP) and related data services.

- Excellent problem-solving skills and the ability to communicate complex concepts effectively.

- Databricks certification or equivalent is highly desirable