Azure Databricks Engineer - ETL/Python (5-10 yrs)

Job Description :

Position : Azure Databricks Engineer

Experience Level : 5 - 9 Years

Location : Pan India (Remote Work Available)

Job Type : Full-Time

Availability : Immediate / Early Joiners Preferred

About the Role :

We are seeking a skilled Azure Databricks Engineer to join our dynamic team. The ideal candidate will have extensive experience in Azure services, particularly Databricks, and will be responsible for designing, developing, and maintaining data pipelines and ETL processes. You will work collaboratively with cross-functional teams to drive data-driven decisions.

Key Responsibilities :

- Design and implement scalable data pipelines using Azure Databricks.

- Develop ETL processes in Azure Data Factory.

- Write and optimize complex SQL queries for data extraction and analysis.

- Utilize Python and PySpark for data manipulation and processing.

- Collaborate with data scientists and analysts to support data-driven projects.

- Monitor and troubleshoot data workflows to ensure reliability and performance.

- Document data processes and contribute to best practices in data engineering.

- Stay updated with the latest trends and technologies in data engineering and Azure services.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- 5 - 9 years of experience in data engineering or related roles.

- Proficient in Azure Databricks, Azure Data Factory, and related Azure services.

- Strong programming skills in Python and PySpark.

- Solid understanding of SQL and experience with relational databases.

- Familiarity with data modeling, data warehousing concepts, and big data technologies.

- Excellent problem-solving skills and ability to work independently or in a team.

- Strong communication skills to convey technical concepts to non-technical stakeholders.

Preferred Qualifications :

- Experience with additional data processing frameworks (e.g., Apache Spark).

- Knowledge of cloud architecture and data governance best practices.

- Familiarity with data visualization tools is a plus.

What We Offer :

- Competitive salary and benefits package.

- Opportunities for professional growth and development.

- A collaborative and innovative work environment.

- Flexible working hours and remote work options.

If you are passionate about data engineering and ready to take your career to the next level, we encourage you to apply!