Azure Data Engineer - Synapse Analytics (8-12 yrs)

Job Title : Azure Data Engineer

Location : Hyderabad (Hybrid)

Total Experience : 8+ years

Job Description :

We are seeking a highly skilled and experienced Azure Data Engineer to join our dynamic team in Hyderabad. This is a hybrid role, offering flexibility with a combination of remote and on-site work. The ideal candidate will have extensive experience working with Azure Data Factory (ADF), SQL, Azure Databricks (ABD), PySpark, Python, and Synapse Analytics. As part of our team, you will play a crucial role in designing, building, and optimizing data pipelines that support advanced analytics and business intelligence solutions.

Key Responsibilities :

- Design, implement, and maintain end-to-end data pipelines in Azure Data Factory (ADF) and Synapse Analytics.

- Develop and optimize ETL processes, utilizing SQL and Python.

- Utilize Azure Databricks and PySpark to process large volumes of data.

- Work closely with business analysts and data scientists to ensure data solutions meet business needs.

- Implement data transformation logic and manage data workflows in a cloud environment.

- Build and maintain scalable and high-performance data solutions on the Azure Cloud.

- Perform troubleshooting and optimization of data processing workflows.

- Collaborate with cross-functional teams to drive data-driven decision-making.

- Implement best practices for security, data governance, and compliance in data pipelines.

Key Skills & Experience :

- Azure Data Factory (ADF) : Extensive experience in designing and developing data integration solutions using ADF.

- SQL : Strong proficiency in SQL for querying and manipulating relational and non-relational data.

- Azure Databricks (ABD) : Hands-on experience with Azure Databricks for data engineering tasks and analytics workflows.

- PySpark : Proficiency in using PySpark for large-scale data processing and transformations.

- Python : Strong coding skills in Python for automation, scripting, and data transformations.

- Synapse Analytics : Familiarity with Azure Synapse Analytics for data warehousing, analytics, and integration.

- Experience with Data Lake and Data Warehouse concepts, including structured and unstructured data.

- Knowledge of cloud architecture and deployment models in Azure.

- Strong troubleshooting and optimization skills in a cloud environment.

- Excellent communication and collaboration skills for working with diverse teams.

Educational Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field.

Desired Skills (Good to Have) :

- Knowledge of CI/CD pipelines in Azure DevOps for data projects.

- Familiarity with Data Governance tools and frameworks.

- Experience with Power BI, DataBricks MLflow, or similar data visualization and ML platforms.