Azure Data Engineer

Job Title : Azure Data Engineer Job Description
We are seeking a talented Azure Data Engineer. As a key member of the data engineering team, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and solutions on the Azure platform. You will play a crucial role in transforming raw data into valuable insights to drive business decisions.
Responsibilities:

• Design, develop, and implement data pipelines using Azure Data Factory to efficiently extract, transform, and load data from various sources into Azure Data Lake Storage (ADLS).
• Build and optimize data processing workflows using Azure Databricks, leveraging Python and PySpark for data manipulation, analysis, and transformation.
• Ensure data quality, integrity, and consistency throughout the data lifecycle.
• Optimize data pipelines for performance, scalability, and cost-efficiency.
• Troubleshoot and resolve data-related issues.
• Stay up-to-date with the latest advancements in Azure data technologies and industry best practices.

Mandatory Qualifications:

• 2-4 years of relevant experience in data engineering or related field.
• Strong proficiency in Azure Data Factory, ADLS, and Azure Databricks.
• Excellent programming skills in Python and PySpark.
• Experience with ETL/ELT processes, and data warehousing concepts.
• Understanding of data quality and governance principles.
• Ability to work independently and as part of a team.
• Strong problem-solving and analytical skills.

Good to Have Qualifications:

• Experience with other Azure data services (Azure SQL Database, Azure Synapse Analytics, etc.)
• Knowledge of cloud computing concepts and architectures.
• Experience with data visualization tools (Power BI, Tableau, etc.)