Azure Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, load data from various sources into Azure Storage solutions such as Blobs, Files, Tables etc.
• Collaborate with cross-functional teams to understand business requirements and design scalable architectures for big data processing using Azure Functions.
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Synapse Analytics.
• Ensure high availability of the system by implementing monitoring tools like Logic Apps and Stream Analytics.

Job Requirements :

• 8-15 years of experience in IT industry with expertise in cloud computing platforms like Microsoft Azure.
• Strong understanding of ADF architecture including pipeline development, scheduling, monitoring & logging.
• Proficiency in writing complex SQL queries for querying large datasets stored on Azure storage services like Blobs, Files & Tables.