Soprasteria - Senior Data Engineer - Azure/Data Warehousing (8-10 yrs)

Job Description :

We are seeking a highly skilled Senior Data Engineer with a strong focus on Azure cloud technologies to join our data development squad. The ideal candidate will have extensive experience in designing, developing, and managing data pipelines and data warehouses on the Azure platform.

Key Responsibilities :

Azure Data Warehouse :

- Design, implement, and optimize Azure SQL Database (Hyperscale) and Azure Synapse Analytics solutions.

- Configure and manage Azure SQL Database and Azure Synapse Analytics for optimal performance and cost-effectiveness.

- Develop and maintain ETL processes using Azure Data Factory to integrate data from various sources.

- Write efficient SQL queries to extract, transform, and load data.

- Monitor and troubleshoot data pipeline performance and data quality issues.

Azure Cloud Services :

- Utilize Azure Functions, Logic Apps, Azure Storage, Service Bus, and Azure Monitor to build scalable and reliable data solutions.

- Develop and deploy serverless functions and workflows to automate data processing tasks.

- Implement data integration patterns using Azure Service Bus and Event Hub.

Data Governance and Security :

- Adhere to data governance and security best practices.

- Implement data security measures to protect sensitive data.

- Monitor data usage and access to ensure compliance with regulations.

Required Skills and Experience :

- 8-10 years of experience in data engineering and data warehousing.

- Strong proficiency in Azure SQL Database (Hyperscale), Azure Synapse Analytics, and Azure Data Factory.

- Experience with SQL Server, SQL Server Jobs, and T-SQL.

- Strong understanding of data modeling, ETL processes, and data warehousing concepts.

- Experience with CI/CD pipelines and DevOps practices.

- Strong problem-solving and analytical skills.

- Excellent communication and collaboration skills.