Azure Data Engineer

Role & responsibilities

• Design and implement data pipelines using Azure Data Factory (ADF) and Azure Functions and Logic apps.
• Design and develop traditional data warehouses from start to finish, including data modelling (star and snowflake schemas), ETL processes, and reporting frameworks.
• Develop and optimize data storage solutions in Snowflake and manage SQL databases.
• Manage API integrations using Azure API Management for data consumption.
• Implement CI/CD pipelines using Azure DevOps.
• Ensure compliance with security standards and geo-location requirements.
• Collaborate with cross-functional teams to gather and adapt to evolving requirements.
• Develop scripts and solutions using Python for automation and data processing.

Key skills

• Expertise in Azure Data Factory, Snowflake, and Databricks.
• Strong SQL skills for querying, optimization, and ETL tasks.
• Proficiency in Azure Functions, Logic Apps, and Azure API Management.
• Strong Python programming for data engineering tasks.
• Knowledge of CI/CD processes using Azure DevOps.
• Understanding of data security principles and Geo-location compliance.

Preferred Qualifications:

• Knowledge of Insurance/Re insurance
• Certified Azure data engineer
• Prior experience of Geospatial data
• Demonstrated ability to handle dynamic requirements in a fast-paced environment.
• Knowledge of data governance and classification practices.
• Strong problem-solving skills and ability to work independently.