Data Engineer

Key Responsibilities: Gather and Analyse business and technical requirements Develop data solutions with effective framework to cleanse, transform and store the data in optimized format Solution design using Microsoft Azure Data services (Azure Data Factory, Databricks, PySpark) and other tools The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.) Load transformed data into storage and reporting structures in destinations including Data Warehouse, Operational Data store Build data pipelines to collectively combine, transform and aggregate the data Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse Skills and Experience Experience in designing and hands-on development in cloud-based analytics solutions. Experience in Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake is required. Thorough understanding of Azure Cloud Infrastructure offering. Strong experience in common data warehouse modelling principles including Kimball, Inmon. Knowledge of Microsoft BI Stack is desirable. Hands-on with PowerShell scripting is desirable. Working knowledge of Python is desirable Developing NO SQL solutions using Azure Cosmos DB is desirable. Knowledge of Dev-Ops processes (including CI/CD) is desirable.