Azure Data Engineer - Data Warehousing Platform (4-10 yrs)

Job Description :

The Azure data engineer will play a vital role by contributing in building a unified data warehouse platform for the organization on Azure cloud. This involves data modeling, data management, data pipeline creation, ensuring data quality and integrity, ensuring performance and scalability for current and future data models and support for BI and data analytics. This role will closely work with product team for data sourcing and other platform tech team members ensuring we develop a data platform in alignment to the group's best practices.

Key responsibilities :

- Design, build and optimize data models as part of data warehouse development

- Design and create ETL pipelines

- Exploit elasticity and agility of Synapse to build a robust ETL solution

- Responsible and accountable for pipelines reliability and availability

- Own and maintain the physical data models of serving layer

- Collaborate with BI developer and provide support for serving layer as per reporting standards

- Provide support to BI and Data Analytics activities involving data discovery, KPI metric requirements

- Create and maintain solution level documents related to project management, solution architecture, technical metadata and data lineage

- Gain understanding of the meaning, domain and the context of the data

- Develop and maintain deployment cycle for the data warehouse (database and pipeline)

Professional :

- Strong Experience of 5+ years in data integration, data gateway, data warehousing and ETL projects

- Strong Experience of 5+ years in building pipelines using Azure Technology Stack: SQL DW/Synapse

- Experience in Azure Data Factory - Azure Databricks - Azure Data Lake Storage

- Ability to write complex SQL scripts and stored procedures

- Demonstrated experience in designing and delivering data platforms for BI or Data Warehouse, including data ingestion, ETL and data integration

- Strong skills in handling and analyzing complex, high volume data with excellent attention to details

- Knowledge of data modelling and data warehousing concepts, such as Kimball or 3NF

- Familiar with Agile methodology and Agile working environment

Personal :

- Ability to work independently while collaborating with various stakeholders

- Highly analytical with an ability to apply problem-solving skills to identify root cause, analyze impact and then solve complex data platform challenges

- Self-motivated and passionate about actively contributing to data team's vision and agenda

- Strong technical and business know-how enough to perform due diligence on business Data Analytics problems, quickly grasp the key process issues and data challenges

Desirable :

- Knowledge of SFDC Sales Cloud data model, Google Analytics

- Experience in building financial data marts (forecast, P&L)

- Experience in building data models for predictive analytics