Azure Data Engineer - ETL/Python (5-10 yrs)

Key responsibilities :

- Creates and maintains optimal data pipeline architecture

- Assembles large, complex data sets that meet functional / non-functional business requirements

- Identifies, designs and implements internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc

- Builds analytics tools that utilise the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics

- Works with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs

- Keeps our data separated and secure

- Creates data tools for analytics and data scientist team members that assist them in building and optimising our product into an innovative industry leader

- Works with data and analytics experts to strive for greater functionality in our data systems

Must have :

- Data Architecture & Modeling: Design and maintain scalable, efficient data models and architectures to support data analytics, reporting, and ML model training.

- Data Pipeline Engineering: Develop, maintain, and optimise scalable data pipelines that can handle large volumes and various types of data.

- Data Quality Assurance: Implement rigorous data cleaning, transformation, and integration processes to ensure data quality and consistency.

- Collaboration: Work closely with data scientists, ML engineers, and other stakeholders to understand data requirements and implement effective data solutions.

- Documentation & Governance: Maintain comprehensive documentation of data procedures, systems, and architectures. Provide guidance and support for data governance practices, including metadata management, data lineage, and data cataloging.