Senior Data Engineer

Good organizational, analytical & consulting skills

Knowledge about Data Mesh concept

Knowledge about Data One Platform (Snowflake)

Familiar with Data Vault Concept and Design

Ability to convert current PULSE (Experience and Knowledge about PULSE is a plus) As Is to Data Vault Design using Snowflake, Immuta, Collibra, Cloud security

Ability to understand the architecture of the existing legacy landscape and come up with architectural options to do this in the Data One Platform

Ability to understand the various technologies in the complex landscape and the analytical capabilities of these technologies

Have a good understanding of the Commercial Processes in DIA and the data behind these processes in the Commercial Space is huge plus

Experience as a Data Engineer and Data Architect

Good understanding of Data and Analytics Architecture patterns

Proficiency in data transformation, with a preference for SQL/Python, Snowflake and dbt

Experience in a CI/CD setting, with a preference for GitLab

Experience in Insights, Data Products and Data Mesh Concepts and Information Architecture and Modeling

Good understanding of data input & output formats - APIs, extracts, user inputs etc

Solid understanding of data retrieval, storage, manipulation

Experience setting up data sharing agreements

Experience setting up service level agreements

Experience defining observability rules and mechanisms

Responsibilities:

• Come up with Architecture options for the various use cases in the beginning and constantly revisit and refine this to match organization's technology landscape and capabilities
• Understand the Business Requirements and decompose this into a concept of what data products will be built which can be used as a blueprint by the developers
• Aid and enable development team to realize the architectural blueprint and delivering insights
• Introduce effective and practical technical governance
• Lead discussions with the various internal stakeholders of analytics and reporting platforms and Aspire Analytics and Reporting and bring all of them into alignment on the Architecture options and Data Products that the Contract Monitoring and Insights needs.
• Able to coach and guide the development team through the various sprints to ensure that the development meets the architecture patterns and the outcomes for the project.
• Ability to be flexible and wear different hats to keep things moving in an environment where things are still shaping up
• Define, enforce and apply data engineering practices and standards to develop robust and maintainable data pipelines
• Analyze and organize raw data ingestion pipelines
• Support senior business stakeholders in defining new data product use cases and their value
• Take ownership of data product pipelines and their maintenance
• Explore ways to enhance data quality and reliability, be the Quality Gatekeeper for developed Data Products
• Be constantly on the lookout for ways to improve best practices and efficiencies and make concrete proposals.
• Take leadership and collaborate with other teams proactively to keep things moving
• Be flexible and take on other responsibilities within the scope of the Agile Team.