Data Engineer - Lead / Architect

Job title - Data Engineer lead / Architect

Location - Bengaluru

Work form Office

We are Looking :

• You will have a passion for building robust data platform sufficing the needs of Data Warehousing and ELT use cases.
• You will also have to collaborate with world-class external and internal Solution Architects, data engineering experts, and contributing to the continuous improvement of our work processes
• Implement and maintain Datawarehouse platform and data pipelines

What you'll bring

• Minimum 6 years experience within Data Engineering with minimum 2 years in a similar role
• Experience with Databrick, DBT, Python and Pyspark is preferrable but not mandatory
• Comfortable working within conceptual, logical and physical data model following Data Vault 2.0 and Kimball data modelling methodologies
• Strong experience working in Data Warehousing and Data Analytics projects including data acquisition, data transformation, and data migration projects
• Strong experience in SQL and Redshift
• Experience in developing and optimising data pipelines using control-m and sql
• Experience in data migration, building, enhancing and maintaining cloud data warehousing
• Experience in performance tuning and optimising databases and SQL queries for analysis and reporting
• Ability to rapidly acquire an understanding of complex business problems/requirements to develop solutions and designs, regardless of existing areas of expertise or specialisation
• Strong skills and experience in cloud environments, especially AWS
• Experience supporting high availability production systems is desirable

What you'll do

• Implement and maintain Datawarehouse platform and data pipelines suitable for Data Warehousing and reporting use cases
• Build data assets that are aligned to IET data strategy and architectural roadmaps
• Promote and champion Data Platform and Engineering ways of working via continuous build, continuous integration and continuous delivery
• Support detailed solution design, data modelling, estimation and specification process
• Promote test driven development and automated unit test frameworks within the teams
• Promote and champion DevOps (CI/CD) practices using Bitbucket and Jenkins
• Coordination of deployment and release activities for the team
• Develop data engineering standards, implementation patterns and how to guides
• Challenge the development team on their delivery of quality, unit test coverage and assistance in the creation of development artefacts
• Contribute to risk analysis and utilise that information to plan development activities
• Identify technical and process improvements that will benefit the business
• Optimising code and ensuring we are getting the best out of the Data Platform
• Foster a safe, innovative and results driven culture