Data Engineer - Lead

Key Responsibilities:

• Building and maintaining data pipelines for data integration and processing, ensuring data security and privacy prerequisites are followed. Create, monitor, and maintain data pipeline architecture.
• Understand business requirement and actively provide inputs from Data perspective.
• Understand the underlying data and flow of data.
• Ensure data quality and accuracy through testing and validation
• Optimize data processing performance through tuning and monitoring. Design and implement optimized data sets.
• Maintains and enhances systems by fixing complicated errors, raising risks and escalating issues where necessary
• Designs high-quality solutions in accordance with timelines and specifications to meet user requirements.
• Ensures all activities adhere to the relevant processes, procedures, standards and technical design.
• Proactively identifies and leads the implementation of continuous improvement items with the support of the Team Lead and Manager.
• Adheres to the development coding standards, the operational framework and WTW Excellence guidelines.
• Works closely with QA, Product/Business Analysts, and other Software Engineering functions to ensure high quality on-time delivery
• Demonstrate learning adaptability, understanding of the implications of technical issues on business requirements and / or operations.
• Create reports and visualizations providing insight into data sets.
• Troubleshoot and resolve data pipeline and reporting performance issues.

Knowledge and Experience:

• A Bachelors/College Degree would be beneficial and extensive experience in a technology related discipline, such as IT or Engineering is required
• 7+ years experience as a Data Engineer.
• Knowledge in code quality, performance and security
• Experience on source code control systems
• Familiarity on continuous delivery and continuous integration practices
• Willingness to work in a fast-paced collaborative team environment that has tight deadlines.
• Ability to learn and evaluate new tools, concepts, and challenges quickly.
• Client service focus and flexibility in supporting client requests.
• Strong analytical and problem-solving skills.
• Commitment to quality and continuous improvement.
• Strong written and verbal communication skills.
• Proficient in Azure Data Factory. Experience building and optimising data pipelines, architectures, and data sets
• Experience with Azure data storage solutions such as Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage
• Basic understanding of data modeling- OLTP vs dimensional modeling is preferred
• Experience creating reports using Power BI.
• Experience with relational databases and proficiency using SQL

A Bachelors/College Degree would be beneficial and extensive experience in a technology related discipline, such as IT or Engineering is required