Senior Data Engineer - ETL/Azure Data Factory (5-9 yrs)

About Our Client :

Our Client is a global specialty finance company with operations and investments across North America, Europe, Asia and Latin America. Through its subsidiaries around the globe, Encore purchases or services portfolios of receivables from major banks, credit unions and utility providers.

GENERAL SUMMARY

- The Azure Senior Data Engineer will be responsible for designing, building and maintaining efficient ELT/ETL pipelines using Data Factory along with data movement using the relevant Azure services.

- The person will be working in close co-ordination with the Tech Lead and/or the Architect to understand the requirements, effectively implement the solutions and to ensure the best practices are followed.

- In addition to the above, the person will be required to own the below key responsibilities.

- Integrating data from various sources into a unified Azure data warehouse and suitable data marts.

- Continuously monitoring and testing the availability, performance and quality of data pipelines.

- Collaborating with peers by employing and following SDLC best practice while maintaining code repositories and activity using Agile, DevOps and CI/CD methodologies through Dev, Test and QA environments

- Working closely with stakeholders to understand ongoing requirements, build effective products and align data modelling principles.

- Adhering to agreed Release and Change Management Processes.

- Troubleshoot and investigate anomalies and bugs in code or data.

- Adhering to test and reconciliation standards to produce confidence in delivery.

- Produce appropriate and comprehensive documentation to support ease of access for technical and

non-technical users.

- Engage in a culture of continual process improvement and best practice.

- Efficiently respond to changing business priorities through effective time management.

- Conduct all activities and duties in line with company policy and compliantly.

- To carry out any other ad-hoc duties as requested by management.

EDUCATION : Bachelor's FIELD OF STUDY: Information Technology

EXPERIENCE :

- 5+ years of total experience into IT industry as a developer/senior developer/data engineer

- 3+ years of experience of working extensively with Azure services such as Azure Data Factory, Azure

Synapse and Azure Datalake

- 3+ years of experience working extensively with Azure SQL, MS SQL Server and good exposure into writing complex SQL queries.

- 1+ years of experience working with the production support operations team as a production support engineer.

- Good knowledge and exposure into important SQL concepts such as Query optimization, Data

Modelling and Data Governance

- Working Knowledge of CI/CD process using Azure DevOps and Azure Logic Apps

- Very good written and verbal communication skills

Key skills required :

- Azure Data Factory, Azure Synapse, Azure SQL, Azure SQL Datawarehouse, MS SQL Server, Azure

DevOps, Azure Logic Apps, Azure Datalake

- Solid experience of ADF meta-data driven Integration runtimes, pipelines, data flows.

- Experienced in design and implementation of end-to-end ELT pipelines using Data Factory, Delta Live Tables, structured streaming

- Experience and understanding of Azure fundamentals, networking and security.