Azure Data Engineer - Data Catalogue (5-10 yrs)

Do you enjoy working in a fast-paced, growth-oriented environment? Do you have a passion working with clients and cross-functional teams to support business initiatives and assist in data lake implementations If so, we are looking for you!

Responsibilities :

- As an Azure Data Engineer, you will

- Work directly with the clients to lead critical modules in Data Engineering program which will include data extraction, data transformation, metadata management, data catalog, data quality, process/workflow definition implementation, Reporting, Delivery, etc.

- Lead and participate in Architecture and Design discussions and prepare technical documentation.

Create scalable solution for data ingestion and implement checks for data quality and accuracy to prepare it for data curation.

- Collaborate with Data Reporting teams to understand business requirements for data visualizations and prepare / curate the data to meet the consumption needs.

- Lead technical review meetings with client stakeholders and other vendors and partners who are part of the larger program.

- Implement Data governance best practices.

- Prepare technical documentation, training workshops and other artifacts as necessary.

Required Qualifications :

- At least 6 years of experience in Information Technology involving large Data Engineering projects.

- At least 4 years of experience in designing, implementing, and maintaining robust and scalable data lake / data warehouse implementations including data pipelines on Azure Cloud using services such as

- Azure Data Factory, Azure SQL Data Warehouse, Azure Analysis Services or any of the Azure Databricks/Synapse/Fabric.

- Expert hands-on knowledge of Azure Synapse. Experience with Azure Databricks and Fabric experience is highly preferred.

- Experience with Azure Purview is highly preferred.

- At least 2 years of experience in data platforms - with multi layered approach,

- Design/Architecture setup is needed.

- At least 2 years of experience in troubleshooting performance issues, identifying root cause and applying fixes.

- At least 3 years of experience in SQL.

- Ability to implement and manage CI/CD pipelines for data engineering projects, leveraging tools like Azure DevOps.

- Experience in working in Agile teams and working independently with Business stakeholders providing solutions and regular updates.

Preferred Qualifications :

- Azure Certifications are highly preferred.

- Ability to collaborate with data scientists and analysts to facilitate the availability of clean, structured

data for analytical purposes.

- Excellent communication and interpersonal skills are required.

- Familiarity with data modeling and ETL tools such as Erwin, Talend, DataStage.

- Proven analytical and problem-solving skills.

- Experience working in Financial and/or Healthcare industry.

- Ability to lead large complex projects with limited direction.