Data Quality Engineer

3 Must haves (for TA team s reference) for Data Quality Engg role: Functional Data Testing Knowledge (4/5) Experience in Data Quality Checks (4/5) T-SQL Query Experience (4/5) Relational Database knowledge (Oracle, Netezza, SQL Server) (3/5)

Knowledge in Data Catalog is added advantage (Optional) We are looking for a detail-oriented Data Quality Engineer to join our team. In this role, you will be responsible for testing and validating Microsoft Purview Data Quality functionality and its ability to connect with on-prem databases. You will work closely with data engineers, business analysts, and data stewards to ensure the newly added capabilities are error-free, meets business requirements, and adheres to overall quality standards.

Responsibilities:

Test various Microsoft Purview functionalities such as Data Profiling, Data Quality, Data Estate Health, Actions/Triggers are supported for on-prem databases such as Oracle, Netezza, SQL Server. Ensure end-to-end connectivity and communication between Microsoft Purview, database connector and the on-prem databases.

Design, develop, and execute test cases to validate data quality, completeness, consistency, and accuracy. Identify, document, report, and track data quality issues, functionality impairment, including inconsistencies, duplicates, anomalies in data.

Requirements: 5+ years of experience in data quality testing or software testing, with a focus on data governance or data management tools. Hands-on experience or familiarity with Microsoft Purview, or similar data governance tools such as Collibra, Informatica, Talend. Proficiency in SQL for data validation and profiling; experience with data quality and governance tools. Understanding of data governance concepts such as metadata management, data lineage, and data classification. Experience working with Oracle, Netezza and SQL Server databases. Nice to have: Experience working with Microsoft Purview. Experience in scripting languages such as Python, Spark.