iFlow - Senior Data Quality Engineer - Azure Cloud Automation (5-9 yrs)

Job description - Senior Data Quality Engineer (Azure Specialist, Automation)

Experience : 6-8+ years

Work Location - Pune (Hybrid)

Technical Skills

Must have :

• 6-8+ yrs of experience working in Bigdata and Cloud environments- including Relational Databases, Data Lakes, ELT/ETL processes, data profiling and data quality management.
• Expert-level experience with SQL & Python, writing complex queries.
• Excellent documentation skills with knowledge of tools like JIRA, Confluence, Bitbucket.
• 5+ years experience in Big data and ETL testing Spark, PySpark
• Experience is API Testing, Postman
• Experience with Azure public cloud(ADF, Synapse, Event Hubs, ADLS2)

• Bachelor's/Master's degree in computer science/engineering, operations research or related areas.
• Self-starter with drive, initiative and a positive attitude. Able to meet very stringent deadlines and always deliver results, even under pressure.
• Outstanding written and verbal communication skills

• Be the point of contact for Data validation deliverable.
• Develop and automate underlying SQL or Python scripts for implementing DQ rules and metrics in pre & postproduction data systems.
• Investigate and explain data anomalies.
• Work alongside the central data quality team and data engineers to ensure high quality data and observability.
• Participate in go-live preparation activities such as QA, dress rehearsals, issue remediation, cutover, and go-live aftercare.
• Seek opportunities for continuous improvement in processes, procedures, and systems with regards to data quality
• Define test strategy for various platform components.
• Hands on in executing Test plans and test scenarios for user stories,
• Test automation executing test scenarios, Performance testing, Functional testing, Regression testing, Post-Production validation, Bug reporting.
• Experience in Publish test reports to stakeholders.