Lead Data Quality Specialist (7-10 yrs)

About the job

Key Responsibilities :

Design and Implement Data Quality Frameworks: Adopt a proactive (and reactive), scalable data quality framework to ensure that all critical capital markets data flows meet high standards of accuracy, completeness, and timeliness.

Collaborate with Data Engineers and Business Teams: Work with data engineering and business teams to identify key data quality issues, establish validation rules, and implement solutions that prevent data quality problems before they arise.

Develop Monitoring and Automation Tools: Implement automated data quality checks and monitoring systems that flag and address data issues in real time.

Leverage tools like Great Expectations or similar frameworks to validate data integrity across pipelines.

Define Data Quality Metrics and SLAs: Establish clear metrics for measuring data quality (e.g , accuracy, completeness, consistency) and set up service level agreements (SLAs) that data producers and consumers can use to track performance.

Pilot Initial Data Flows: Lead a pilot focused on a few key data streams (such as risk analytics and trade execution data) to refine the framework, demonstrate value, and gain early insights into how proactive data quality can support downstream data use cases.

Drive Data Governance: Build the governance structures that will ensure long-term data quality, including clear data ownership and stewardship responsibilities, processes for addressing data quality issues, and reporting tools for business and technical teams.

Support Long-Term Vision for Data Contracts: While the primary focus is on proactive data quality, this work will lay the foundation for establishing formal data contracts in the future, where data quality metrics and SLAs become formalized agreements between teams.

Required Skills and Experience :

- 7+ years of experience in data quality, data architecture, or a similar role in capital markets or financial services.

- Proven experience designing and implementing data quality frameworks that ensure accuracy, completeness, and timeliness of data.

- Expertise in data validation tools such as Great Expectations, whylogs, dbt expectations, Apache Griffin, or custom-built solutions for real-time data quality checks.

- Strong skillset and experience in building full-stack in Python

- Understanding of cloud infrastructure (GCP or Azure) and how to implement scalable data quality systems within cloud-native architectures.

- Ability to work closely with data engineers to support their data pipeline development by embedding data quality checks and standards.

- Experience establishing and tracking data quality metrics and SLAs, and working with teams to ensure compliance.

- Familiarity with capital markets data structures (e.g, trades, pricing, risk data) and the unique challenges around managing and ensuring quality in high-frequency, transactional data environments.

Preferred Qualifications :

- Familiarity with data governance frameworks and how data quality ties into governance processes.

- Experience working in environments that emphasize data accountability and clear data ownership across multiple teams and systems.

- Proficiency in data engineering languages (Java, Python, SQL, .) to support the creation and automation of data quality check patterns in multiple clients.

- Hands-on experience in capital markets, financial services, or similar high-performance data environments