Data Validation Specialist - Snowflake (7-12 yrs)

Overview :

Primary responsibility will be to ensure the accuracy, integrity, and consistency of data within the organization's databases and systems. You will work closely with cross-functional teams to implement data validation processes and procedures, ensuring that data entered into the system meets predefined standards and requirements.

Responsibilities :

- Develop and implement data validation rules and procedures to ensure the accuracy and integrity of data between two different environments.

- Collaborate with developers to integrate data validation checks into the back-end systems and processes.

- Design and execute automated tests to validate data quality and identify anomalies or errors.

- Analyze data validation results and troubleshoot issues to determine root causes and implement corrective actions.

- Develop and maintain documentation related to data validation processes, including validation rules, test cases, and procedures.

- Work with cross-functional teams to define data quality standards and requirements.

- Monitor data quality metrics and trends and provide recommendations for continuous improvement.

Qualifications :

- Bachelor degree in computer science, information technology, or a related field.

- Proven experience in back-end data validation, data quality assurance, or a similar role.

- Snowflake experience with strong understanding of database concepts, SQL, data modeling, and ETL processes.

- Should have experience with ETL informatica Power Center, DataStage, shell scripting.

- Ability to analyze complex data sets and troubleshoot data-related issues.

- Experience with data validation tools and techniques, such as regular expressions, data profiling, and data cleansing.

- Proficiency in scripting or programming languages (e.g., Python, Java) for automation.

- Excellent analytical and problem-solving skills, with a keen attention to detail.

- Strong communication and collaboration skills, with the ability to work effectively in a team environment.

- Experience with Agile development methodologies is a plus.

- Familiarity with reporting platforms and tools, and data visualization tools is a strong plus.

Key Responsibilities :

Data Validation :

- Design, develop, and execute data validation procedures to ensure data integrity and accuracy across Snowflake-based data warehouses and databases.

- Identify and resolve discrepancies, anomalies, or inconsistencies in data by performing both automated and manual validation checks.

- Work with data engineers to develop and automate data validation processes, such as checks for missing values, outliers, and data type mismatches.

Data Quality Assurance :

- Monitor and enforce data quality standards for datasets within Snowflake.

- Define data quality metrics and set up data validation rules for both batch and real-time data.

- Perform regular data audits and reconciliation tasks to ensure the quality of data loaded into Snowflake.

- Track and report on data quality issues and collaborate with teams to resolve them in a timely manner.

Collaboration and Stakeholder Engagement :

- Collaborate with data engineers and business analysts to understand data requirements and validate that data meets business and analytical needs.

- Work with stakeholders to document data validation processes and create best practices for data governance and quality.

- Provide insights into data integrity issues and suggest improvements or enhancements.

Snowflake-Specific Responsibilities :

- Utilize Snowflake's features (e.g., data loading, transformation, and querying) to validate and audit data effectively.

- Develop and implement Snowflake-based SQL queries for data validation and quality assurance tasks.

- Troubleshoot data loading and transformation issues in Snowflake and ensure data is accurately populated.

Automation and Tool Development :

- Build and maintain automated scripts, tools, and dashboards for ongoing data validation tasks.

- Implement ETL pipeline validations and ensure data consistency during migration and transformation.

Documentation & Reporting :

- Document data validation procedures, rules, and best practices.

- Prepare reports on data quality, trends, and issues for internal and external stakeholders.

- Provide training and support to other teams on data validation techniques and tools.

Required Skills and Qualifications :

Experience :

- Minimum 3-5 years of experience in data validation, data quality assurance, or data engineering.

- Strong experience working with Snowflake (both on the cloud and data validation aspects).

- Solid experience writing complex SQL queries for data analysis and validation.

- Familiarity with ETL processes and tools (e.g., Talend, Informatica, Apache Airflow).

Technical Skills :

- Expertise in using Snowflake for data management, including querying, data transformation, and data governance.

- Knowledge of cloud computing environments and data warehousing best practices.

- Proficiency in SQL, including advanced querying and data transformation techniques.

- Experience with data validation tools, scripting languages (e.g., Python, Bash), and test automation frameworks.

- Analytical and Problem-Solving Skills :

- Strong analytical skills with the ability to troubleshoot and identify data discrepancies.

- Detail-oriented with an ability to identify, investigate, and resolve data-related issues quickly.