ETL Test Engineer - Data Quality & Validation (5-7 yrs)

Role : ETL Test Engineer

Job Description :

As an ETL Test Engineer, you will be responsible for ensuring the quality and accuracy of data pipelines and data transformations. You will work closely with data engineers and analysts to validate data sources, ETL processes, and target systems.

Key Responsibilities :

Test Planning and Design :

- Develop comprehensive test plans and test cases to cover all aspects of ETL processes.

- Identify test scenarios to ensure thorough testing coverage.

Test Execution :

- Execute manual and automated tests to verify data accuracy, completeness, and consistency.

- Monitor data pipelines and identify potential issues.

Test Automation :

- Develop and maintain automated test scripts using appropriate tools.

- Integrate automated tests into CI/CD pipelines.

Data Validation :

- Validate data quality and integrity throughout the ETL process.

- Perform data profiling and data cleansing activities.

Performance Testing :

- Conduct performance testing to identify bottlenecks and optimize data pipelines.

- Analyze performance metrics and provide recommendations.

Issue Tracking and Reporting :

- Track and manage defects and issues.

- Generate detailed test reports and metrics.

Collaboration :

- Work closely with data engineers, analysts, and business stakeholders.

- Provide feedback on data quality and process improvements.

Required Skills and Experience :

- Strong understanding of ETL processes and data warehousing concepts.

- Experience with data integration tools (i.e., Informatica PowerCenter, Talend, Apache Airflow).

- Proficiency in SQL and database concepts.

- Knowledge of data quality and data profiling techniques.

- Experience with testing methodologies and frameworks (i.e., TestNG, JUnit).

- Understanding of CI/CD pipelines and automation tools.

- Strong analytical and problem-solving skills.

- Excellent communication and interpersonal skills.

Preferred Skills :

- Experience with cloud platforms (AWS, Azure, GCP).

- Knowledge of data visualization tools (i.e., Tableau, Power BI).

- Experience with scripting languages (Python, Shell)