Data Engineer (3-4 yrs)

Responsibilities :

- Collaborate with cross-functional teams to ensure quality and timely delivery of products.

- Identify areas of improvement in data quality processes and propose solutions to enhance data accuracy and reliability and create test strategies.

- Collaborate with the Data Delivery technology teams and architects to define and develop solutions.

- Collaborate with data engineering and development teams to implement data quality best practices and optimize data workflows.

- Develop and execute Data Quality frameworks, solutions and automated test cases for software applications to ensure the reliability of data pipelines and data transformations.

- End to end integration testing between multiple independent systems and interfaces (flat files, APIs (ETL)) etc.

- Utilize AWS services (EC2, Glue, Athena etc. to test data integration and migration processes.

- Conduct functional, integration, regression, and performance testing of database systems using industry standard technologies (SQL, NOSQL, Python, etc.)

- Create and maintain documentation of test plans, test cases and testing results, data quality issues, testing procedures, and resolutions.