Senior Software Engineer - ETL/Datawarehouse Testing/Python (7-9 yrs)

Job Description : Senior Software Engineer - ETL Testing with Python

Location : Pune, Maharashtra, India

Company : RiDiK (A Subsidiary of CLPS Incorporation, Nasdaq: CLPS)

About RiDiK :

RiDiK, a subsidiary of CLPS Incorporation (Nasdaq: CLPS), is a leading technology solutions provider, committed to delivering innovative and high-quality services to our global clients. We are expanding our team in Pune and seeking a highly skilled and experienced Senior Software Engineer specializing in ETL Testing with Python to join our dynamic team.

Position Overview :

As a Senior Software Engineer in ETL Testing with Python at RiDiK, you will be responsible for designing, developing, and implementing robust automation frameworks for testing data pipelines, ETL processes, and Business Intelligence reports. You will leverage your expertise in Python, SQL, and cloud technologies to ensure the quality and reliability of our data-driven applications. This role requires a strong understanding of data warehousing concepts, excellent problem-solving skills, and a passion for automation.

Responsibilities :

- Design, develop, and deploy scalable and maintainable automation frameworks using Python for ETL, data pipeline, and API testing.

- Own and drive technology stack evaluation and proof of concepts for automation initiatives.

- Develop and maintain automation scripts for web, database, and API applications.

- Perform comprehensive ETL/Data warehouse backend testing to ensure data integrity, accuracy, and consistency.

- Develop and execute complex SQL queries for data validation and verification.

- Test data transformations, data loading processes, and data quality checks.

- Validate data consistency across different data sources and targets.

- Conduct thorough testing of Business Intelligence reports using tools like Tableau or similar platforms.

- Verify the accuracy and performance of reports, dashboards, and visualizations.

- Test report data sources, calculations, and filters.

- Develop and execute automated API tests to validate API functionality, performance, and security.

- Utilize tools and frameworks for API testing (Postman, Requests library).

- Utilize test management tools (HP Quality Center, JIRA) for test planning, execution, and defect tracking.

- Manage end-to-end automated test case management, reporting, and bug tracking.

- Work closely with application development, architecture, and infrastructure teams to ensure seamless integration of automation processes.

- Participate in code reviews and provide constructive feedback.

- Communicate effectively with stakeholders and provide regular updates on testing progress.

- Utilize AWS services for testing and deployment.

- Contribute to the testing of ML Ops systems and ML/AI-based software and data outputs.

- Work within an Agile/Scrum environment, participating in sprint planning, daily stand-ups, and retrospectives.

- Contribute to continuous improvement of the testing process.

Required Skills and Experience :

- Education : Master's degree in computer science, Software Engineering, or a related field.

- Experience : 7+ years of automation testing experience, preferably in a product organization.

- Proficient in Python for automation framework development.

- Strong SQL skills, with the ability to write and interpret complex queries.

- Extensive experience in ETL/Data warehouse backend testing.

- Strong knowledge of data warehousing concepts and principles.

- Experience with databases like Vertica, Oracle, or Teradata.

- Experience in Business Intelligence testing using tools like Tableau or similar platforms.

- Adept in API testing using relevant tools and frameworks.

- Experience with test automation frameworks such as JUnit, Selenium, DBUnit, TestNG.

- Experience developing automation frameworks for web, data pipeline, and API applications.

- Experience with test management and defect tracking tools (HP Quality Center, JIRA).

- Working knowledge of AWS.

- Experience with version control systems (Git).

- Proficient experience working with SDLC and Agile methodologies.

- Strong comprehension, analytical, and problem-solving skills.

- Excellent communication and interpersonal skills.

- Ability to work independently and as part of a team. -

Preferred Qualifications :

- Prior experience in ML Ops systems.

- Knowledge of testing data science projects.

- Experience with testing ML/AI based software and data output.

- Strong knowledge of enterprise application architecture and technologies, including databases, web, web services, and reporting.

- Experience in end-to-end automated test case management, reporting and bug tracking.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on challenging and innovative projects.

- Collaborative and supportive work environment.

- Opportunities for professional growth and development. -

- Exposure to global clients and projects.