Software Quality Assurance Engineer - AI Feature Validation & Testing (5-8 yrs)

Overview :

We are seeking a highly skilled and experienced Software QA Engineer to join our dynamic team.

This role is critical in ensuring the quality and reliability of our cutting-edge AI-driven software solutions.

The ideal candidate possesses a strong background in software quality assurance with a focus on AI feature validation, particularly Generative AI.

You will be responsible for designing and executing comprehensive test strategies, validating AI models, and ensuring software quality within a cloud-based (AWS) and CI/CD environment.

This position requires a proactive individual with excellent analytical and problem-solving skills, and a passion for delivering high-quality software.

Key Responsibilities :

- Test Strategy & Planning : Develop and execute comprehensive test plans and test cases for AI-driven features, including functional, performance, and security testing.

- AI Model Validation : Design and implement test methodologies for validating AI models, including data preprocessing, model training, model responses, and overall model performance. This includes evaluating accuracy, bias, and robustness.

- Automation Development : Create and maintain robust and scalable automated test scripts using Selenium, Python, and the Robot Framework. Extend and enhance existing automation frameworks as needed.

- Test Execution : Conduct both manual and automated testing, including functional testing, regression testing, stress testing, load testing, and user acceptance testing (UAT).

- Defect Management : Work closely with developers to identify, debug, and track issues, and validate bug fixes. Utilize a bug tracking system (e.g, Jira).

- CI/CD Integration : Integrate automated tests into the CI/CD pipeline (Jenkins, GitLab) to ensure continuous quality and rapid feedback.

- Cloud Environment : Work within an AWS cloud environment, understanding its components and their impact on testing.

- Agile Methodology : Participate actively in Agile ceremonies (sprint planning, daily stand-ups, retrospectives) and contribute to a collaborative team environment.

- Documentation : Create and maintain clear and concise documentation related to test plans, test cases, test results, and defect reports.

- Performance Testing : Design and execute performance tests to evaluate the responsiveness, stability, and scalability of the application.

- Collaboration : Collaborate effectively with cross-functional teams, including developers, product managers, and other stakeholders.

Requirements :

Mandatory Skills :

- 5+ years of proven experience in software QA, with a specific focus on AI feature validation and testing.

- Deep understanding and expertise in Generative AI validation and AI testing methodologies.

- Strong proficiency in automation testing using Selenium and Python (with the Robot Framework).

- Hands-on experience with CI/CD tools (Jenkins, GitLab).

- Solid understanding of Linux operating systems and command-line interface.

- Experience with database testing (e.g, SQL).

- Practical knowledge of cloud technologies, specifically AWS.

- Excellent analytical and problem-solving skills, with a keen attention to detail.

- Strong communication and collaboration skills.

Preferred Skills :

- Experience with additional automation frameworks (e.g, Appium, Cypress).

- Exposure to networking concepts and protocols.

- Knowledge of performance testing tools (e.g, JMeter, LoadRunner).

- Familiarity with containerization technologies (e.g, Docker, Kubernetes).

- Experience with API testing (e.g, Postman).

- ISTQB certification (or equivalent)