Upload Button Icon Add office photos
filter salaries All Filters

1 DhiWise Job

Senior QA Engineer

5-10 years

Surat

1 vacancy

Senior QA Engineer

DhiWise

posted 6mon ago

Job Description

We are looking for a Senior QA Engineer to join our team at DhiWise, where we are building an innovative GenAI-powered SDLC automation platform. In this role, you will lead the testing efforts to ensure the accuracy, relevance, and reliability of AI-generated outputs. Youll work closely with our AI/ML and development teams to design and execute test plans that validate the performance of AI models, automate testing, and continuously improve the quality of AI-driven results. If you have experience in AI/ML testing and want to shape the future of GenAI in software development, wed love to hear from you!
Key Responsibilities:
  • Lead the testing strategy for GenAI-powered features of the SDLC automation platform, focusing on the relevance and accuracy of AI-generated results.
  • Design and implement comprehensive test plans for GenAI features, including use-case validation, model performance testing, and output validation for correctness and consistency.
  • Collaborate closely with the AI/ML and development teams to define quality standards for GenAI features, ensuring they align with user expectations and business goals.
  • Develop test scripts to automate the validation of AI-generated code, ensuring the correct application of business logic, coding standards, and security protocols.
  • Evaluate AI models for their performance across diverse scenarios, continuously testing for edge cases and data biases.
  • Conduct manual and automated testing to validate the integration of GenAI features with other platform components, ensuring seamless functionality.
  • Provide feedback on the improvement of AI models based on test results, working iteratively with AI engineers to enhance accuracy and reliability.
  • Perform continuous evaluation of GenAI model relevance, assessing results for errors, hallucinations, and unwanted behavior, and collaborating with the product team to adjust the scope of features.
  • Lead exploratory testing for new features, identifying potential failure points, and ensuring high-quality releases.
  • Participate in AI model monitoring post-deployment to ensure ongoing accuracy and relevance of generated content as data evolves.
Key Skills Requirements:
  • Experience: 5+ years in software quality assurance, with a minimum of 2+ years focused on testing AI/ML platforms or GenAI models.
  • In-depth understanding of AI/ML testing frameworks and methodologies, including model validation, bias testing, and relevance assessment.
  • Hands-on experience testing AI/ML-driven applications, focusing on generated output quality, including accuracy, relevance, and user satisfaction.
  • Strong proficiency in test automation tools (e.g., Selenium, Appium, JUnit) and scripting languages (e.g., Python, Java) for testing AI-based platforms.
  • Experience in evaluating AI models for correctness and relevance, including testing for edge cases and unexpected results.
  • Familiarity with CI/CD pipelines and automated testing in a GenAI context.
  • Ability to collaborate effectively with AI/ML teams, providing feedback on model performance and quality improvements.
  • Problem-solving mindset with a focus on identifying weaknesses or inaccuracies in AI-generated outputs.
  • Bachelor s degree in Computer Science, Engineering, or related field (or equivalent experience).
Preferred Qualifications:
  • Experience with testing GenAI platforms, including text, code, or image generation applications.
  • Knowledge of model training techniques and how they affect output variability and accuracy.
  • Experience with cloud infrastructure testing (AWS, Azure, or GCP), especially for AI services.
  • Understanding of Natural Language Processing (NLP) and how it impacts the quality of generated results.
  • Familiarity with A/B testing frameworks for AI model performance evaluation.
  • ISTQB or equivalent certification is a plus.
Why Join DhiWise
  • Be a key player in the development of a transformative GenAI-driven SDLC automation platform.
  • Work at the cutting edge of AI and software automation, with a focus on real-world use cases and impact.
  • Opportunity for professional growth and leadership in a rapidly evolving domain.
 
 

Employment Type: Full Time, Permanent

Read full job description

What people at DhiWise are saying

DhiWise Benefits

Cafeteria
Work From Home
Education Assistance
Health Insurance
Job Training
Free Transport +6 more
View more benefits

Compare DhiWise with

Amazon Sellers Services

4.0
Compare

Primus Global Technologies

3.9
Compare

GAMMON INDIA

3.8
Compare

Practo

3.1
Compare

Magneti Marelli Motherson Auto System

3.8
Compare

TriGeo Technologies

3.2
Compare

Educomp Solutions

3.5
Compare

HBL Global

3.9
Compare

Namaste India Foods

3.8
Compare

Rao IIT Academy

3.7
Compare

Bhagwati Products

3.8
Compare

InsanelyGood

4.1
Compare

Flipkart Wholesale

3.9
Compare

Busibud

4.0
Compare

Deenanath Mangeshkar Hospital

4.1
Compare

Baoiam Innovations

4.5
Compare

Tradeshala

4.5
Compare

Recipharm Pharmaservices

3.9
Compare

Patil Group

3.9
Compare

KHY ELECTRONIC

3.7
Compare

Similar Jobs for you

Senior QA Engineer at Rheo AI

Chennai

3-8 Yrs

₹ 7-11 LPA

Senior QA Engineer at International Centre for Excellence (ICE)

Hyderabad / Secunderabad

4-8 Yrs

₹ 6-10 LPA

Senior QA Engineer at Sky Systems, Inc

Pune

2-5 Yrs

₹ 5-9 LPA

Senior QA Engineer at Capsilon Corporation.

Hyderabad / Secunderabad

5-9 Yrs

₹ 7-11 LPA

Senior QA Engineer at Quantiphi Analytics Solutions Pvt. Ltd.

Mumbai, Bangalore / Bengaluru + 1

3-7 Yrs

₹ 8-13 LPA

QA Lead at MAGICMIND TECHNOLOGIES LIMITED

Kolkata

5-8 Yrs

₹ 7-10 LPA

Senior QA Engineer at RELQ TECHNOLOGIES

Chennai

4-8 Yrs

₹ 6-10 LPA

Senior QA Engineer at tredence

Bangalore / Bengaluru

4-8 Yrs

₹ 9-14 LPA

Senior QA Engineer at HASpaces

Kochi, Thrissur + 2

8-10 Yrs

₹ 7-11 LPA

Senior QA Engineer at ajm softwares

Pune

2-5 Yrs

₹ 4-8 LPA

Senior QA Engineer

5-10 Yrs

Surat

6mon ago·via naukri.com
write
Share an Interview