Add office photos
All Filters
43 NASDAQ Jobs
Test Automation Senior Specialist (AI Testing)
4-7 years
Bangalore / Bengaluru
1 vacancy
Test Automation Senior Specialist (AI Testing)
NASDAQ
posted 2mon ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
- Develop and maintain comprehensive automated test suites for generative AI models, including language models, and multimodal systems.
- Create innovative testing strategies to validate the quality, coherence, and safety of AI-generated content.
- Design and implement automation frameworks to test generative AI products across multiple platforms and use cases.
- Collaborate closely with AI researchers, data scientists, and product developers to understand product requirements and unique testing challenges of generative systems.
- Develop tools and scripts to generate diverse test data sets and simulate real-world generative AI scenarios.
- Implement automated tests for prompt engineering, fine-tuning processes, and model versioning.
- Continuously improve testing methodologies to keep pace with rapidly evolving generative AI technologies.
- Analyze test results and provide detailed reports on model performance, potential biases, and areas for improvement.
- Bachelors or Masters degree in Computer Science, AI/ML, or related technical field.
- Minimum 5+ years of experience in software test automation, with at least 2 years focused on AI/ML systems, preferably generative AI.
- Strong programming skills in Python.
- Expertise in test automation tools and frameworks suitable for AI testing tools/frameworks like RAGAS, Deep eval, TrueLens, AWS Bedrock Evaluator, pytest, Robot Framework.
- Hands-on experience/knowledge of AI frameworks like Langchain or LlamaIndex.
- In-depth understanding of natural language processing, computer vision, and generative AI concepts.
- Experience with large language models (e.g., GPT family, BERT).
- Familiarity with prompt engineering and techniques for evaluating generative AI outputs.
- Knowledge of ethical AI principles and experience in testing for bias and fairness in AI systems.
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Senior Specialist roles with real interview advice
People are getting interviews at NASDAQ through
People are getting interviews through
(based on 15 NASDAQ interviews) What people at NASDAQ are saying
Rating based on 1 Senior Specialist
review
Anonymous · Operations / Strategy
in Bengaluru/Bangalore
Got an opportunity to work with a global brand
No job security
Read 1 reviewSenior Specialist salary at NASDAQ
What NASDAQ employees are saying about work life
NASDAQ Benefits
View more benefits
Compare NASDAQ with
Bombay Stock Exchange
Reliance Industries
TCS
Infosys
HDFC Bank
Wipro
ICICI Bank
HCLTech
Axis Bank
Tech Mahindra
Stock Holding Corporation of India
TMF Group
Travelex
Toppan Merrill Technology Services India
Go-Jek
ICE Data Services
Sumitomo Mitsui Banking Corporation
Dealmoney Securities
Manappuram Home Finance
CME Group
Similar Jobs for you
Test Automation Senior Specialist (AI Testing)
4-7 Yrs
Bangalore / Bengaluru
