6 Billennium Jobs

- Experience: 4+ years of experience in software testing, with at least 1 year focused on genAI applications

- Technical Skills: Strong proficiency in Python and testing frameworks (e.g., pytest, unittest); experience with AI testing tools and frameworks

- AI/ML Knowledge: Understanding of LLM architectures, RAG systems, and common failure modes in AI applications; familiarity with evaluation metrics for generative AI

- Test Automation: Experience with test automation frameworks and CI/CD pipelines; ability to design and implement automated testing solutions for AI applications

- Ability to analyze requirements, identify test scenarios, and prioritize testing activities based on risk and impact

- Cloud Platforms: Practical experience with testing applications on cloud platforms (AWS, Azure) and working with cloud-based AI services

- Monitoring Tools: Experience with monitoring and observability tools, log analysis, and performance metrics tracking (e.g. DataDog, Grafana)

- ALM tools: Experienced in ALM tools (e.g. Jira, GitLab, ServiceNow)

- Security Testing: Understanding of security testing methodologies, particularly in the context of AI applications