Gen AI Content Evaluator

At IBM, work is more than a job - it's a calling:To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk Your Role and Responsibilities Are you interested in working in one of the most impactful areas of technology in the world today? Do you want to build generative AI skills while working on a project to transform the most mission-critical IT workloads for organizations that power the global economy? Come join the team that is at the intersection of cutting-edge gen AI and mainframe software development, a key strategic pillar for IBM.

As a Gen AI Content Evaluator, you will evaluate and benchmark the LLM and fine tune its performance. This may include contributions to the automated evaluation pipeline in addition to advancing techniques used to evaluate performance as well as metrics. In your role as an evaluator, you will contribute new and innovative ideas towards improving our evalation and benchmark criteria.

Required Technical and Professional Expertise

Outstanding communication and collaboration skills, Minimum of 2 years of industry experience programming in JAVA, Demonstrated ability to work with remote teams

Preferred Technical and Professional Expertise

Exposure to Agile methodology