24 Evaluator Jobs

Responsibilities

Are you interested in working in one of the most impactful areas of technology in the world today? Do you want to build generative AI skills while working on a project to transform the most mission-critical IT workloads for organizations that power the global economy? Come join the team that is at the intersection of cutting-edge gen AI and mainframe software development, a key strategic pillar for IBM. This role is tailor-made for mainframe professionals eager to embrace the future, and you'll work at the crossroads of trusted mainframe technology and the transformative potential of AI, building solutions that power enterprise modernization.

As a Gen AI Model trainer you will create training material which will be used to train an LLM on how to explain or transform code. This training material will be used to aid conversion from source language to English or other industry standard language. Futhermore, you will involve in Model ranking and advice on Model improvements and prompting.


Required education
Bachelor's Degree

Preferred education
Master's Degree

Required technical and professional expertise

5+ years of Industry experience

Minimum of 5 years of recent industry experience programming in PL/I

Outstanding communication and collaboration skills

Demonstrated ability to work with remote teams

Preferred technical and professional experience

Any prior COBOL/Java/HLASM programming experience

Exposure to Agile methodology

Experience with program analysis. This would involve working with static analysis information, abstract syntax trees, control flow graphs, and variable dependency analysis.

Exposure to LLMs and prompt engineering