IBM Gen AI Content Evaluator Team Lead 

India, Karnataka, Bengaluru 

306594674

• “Roles and Responsibilities
• Leading across both BaaS and EaaS. Driving the future roadmap – how can we improve? How can we extend what we are doing to handle use cases beyond C2J and Code Explanation?
• Keep abreast of technological advances in the area of benchmarking and evaluation in GenAI and adopt our framework and processes to take advantage.
• You will be responsible to incrementally improving our measurement and analysis over time.””
• As a senior leader, you will contribute to the design of the evaluation and benchmarking strategy and provide ongoing analysis and metrics on current performance. This may include proving updates to senior management.
• You will be responsible for advancing techniques used to evaluate performance as well as metrics.
• Drive efficiencies in the current process.
• Be able to co-ordinate work across the teams in Haifa doing the evaluators, the language specialists, and teams in UK and US.”

Required Technical and Professional Expertise

• Experience with software build technologies
• Experience in creating, modernising and supporting robust CI/CD pipelines
• Strong Automation and CI/CD skill set (Eg:Tekton)
• Strong hands-on experience in Java
• Hand on expereience on Golang or Python
• Experience on Containerisation and Kubernetes (Some knowledge of deployments, Statefulsets, PVC, etc)
• Experience in developing automation strategies and designing automated systems that meet the specific requirements of the organization.
• Understanding of test automation frameworks and integrations with multiple tools.
• Strong communication, logical thinking, and analytical skills.`
• Experience setting architecture direction and driving improvements into the technology/processes,”

Preferred Technical and Professional Expertise

• Z experience – Cobol, JCL, CICS, DB2
• Agile Development Model awareness & experience (edited) ”