Finding the best job has never been easier
Apple Human Centered AI - Data Scientist ASE Singapore 380901502
06.05.2025
Share
Responsibilities include:- Create evaluation task design and guidelines; identify a relevant data annotation platform to run evaluations at scale.- Implement metrics to measure the effectiveness and accuracy of models to ensure they meet performance standards.- Monitor LLM performance in production environments through human evaluations, identifying trends, and raising alerts when quality degradation occurs. - Perform detailed failure analysis to understand model weaknesses and identify areas for improvement, offering actionable insights to engineers- Maintain high standards for data quality and continuously enhance processes based on both quantitative and qualitative feedback
- Experience with machine learning concepts, including model evaluation metrics, and data analysis. Proven data analysis expertise using SQL, Python, and Tableau to deliver actionable insights
- Experience with Large Language Models and evaluation techniques
- Fluency in English reading, writing and comprehension skills to partner with international teams
- Fluent in either Chinese, Japanese, Hindi, Korean, French, Spanish, to support the language specific market
- Cultural understanding of one of the above mentioned language markets to accurately represent user experience in early development cycles
- Ability to analyze complex issues, and identify potential problems with LLM outputs to improve quality with keen attention to detail
- Effective collaboration with cross-functional teams to define ML/LLM evaluation requirements
- Experience crafting, conducting, analyzing, and interpreting experiments and investigations
- Excellent communication skills
- Flexibility to work early morning or late night shift patterns required
These jobs might be a good fit
