The point where experts and best companies meet
Apple ML Engineer - Evaluation Automation United States, California, Cupertino 183063575
Yesterday
Share
Apple has an extraordinary reputation for product quality. We are looking for a talented Machine Learning Engineer with a strong background in Large Language Models (LLMs) to build the next generation ML evaluation frameworks and tools. In this role, you will leverage LLMs and other ML techniques to help automate large-scale data generation and evaluation job execution on server or on device, build LLM judges, detect anomalies, and streamline ML evaluation workflows.This is a high-impact role where you'll work at the intersection of AI/ML, conversational agents, information retrieval, software engineering, and ML evaluation, helping us push the boundaries of how AI can transform ML evaluation.
Design and develop machine learning and LLM-based solutions for ML model and system evaluation use cases such as:Automatic large scale data generationAutomatic UI and Non UI test evaluationRun evaluation jobs at scaleBuild and optimize LLM judgesIntelligent log summarization and anomaly detection
- 3+ years of experience in machine learning, including hands-on work with LLMs.
- Strong programming skills in Python and experience with ML/NLP libraries
- Experience building or fine-tuning LLMs for software engineering tasks
- Understanding of prompt engineering, and retrieval-augmented generation (RAG)
- Experience developing LLM based automated evaluation frameworks
- Excellent knowledge of software testing methodologies & practices
- Experience in Swift/XCTest/XCUITest is preferred
- Ability to thrive in a collaborative working environment within your team and beyond
- Ability to triage problems, prioritize accordingly, and propose a resolution
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
These jobs might be a good fit
