Finding the best job has never been easier
Apple ML Framework MetalLM Engineer United States, West Virginia 312786465
Yesterday
Share
Responsibilities:Work on cutting-edge ML inference framework project and optimize code for efficient and scalable ML inference using distributed compute strategies such as data, tensor, pipeline and expert parallelism.Develop kernel and compiler level optimizations and perform in-depth analysis to ensure the best possible performance across Server hardware families.Apply advanced model optimization techniques including speculation, quantization, compression, and others to maximize throughput and minimize latency.Analyze and improve performance metrics such as end-to-end latency, TTFT, TBOT, memory footprint, and compute efficiency.Implement features of Metal device backend for ML training acceleration technologies
- 3+ years of programming and problem-solving experience with C/C++/ObjC
- Experience with GPU kernel development & optimizations using compute programming models such as Metal, CUDA etc.
- Experience with system level programming and computer architecture
- Experience with Distributed training or inference techniques
- Experience with graph compilers such as Triton, OpenXLA or LLVM/MLIR is a plus
- Contributions to an AI framework such as PyTorch, JAX or Tensorflow is a plus
- Good understanding of machine learning fundamentals
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
These jobs might be a good fit
