Amazon Software Engineer - AI/ML AWS Neuron Distributed Training 

United States, California, Cupertino 

149430832

Annapurna Labs was a startup company acquired by AWS in 2015, and is now fully integrated. If AWS is an infrastructure company, then think Annapurna Labs as the infrastructure provider of AWS. Our org covers multiple disciplines including silicon engineering, hardware design and verification, software, and operations. AWS Nitro, ENA, EFA, Graviton and F1 EC2 Instances, AWS Neuron, Inferentia and Trainium ML Accelerators, and in storage with scalable NVMe, are some of the products we have delivered, over the last few years.AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine
The ML Distributed Training team works side by side with chip architects, compiler engineers and runtime engineers to create , build and tune distributed training solutions with Trn1. Experience training these large models using Python is a must. FSDP, Deepspeed and other distributed training libraries are central to this and extending all of this for the Neuron based system is key.Key job responsibilitiesWork/Life Balance
Mentorship & Career Growth

- 3+ years of building complex software systems experience
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
- Experience optimizing machine learning workloads

- Master's degree in computer science or equivalent
- Experience with writing high performance CUDA kernels, internals of Megatron/FSDP/Deepspeed/GSPMD
- Experience with building roofline models to improve performance
- Experience training large models at scale