Key responsibilities of this role are: - Making enhancements to the release process, automating nightly builds, and setting up scheduled CI runs for different levels of testing etc. - Making innovations in model testing and benchmarking (accuracy and latency), for various combinations of model types in different domains (vision, text, audio etc) and compression algorithms (quantization, pruning, palettization etc), discovering performance/accuracy trends, effects of various hyper parameters etc. - Finding innovative ways to reduce test time while maintaining high quality test coverage - Keeping the code base updated to work with the latest versions of Python, PyTorch, numpy etc. - Set up and debug training jobs, datasets, evaluation, performance benchmarking pipelines. Ability to ramp up quickly on new training code bases and run experiments. - Run detailed experiments and ablation studies to profile algorithms on various models, tasks, across different model sizes. - Improving model optimization documentation, writing tutorials and guides- Self prioritize and adjust to changing priorities and asks