Microsoft Research Intern - LLM Inference Acceleration Optimization 

United States, Washington 

123629734

• Accepted or currently enrolled in a PhD program in Computer Science or related STEM field.
• At least 6 months of experience with training and/or inference of recent LLMs like Llama and Phi.

Other Requirements

• Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
• In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.

• Experience with large-scale collective communication on GPUs.
• Experience with performance benchmarking of AI frameworks like Pytorch, vLLM, and/or SGLang.
• Ability to convert research ideas into working code that runs and scales on real systems.
• Proficient interpersonal skills and growth mindset.
• Open to failing fast in pursuit of ambitious ideas.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: