We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. We are looking for candidates who:
- Are passionate about the infrastructure enabling large-scale AI model training
- Will thrive in a highly collaborative, fast-paced environment
- Have a high degree of craftsmanship and pay close attention to details
- Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies
- Effectively manage multiple responsibilities and can adjust to shifting priorities.
Responsibilities
- Design and develop Python and CUDA/HIP C code that enable distributed training of multimodal LLMs ingesting text, audio, images, or video data.
- Build and maintain cutting-edge infrastructure that can store and process the petabytes of data needed to power models.
- Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation.
- Collaborate with the product team and other engineers and researchers across Microsoft AI to identify gaps in the current generation of models.
- Embody our and .
Required/Minimum Qualifications
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work
- OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work
- Experience with HPC (High performance computing) and/ or parallel programming?
- Experience in the area of pretraining
- Experience working with GPU clusters