pushing the boundaries of scale, performance, and reliability.
The AI Pre
We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. We are looking for candidates who:
- Are passionate about the infrastructure enabling large-scale AI model training
- Will thrive in a highly collaborative, fast-paced environment
- Have a high degree of craftsmanship and pay close attention to details
- Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies
- Effectively manage multiple responsibilities and can adjust to shifting priorities.
Responsibilities
- Design and develop Python and CUDA/HIP C code that enable distributed training of multimodal LLMs ingesting text, audio, images, or video data.
- Build and maintain cutting-edge infrastructure that can store and process the petabytes of data needed to power models.
- Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation.
- Collaborate with the product team and other engineers and researchers across Microsoft AI to identify gaps in the current generation of models.
- Embody ourand
Required/Minimum Qualifications
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work
- OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work
- Experience with HPC (High performance computing) and/ or parallel programming?
- Experience in the area of pretraining
- Experience working with GPU clusters