We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. In particular, we are looking for candidates who:
- Are passionate about the role of data in large-scale AI model training
- Will thrive in a highly collaborative, fast-paced environment
- Have a high degree of craftsmanship and pay close attention to details
- Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies
- Effectively manage multiple responsibilities and can adjust to shifting priorities.
Responsibilities
- Design and develop data pipelines that ingest enormous amounts of multi-modal training data (text, audio, images, video).
- Build and maintain cutting-edge infrastructure that can store and process the petabytes of data needed to power models.
- Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation.
- Collaborate with the product team and other engineers and researchers across Microsoft AI to identify gaps in the current generation of models.
- Embody our and .
Required/Minimum Qualifications
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modelling or data engineering work
- OR equivalent experience.
- Expertise in large scale data engineering ideally applied to AI
- Expertise in Spark, Kubernetes or similar.