Microsoft Principal Software Engineer 

India, Telangana, Hyderabad 

668522971

You will be joining the Inference team that builds the model-serving platform for large models including the OpenAI generative models. We host models at the scale of Bing and Office and solve exciting problems on the intersection of AI and Cloud.

We are looking for a strong Software Engineer who is passionate about designing and building highly reliable, available platform to support model inferencing at scale. You will also be expected to work on high throughput/low latency scenarios and drive performance optimization capabilities.

Required and Preferred

• B Tech or M Tech in computer science, engineering, mathematics or a related field, or equivalent industry experience.
• 18+ years of software development experience. Work experience of running a real time service with high throughput and low latency requirements is a plus.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Responsibilities:

As an SME and architect in the team, you will work with a team of passionate engineers across the Azure inference areas to
• Design, implement, test, and operate key Azure AI services.
• Release features on time, with high quality, meeting functional, performance, scalability, and compliance requirements.
• Drive quality right from the design phase, evangelising best practices and engineering for scale.
• Solve problems relating to mission critical services and create solutions to prevent problem recurrence.
• Participate and drive live site for the services