Microsoft Principal Data Scientist 

Taiwan, Taoyuan City 

782863325

This role is available inor
Redmond, WA.

In this role as a Principal Data Scientist, you will work to improve online metrics that evaluate Product quality in A/B testing and non-A/B testing situations. You will apply sophisticated statistical methods and large language models (LLMs) combined with human labels to conduct thorough evaluations of Bing’s Search Product through the lens of metrics. Your expertise will guide Bing’s product quality assessments, and user satisfaction measurement.

Required Qualifications:

• Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND5+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • ORMaster's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND7+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • ORBachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND10+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • ORequivalent experience.

• 5+ years experience programming experience utilizing Python, R or Big Data environments

Preferred Qualifications:

• Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND8+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • ORMaster's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND10+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • ORBachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND12+ years data-science experience (e.g., managingstructured and unstructured data, applying statistical techniques and reporting results)
  • OR equivalent experience.

• Experience with Statistical modeling, A/B experimentation and building metrics for large scale user facing Artificial Intelligence products.
• Experience with machine learning.
• Experience with real world system building and data collection, including design, coding and evaluation
• Experience using LLMs (Large Language Models) to build reliable metrics & gather insights
• Customer focused, strategic, drives for results, is self-motivated, and has a propensity for action
• Fantastic problem solver: ability to solve problems that the world has not solved before

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

Develop and refine metrics to assess the performance and effectiveness of our Generative SERP experience. Ensure these metrics capture user satisfaction, accuracy, and overall interaction quality.

Develop ML/Statistical models to measure/predict the quality of online content and/or user interactions with large-scale AI systems.
Experimental Design: Think critically about experimental design & develop innovative strategies and products in these areas to improve the quality of A/B experimentation

Translate strategy into plans that are clear and measurable, with progress shared out to stakeholders.