Microsoft Data Scientist II 

Taiwan, Taoyuan City 

325316110

Required Qualifications:

• 4+ years of experience in machine learning/data science and business intelligence.
• Proven track record in experimentation, causal analysis and developing machine learning systems for business use-cases, root-cause analysis and data visualization techniques.
• Strong experience with cloud platforms (Azure preferred) and infrastructure as code (e.g., Terraform, ARM templates).
• Demonstrated ability to lead initiatives, mentor junior team members, and influence cross-functional teams.
• Hands-on experience in building and deploying ML models in a cloud environment (preferably Azure).
• Programming experience in R, Python and big data environments.
• Understanding of CI/CD tools and workflows (Azure DevOps, GitHub Actions).
• Strong experience in model monitoring, retraining, and setting up complex experiments to measure business results.

Preferred Qualifications:

• Experience with Statistical modeling, A/B experimentation and building metrics for large scale user facing Artificial Intelligence products.
• Experience with human-in-the-loop machine learning.
• Experience with real world system building and data collection, including design, coding and evaluation.
• Experience using LLMs (Large Language Models) to build reliable metrics & gather insights.
• Customer focused, strategic, drives for results, is self-motivated, and has a propensity for action.
• Fantastic problem solver: ability to solve problems that the world has not solved before.
• Knowledge of responsible AI practices, including fairness, transparency, and bias mitigation.
• Strong communication skills and the ability to work in a fast-paced, collaborative environment.

We are looking for a highly motivated and skilled Data Scientist II to join our team. The ideal candidate will have a strong background in one or more of the following areas: Experimentation, Causal Analysis, Applied AI/ML techniques for propensity modelling, customer segmentation, AI agent development and evaluation. You will be working with data scientists, software engineers, and product teams to ensure the models are secure, reliable, and performant.

• General Product quality measurement: Define, invent, and deliver metrics that accurately measure the quality of online information and the satisfaction/success of our customers.
• A/B testing: Design and implement A/B testing to evaluate the impact of changes to our products and services. Analyze results to provide actionable insights and drive continuous improvement.
• RAG based evaluation and measurement: Develop and refine metrics to assess the performance and effectiveness of AI Agents and Copilot Services. Ensure these metrics capture user satisfaction, accuracy, and overall interaction quality.
• ML Models: Develop ML/Statistical models to measure/predict the quality of online content and/or user interactions with large-scale AI systems.
• Experimental Design: Think critically about experimental design & develop innovative strategies and products in these areas to improve the quality of A/B experimentation.
• Business Intelligence and Strategy: Translate strategy into plans that are clear and measurable, with progress shared out to stakeholders. Build actionable and automated deep-dive capabilities to support decision making.
• Cooperation: Partner effectively with program management, engineers, and other areas of the business.