Amazon Principal Data Scientist Customer Engagement Service - Science 

United States, Washington, Seattle 

410351342

Key job responsibilities
• Design end-to-end measurement frameworks for multi-turn conversations across text and voice interfaces
• Create benchmark datasets and metrics for core language tasks (intent detection, API execution, response generation, safety)
• Develop experimental methodologies connecting technical metrics to business outcomes
• Lead the development of real-time monitoring systems to detect model and system degradation
• Partner with scientists to establish offline and online evaluation frameworks that drive model improvements
• Analyze customer interaction patterns to identify optimization opportunities across self-service channels
• Guide strategic decisions through data-driven insights that connect UX design to business impact

• Master's degree in Computer Science, Statistics, or related quantitative field
• Rich experience in data science or machine learning
• Proven expertise in experimental design and causal inference
• Strong background in NLP evaluation metrics and benchmarking
• Experience with large-scale measurement systems and real-time monitoring
• Excellence in statistical analysis and hypothesis testing
• Track record of translating technical metrics into business insights

• PhD in Maths, Statistics, Operation Research, Computer Science and related technical fields
• Experience evaluating conversational AI or chatbot systems
• Expertise in voice quality metrics and speech recognition evaluation
• Background in customer experience analytics
• Knowledge of multi-modal and multi-lingual evaluation frameworks