You will own the Evaluation engineering data tools roadmap for Siri and Information Intelligence features. You will lead the development of experimental testing tools, with a focus on evaluation and statistical testing and E2E view. Develop and apply various statistical approaches to building E2E test sets. Explore production data to discover gaps in testing. Own failure triage automation; focuses on significantly improving failure actionability. Lead systems integration testing, complete with test plan and tools development (client/server and data/server). Develop success criteria for QE tools testing, and oversees such testing execution and feedback to engineering partners. Think tirelessly of strategic and creative ways to evaluate and improve Siri user experience, and drives the team to work towards this shared goal. Build the team on the foundation of excellence, professional growth, inclusivity, and respect.