Develop, implement, and refine robust evaluation frameworks that align AI model performance with user needs and goals. Collaborate closely with data scientists, engineers, and cross-functional teams to ensure comprehensive assessment across various modalitiesLead and manage user research programs, leveraging diverse methodologies to gather actionable user insights. Work closely with UX researchers to ensure that user feedback is systematically integrated into model training and evaluation processesDesign and execute large-scale data collection efforts, ensuring the acquisition of high-quality, diverse datasets critical for AI model development. Coordinate with engineering, operations, and data science teams to streamline data collection workflowsPartner with key stakeholders, including designers, data scientists, and engineers to ensure that evaluation and data collection efforts are well-integrated into the overall AI model development lifecycleStay at the forefront of AI evaluation and data collection techniques, continuously innovating and refining methodologies to maintain state-of-the-art model performance and user experience