Amazon Data Scientist II Customer Engagment Technologies 

United States, Washington, Seattle 

473125006

This involves model development in areas such as multi-turn dialogue management, knowledge grounding, and open-ended generation and assessment of dialogue quality and style of the conversational model.Key job responsibilities
• Define and implement robust HITL strategies to effectively expedite LLM models scaling process.
• Collaborate with human annotators and subject matter experts to establish clear guidelines and quality control measures.
• Analyze feedback loops and iterate on model performance to ensure continuous improvement.
• Conduct in-depth analysis of large-scale conversational datasets to identify patterns, trends, and potential challenges.
• Independently document methodologies, findings, and results in a clear and concise manner, ensuring reproducibility and knowledge sharing.• Develop and implement strategies for data collection, annotation, and model training to ensure high-quality and robust performance of the chatbots.
• Conduct experiments and evaluations to measure the performance of the developed models and systems, and identify areas for improvement.
A day in the life
Benefits Summary:1. Medical, Dental, and Vision Coverage
2. Maternity and Parental Leave Options
3. Paid Time Off (PTO)
4. 401(k) Plan

- 3+ years of data scientist experience
- 3+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, etc.) experience
- 3+ years of machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance experience
- Experience applying theoretical models in an applied environment