Amazon ML Quality Process Lead - Italian Customer Engagement Technologies 

United States, New Hampshire 

215713633

Key job responsibilities
- Review annotations by paying close attention to details, making necessary adjustments to ensure high-quality data that supports ongoing model improvement.
- Perform root cause analysis using basic data analysis in Excel and SageMaker (annotation tool) on annotations to identify opportunities for improving data accuracy.
- Provide support for ML model training data annotations, assisting annotators in maintaining high-quality work by enforcing best practices.- Review LLM testing results provided by testers, paying close attention to details, to ensure their accuracy and identify areas for improvement.
- Carefully monitor the accuracy of multiple annotation projects and proactively communicate any blockers or potential delays in the completion of quality checks.A day in the life1. Medical, Dental, and Vision Coverage
2. Maternity and Parental Leave Options
3. Paid Time Off (PTO)
4. 401(k) Plan

- Language fluency in Italian (Native-level) and English.
- Experience in creating and managing ML annotation processes, testing models, and quality assurance methodologies.
- Analytical and problem-solving skills to identify patterns, inconsistencies, and areas for improvement.
- Ability to thoroughly investigate and identify misalignment between annotations and SOPs, as well as the root causes of inaccuracies.
- Strong ownership and accountability to meet SLAs, and proactive communication regarding blockers, and proposed solutions.
- Ability to collaborate closely with cross-functional teams, understand project/stakeholder requirements, and align annotation efforts and model testing accordingly.

- Bachelor's Degree
- Experience in annotation
- Familiarity in using Excel
- Experience with project management and stakeholder managementPursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.