Amazon Software Development Engineer Customer Engagement Technology 

United States, California 

750391956

Key job responsibilities- Develop and own the deployment pipelines for integrating and deploying LLM models into production environments, including rigorous testing and validation stages.
- Design and implement the ML inference service that orchestrates the interaction between multiple models, such as issue prediction, item recommendation, and response generation, to provide coherent and contextual responses.- Enhance observability and logging mechanisms to proactively identify and troubleshoot issues, and maintain dialogue state for offline training and model improvement.
- Strong understanding of LLM domain, including experience with model compression techniques, quantization, and efficient serving strategies for conversational AI applications.
- Ability to balance model accuracy with performance constraints in production environments.A day in the life
Benefits Summary:1. Medical, Dental, and Vision Coverage
2. Maternity and Parental Leave Options
3. Paid Time Off (PTO)
4. 401(k) Plan

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent