Amazon Applied Scientist - Conversational Agent Analytics Insights 

United States, Washington, Seattle 

702327609

We are using cutting edge generative AI to help teams generate insights faster based on our massive data lake. You will need to invent new techniques for metrics retrieval and SQL generation to ensure we're retrieving accurate and trusted data. You'll create feedback loops to ensure our solution is constantly evaluating itself and improving.Being that this is for a conversational AI position, here is what our bot replied when we prompted it for a job description of who should help build it:Role Overview:
Responsibilities:
- Study and understand data engineering and analytics workflows to design the right conversational experiences
- Research, design, and develop NLP/NLU models for intent classification, entity extraction, sentiment analysis etc.
- Continuously improve models through techniques like active learning, transfer learning etc.
- Optimize models for metrics like precision, recall, latency, interpretability etc.
- Implement models within overall bot architecture and integrate with backend systems- Stay up-to-date on latest advancements in conversational AI research, specifically in LLMs (multi-agent, chain of thought, autonomous agents)
- Be familiar with optimizing retrievers in RAG architectures.Key job responsibilities
You will test multiple foundational models and fine tune when appropriate. You will create feedback loops that will evaluate performance and improve our systems. You will optimize prompts for better responses from our LLMs. You will build tools to auto-curate metadata using LLMs.A day in the life

- 3+ years of building models for business application experience
- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
- Experience programming in Java, C++, Python or related language
- Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing

- Experience using Unix/Linux
- Experience in professional software development