Amazon Language Data Scientist Amazon 

United States, Washington, Seattle 

552708568

As a Language Data Scientist, you will start by diving deep into a couple of critical LLM related projects. You will collaborate with fellow applied scientists, language data scientists, program managers, as well as stakeholders in engineering, annotation operation teams, and product teams to understand the role data plays in developing models that meet customer needs. You will analyze, follow, and improve processes for collecting, assessing and improving LLM inputs and outputs, and automating where appropriate.You will apply state-of-the-art Generative AI techniques to analyze how well our data represents human language and run experiments to gauge downstream interactions. You will work collaboratively with other language data scientists and scientists to design and implement principled strategies for data optimization.
Key job responsibilities
- Source, validate, and deliver high-quality language model artifacts, and linguistic data- Oversee the progress and quality of several data collection, model development and annotation projects at a time
- Advocate for strict adherence to data guidelines and quality thresholds
- Extend existing data collection, annotation, and quality assurance efforts to support feature and language expansion
- Innovate on data collection and LLM finetuning/prompt engineering methodologies, guidelines, quality metrics to support new requests
- Automate repetitive workflows and improve existing processes

- 2+ years of data scientist experience
- 3+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, etc.) experience
- 3+ years of machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance experience
- Experience applying theoretical models in an applied environment
- Master's degree in a quantitative field such as statistics, mathematics, data science, business analytics, economics, finance, engineering, or computer science