Amazon Software Dev Engineer ML Infra Amazon Search 

United States, California, Palo Alto 

118989052

Key job responsibilities
As a member of this team, you will:1. Evolve a sophisticated deep-learning ranking system and feature store deployed across thousands of machines in AWS, serving billions of queries at tens of millisecond latencies.
2. Immerse yourself in imagining and providing innovative solutions to large-scale information retrieval and machine learning (ML/DL) problems.
3. Have a relentless focus on scalability, latency, performance, robustness, and cost trade-offs -- especially those present in highly virtualized, elastic, cloud-based environments.
4. Conduct and automate performance testing of the model serving system to evaluate different hardware options (including GPUs and specialized accelerators such as AWS Inferentia2), model architectures and serving configurations.
5. Implement and enhance a rapid experimentation framework to test ranking hypotheses.
6. Create mechanisms to ensure models work as expected in production.
7. Work closely with applied scientists to determine the requirements for deploying ranking models in production environments.

- 3+ years of non-internship professional software development experience
- Bachelor's degree in computer science or equivalent
- Experience implementing large-scale low-latency distributed systems and working with scalable algorithms utilizing large amounts of data.
- Experience in large scale AI and ML infrastructure, and in machine learning technologies including or similar to PyTorch, TensorRT, AWS Inferentia, Triton Inference Server, etc.
- Experience writing production code for services that utilize Machine Learning or Information Retrieval algorithms.

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Master's degree in computer science or equivalent
- Polished communication skills, with the ability to communicate with confidence, clarity, and focus