Amazon Delivery Consultant - Security 

United States, Texas, Arlington 

600222152

As an SDE on our team, you will leverage your deep technical expertise to build reliable, scalable, and highly performant AI systems for inference and evaluation of Nova models. You will collaborate closely with the Applied Scientists to automate hosting of multimodal LLMs and run evaluations against industry standard as well as customized benchmarks to generate model cards, identify gaps in model performance, and inform strategies to bridge those gaps.Key job responsibilitiesResponsibilities
- Design and implement solutions that scale from running single evaluations to a whole suite of evaluations on a regular cadence for multiple models
- Propose strategies to optimize the use of compute infrastructure to manage costs
- Manage project prioritization, deliverables, and timelines.
- Champion best practices for maintaining a high bar on operational excellence- Operate in a dynamic environment to deliver high quality software against competitive schedules with rapidly-evolving priorities.

- 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team

- 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent