Amazon Software Development Engineer Generative AI AGI-Web Information Services 

United States, Washington, Bellevue 

600905238

Key job responsibilities
• Design and build highly scalable web crawling and data extraction systems capable of acquiring structured data from websites efficiently.
• Continuously optimize the data extraction architecture to ensure peak performance, scalability, resilience, and cost-effectiveness.
• Develop robust systems to process vast volumes of web content and extract meaningful insights through advanced data processing techniques.
• Design and implement high-throughput data pipelines and infrastructure to handle petabyte-scale datasets seamlessly.
• Collaborate closely with scientists and cross-functional engineering teams to rapidly prototype, iterate, and deploy state-of-the-art algorithms and models.
• Craft high-quality, thoroughly tested production-ready code using languages such as Python, Java, and Scala, adhering to industry best practices.
• Continuously explore and implement innovative solutions to complex technical challenges, pushing the boundaries of what's possible in web crawling and data processing.

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent