Amazon Software Development Engineer Catalog DataWorks Item Offers Platform 

United States, California, Sunnyvale 

945356171

As a Software Engineer in the CDW team, you will own complex big data pipelines and data solutions to provide highly availability datasets. You will work with large data sets (in petabytes) and transformations involving multiple data sources to enable downstream analytics for our stakeholders. You will build and manage large datasets to help teams drive data-driven decisions through analytical and business metrics dashboards. You will be building libraries, tools and scripts to enable /accelerate other teams in organization accelerate their dataset generation work.

- Bachelor's degree in computer science or equivalent
- 3+ years of big data technologies such as AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR or Storm/Samza experience
- Experience with diverse data formats: Parquet, JSON, big data formats, and table formats like Apache Iceberg
- Experience in at least one modern scripting or programming language, such as Python, Java or Scala

- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Experience with BDT toolsets like Cradle, DataCraft, Andes and other products
- Experience in managing data at scale (hundreds of terabyte size datasets)
- Experience mentoring team members on best practices