Amazon Data Engineer Level Amazon 

United States, California, Palo Alto 

164819226

In this role, you will be building complex data engineering and business intelligence applications using AWS big data stack. You should have deep expertise and passion in working with large data sets, data visualization, building complex data processes, performance tuning, bringing data from disparate data stores and programmatically identifying patterns. You should have excellent business acumen and communication skills to be able to work with business owners to develop and define key business questions and requirements. You will provide guidance and support for other engineers with industry best practices and directionKey job responsibilities
• Design and develop the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Python and AWS big data technologies.
• Oversee and continually improve production operations, including optimizing data delivery, re-designing infrastructure for greater scalability, code deployments, bug fixes and overall release management and coordination.
• Establish scalable, efficient, automated processes for large scale data analyses
• Continuously explore and leverage the latest AWS technologies and Generative AI capabilities to introduce new data engineering solutions, driving innovation and operational efficiencies.
• Establish and maintain best practices for the design, development and support of data integration solutions, including documentation.
• Work closely with Product teams, Data Scientists, Software developers and Business Intelligence Engineer to explore new data sources and deliver the data.
• Able to read, write, and debug data processing and orchestration code written Python/Scala etc following best coding standards (e.g. version controlled, code reviewed, etc.)

- 5+ years of data engineering experience
- Experience with SQL
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby