Amazon Data Engineer Content Analysis & Strategy CAST 

United States, New York, New York 

855779075

Key job responsibilities
* Writing scripts, building microservices in AWS to increase team efficiency
* Building and managing ETL pipelines in AWS to ingest data from external vendors
* Assist the BIs on the team in managing our existing environment that consists of Redshift and SQL based pipelines. The activities around these systems will largely be well-defined via standard operation procedures (SOP) and typically involve approving data access requests, subscribing or adding new data to the environment, but there will be cases where creative problem-solving is required
* SQL data pipeline management (creating or updating existing pipelines) and maintenance tasks on the Redshift cluster
* Assist the team with the management of our next-generation AWS infrastructure. Tasks includes infrastructure monitoring via CloudWatch alarms, infrastructure maintenance through code changes or enhancements, and troubleshooting/root cause analysis infrastructure issues that arise, and in some cases this resource may also be asked to submit code changes based on infrastructure issues that arise.

- 1+ years of data engineering experience
- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets
- Experience writing and optimizing SQL queries with large-scale, complex datasets
- Experience with one or more scripting language (e.g., Python, KornShell, Scala)

- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.