Amazon DISCO CAST Data Engineer 

India, Karnataka, Bengaluru 

571622348

Key job responsibilities
• Writing scripts, building microservices in AWS to increase team efficiency
• Building and managing ETL pipelines in AWS to ingest data from external vendors
• Assist the BIs on the team in managing our existing environment that consists of Redshift and SQL based pipelines. The activities around these systems will largely be well-defined via standard operation procedures (SOP) and typically involve approving data access requests, subscribing or adding new data to the environment, but there will be cases where creative problem-solving is required
• SQL data pipeline management (creating or updating existing pipelines) and maintenance tasks on the Redshift cluster
• Assist the team with the management of our next-generation AWS infrastructure. Tasks includes infrastructure monitoring via CloudWatch alarms, infrastructure maintenance through code changes or enhancements, and troubleshooting/root cause analysis infrastructure issues that arise, and in some cases this resource may also be asked to submit code changes based on infrastructure issues that arise.

- 2+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
- Experience in troubleshooting the issues related to data and infrastructure issues.
- A passion for problem solving
- Excessive curiosity
- Exceptional ability to learn quickly and independently

- Experience in Linux/Unix scripting a big plus (e.g., bash scripts)
- Experience writing CLI tools/utilities in any language
- Experience with Typescript/Javascript and Java
- Experience with tools such as DBT, Stitch, Glue, Airflow
- Knowledge of distributed systems as it pertains to data storage and computing
- Experience in administering reporting/analytics platforms