Finding the best job has never been easier
Share
Key job responsibilities
* Design, implement, and support a platform providing secured access to large datasets.
* Architect , develop and maintain end to end scalable data infrastructure and data pipelines.
* Develop the teams' data strategy and technical road map of data storage & pipelines design and implementation
* Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, scripting and AWS big data technologies.
* Work closely with business owners, developers, Business Intelligence Engineers to explore new data sources and deliver the data.
* Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data volume using AWS.
* Empower the team for self-servicing by providing the necessary skills to handle complex tasks independently.
* Experience with data modeling, warehousing and building ETL pipelines and other BI solutions
* Develop data products, infrastructure and data pipelines leveraging AWS services (such as Redshift, Kinesis, EMR, Lambda etc.) and internal Amazon tools (Datanet, Cradle, QuickSight etc.)
* Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
* Experience communicating with users, other technical teams, and management to collect requirements, describe data modeling decisions and data engineering strategyBasic qualifications* 5+ years of data engineering experience
* Experience with data modeling, warehousing and building ETL pipelinesPreferred qualifications* Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
* Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
These jobs might be a good fit