Amazon Big Data Engineer Pricing Promotions Science Insights 

Canada, British Columbia, Vancouver 

431644899

Key job responsibilities
- Design, build, and operate highly scalable, fault-tolerant data processing systems using modern AWS services like Redshift, S3, Glue, EMR, Kinesis, and Lambda, and orchestration systems using Airflow
- Leverage your expertise in Python, Scala, or other modern programming languages to develop custom data processing frameworks and automation tools
- Collaborate closely with data scientists, analysts, and product managers to understand business requirements and translate them into technical solutions
- Continuously optimize data pipeline performance, reliability, and cost-efficiency using best practices in CI/CD and infrastructure-as-code
- Mentor junior engineers and share your knowledge of data engineering best practices
- Stay up-to-date with the latest big data technologies and architectural patterns, and drive the adoption of innovative solutions
A day in the life
You will:- Build automated data quality monitoring, audit and reconciliation mechanisms- Improve efficiency of operations in terms of cost, effort and reliability

- 4+ years of data engineering experience
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with SQL
- Experience with data audit and reconciliation strategies.
- Experience with data pipeline orchestration frameworks, such as Airflow.
- Experience with streaming data processing technologies.