Finding the best job has never been easier
Share
Key job responsibilities- Design, implement, and support a platform providing secured access to large datasets.
- Recognize and adopt best practices in data integrity, test design, analysis, validation, and documentation.
- Tune data pipelines and query performance using profiling tools and SQL.
- Analyze and solve problems at their root, stepping back to understand the broader context.- Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data volume using AWS.
- Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for datasets.
- Design, implement, and support an analytical data infrastructure providing ad hoc access to large datasets and computing power
- Managing AWS resources- Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency
- Work with external data vendors to onboard data into existing infrastructure
- 3+ years of data engineering experience
- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets
- Knowledge of distributed systems as it pertains to data storage and computing
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- 3+ years of analyzing and interpreting data with Redshift, Oracle, NoSQL etc. experience
- Master's degree
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience providing technical leadership and mentoring other engineers for best practices on data engineering
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
- 5+ years of data engineering experience
- Excellent written and verbal communication skills
- Effective communication with senior management as well as with colleagues from operations and business backgrounds
- Ability to work on a diverse team or with a diverse range of coworkers
These jobs might be a good fit