Amazon Data Engineer II 

United States, New York, New York 

610465116

As a highly talented Data Engineer (DE), you will design, build, and maintain our complex data engineering and cutting-edge infrastructure that powers our organization's data-driven initiatives. Your primary focus will be to architect scalable and efficient data pipelines that can ingest, process, and transform vast amounts of data from diverse sources. You will work with large datasets, data visualization, and build complex data processes, ensuring high-performance, fault-tolerant systems that maintain data integrity, reliability, and accessibility for downstream analytics and reporting. You will provide guidance and support to other engineers with industry best practices and direction.Key job responsibilities
· Design, implement, and support data warehouse/data lake infrastructure using AWS big data stack, Python, Redshift, QuickSight, Glue/lake formation, EMR/Spark/Scala, Athena, etc.
· Develop and manage ETLs to source data from various systems and create a unified data model for analytics and reporting.
· Use business intelligence and visualization software (e.g., QuickSight) to develop dashboards used by senior leadership.
· Empower technical and non-technical internal customers to drive their own analytics and reporting, and support ad-hoc reporting when needed.
· Develop a deep understanding of vast data sources and know exactly how, when, and which data to use to solve particular business problems.
· Work with Product Managers, Finance, and Engineering Teams on a day-to-day basis to support their new analytics requirements.
· Manage numerous requests concurrently and strategically, prioritizing when necessary.
· Partner/collaborate across teams/roles to deliver results.
· Mentor other engineers and positively influence team culture.New York City, NY, USA

- Bachelor's degree, or Master's degree
- 2+ years of analyzing and interpreting data with Redshift, Oracle, NoSQL etc. experience
- 3+ years of data engineering experience
- Knowledge of distributed systems as it pertains to data storage and computing
- Experience with data modeling, warehousing and building ETL pipelines
- Experience working on and delivering end to end projects independently
- Experience programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby
- Experience with Redshift, Oracle, NoSQL etc.
- Excellent knowledge and experience of designing and developing data engineering systems from grounds up and maintaining/supporting existing systems.
- Excellent knowledge of data warehousing and big data design and concepts
- Experience in dealing with large and complex data sets and performance tuning
- Experience in designing data models that supports structures and unstructured data
- Experience in gathering requirements and formulating business metrics for reporting
- Strong verbal/written communication & presentation skills, including an ability to effectively communicate with business and technical teams.
- Ability to deal with ambiguities and competing priorities.

- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
- Prior experience in programming using Python
- Any knowledge/skill on Data Science, AI/ML will be plus