Amazon Sr Data Engineer 

United States, Washington, Seattle 

707673182

You will work closely with a diverse range of roles, such as Software Development Engineers, Data Scientist, Data Engineers, Technical Program Managers, Product managers and our Security Engineer customers, to build high quality datasets for security investigations, application modeling, and more.You'll mostly work with AWS services like EMR, Glue, Athena, Redshift, S3, SNS, SQS, and some internal tools. Our lake comprises over 500 datasets from different sources, with some datasets experiencing large daily volumes exceeding 1TB.As a Sr. Data Engineer, you will be responsible for data architecture. You will be gathering and understanding data requirements, partnering with software engineers, and collaborating across roles and teams to create the necessary data infrastructure and high quality pipelines to drive our team's initiatives. We have high-visibility data ingestion goals in a fast-paced, operational environment. The ideal candidate should enjoy the challenge of operating complex and mission-critical systems under extreme loads.Key job responsibilities
• Develop and influence the teams’ data strategy and data storage roadmap through working closely with partners
• Lead designs for data governance strategy, define data schema and develop tools to enable more efficient data sharing with customers which adhere to highly confidential data handling guidelines.
• Continually improve the data quality and operations, via automation and building full CI/CD data pipelines
• Recognize and adopt best practices in data integrity, data model, testing, analysis, validation, and documentation.
• Build end-to-end data pipelines to ingest and transform data from different types of data sources and systems
• Utilize AI/LLM to automate manual and redundant data engineering task
• Evaluate and implement various big-data technologies and solutions (e.g. Redshift, Hive/EMR, Spark, SNS, SQS, Kinesis) to optimize processing of extremely large datasets
• Understand and analyze business processes, logical data models and relational database implementations
• Write high performing and optimized SQL queries
Training & Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, training, and other career-advancing resources here to help you develop into a better-rounded professional.Diverse Experiences
Amazon Security values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.Work/Life Balance

- 5+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience mentoring team members on best practices

- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience operating large data warehouses
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence