Design, Build, and Operate the infrastructure required for optimal data extraction, transformation, and loading from a wide variety of data sources using SQL, cloud migration tools, and ‘big data’ technologies.
Optimize the ingestion, storage, processing, and retrieval of various data types, from near real-time events and IoT to unstructured data such as images, audio, video, documents, and others.
Design, Build, and Operate large, complex data lakes that meet functional / non-functional business requirements.
Work with customers and internal stakeholders, including the Executive, Product, Data, Software Development, and Design teams, to assist with data-related technical issues and support their data infrastructure and business needs.
Requirements
5+ years of experience in a Data Engineer role in a cloud-native ecosystem.
Bachelor (Graduate preferred) degree in Computer Science, Mathematics, Informatics, Information Systems, or another quantitative field.
Working experience with the following technologies/tools:
In-depth knowledge of AWS services for scalable and secure cloud-based solutions.
Programming skills in Python, including data manipulation and script automation.
Familiarity with Terraform for infrastructure as code to manage cloud services and resource
Advanced SQL
Experience building and optimizing data pipelines, architectures, and data sets.
Experience supporting and working with external customers in a dynamic environment.
Possesses excellent communication and presentation skills.
Team player that can train as well as learn from others.
Nice to Have Skills:
One or more AWS Certification(s) (SA Associate, Data Analytics Specialty, etc.)