Job responsibilities
- Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
- Supports review of controls to ensure sufficient protection of enterprise data
- Advises and makes custom configuration changes in one to two tools to generate a product at the business or customer request
- Updates logical or physical data models based on new use cases
- Frequently uses SQL and understands NoSQL databases and their niche in the marketplace
- Adds to team culture of diversity, equity, inclusion, and respect
- Contributes to software and data engineering communities of practice and events that explore new and emerging technologies
- Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
Required qualifications, capabilities, and skills
- Formal training or certification on Data Engineering concepts and 3+ years applied experience in AWS and Kubernetes
- Proficiency in one or more large-scale data processing distributions such as JavaSpark/PySpark along with knowledge on Data Pipeline (DPL), Data Modeling, Data warehouse, Data Migration and so-on.
- Experience across the data lifecycle along with expertise with consuming data in any of: batch (file), near real-time (IBM MQ, Apache Kafka), streaming (AWS kinesis, MSK)
- Good at SQL (e.g., joins and aggregations)
- Working understanding of NoSQL databases
- Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages.
- Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
- Significant experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
- Experience customizing changes in a tool to generate product
Preferred qualifications, capabilities, and skills