Job responsibilities
- Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
- Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
- Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
- Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
- Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
- Contributes to software engineering communities of practice and events that explore new and emerging technologies
- Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and skills
- Formal training or certification on data engineering concepts and 3+ years of applied experience
- Experience in one or more programming language(s), such as Python, Java
- Experience with SQL-based technologies (e.g., MySQL/ Oracle DB)
- Hands-on practical experience delivering data pipelines
- Proficient in all aspects of the Software Development Life Cycle
- Ability to develop reports, dashboards, and processes to continuously monitor data quality and integrity
- Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
- Experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
- Strong experience with distributed computing frameworks such as Apache Spark, specifically PySpark
- Strong hands-on experience building event driven architecture using Kafka
- Hands-on experience building data pipelines on AWS using Lambda, SQS, SNS, Athena, Glue, EMR
Preferred qualifications, capabilities, and skills
- Familiarity with modern front-end technologies
- Exposure to cloud technologies
- Knowledge of bitbucket and JIRA
- Familiarity with writing Splunk or Cloudwatch queries, DataDog metrics