Job responsibilities
- Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems.
- Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems.
- Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development.
- Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.
- Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
- Contributes to software engineering communities of practice and events that explore new and emerging technologies.
- Adds to team culture of diversity, equity, inclusion, and respect.
Required qualifications, capabilities, and skills.
- Formal training or certification on software engineering concepts and 3+ years applied experience.
- Hands on experience with AWS framework leveraging AWS Glue for ETL transformation, EMR and Py-Spark framework development.
- Hand on experience in AWS (EC2, S2, Glue, AWS Lambda, Athena, RDS, SNS), proficiency with Python, Py-Spark, Machine Learning disciplines
- In depth knowledge on AWS infrastructure using Terraform, automating deployments and scaling data pipelines.
- Strong experience with distributed computing frameworks such as Apache Spark, specifically PySpark and event driven architecture using Kafka
- Experience in Unix Shell Scripting and batch job scheduler concepts.
- Experience in developing, debugging, and maintaining code in a large corporate environment and in RDBMS/querying languages.
- Demonstrated knowledge of software applications and technical processes within a technical discipline (ETL Processing, Scheduling, Operations.)
- Proficient in scripting with Python for data processing tasks and ETL workflows
Preferred qualifications, capabilities, and skills
- Familiarity with Java framework, modern front-end technologies and exposure to cloud technologies
- Experience in Ab-intio tool with developments of graphs, maps and P-sets.
- Experience with ETL transformation to AWS Glue processes
- Experience AWS framework to modernize mainframe data, utilizing AWS Glue, S3, and Kafka for data ingestion.