Job responsibilities
- Provides guidance to immediate team of software engineers on daily tasks and activities
- Sets the overall guidance and expectations for team output, practices, and collaboration
- Anticipates dependencies with other teams to deliver products and applications in line with business requirements
- Manages stakeholder relationships and the team’s work in accordance with compliance standards, service level agreements, and business requirements
- Creates a culture of diversity, equity, inclusion, and respect for the team members and prioritizes diverse representation
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 10+ years applied experience
Proficient in automation and continuous delivery methods
Proficient in all aspects of the Software Development Life Cycle
Experience with APIs, Web services, Microservices architecture, Database technologies - Oracle, AWS RDS
Experience with a combination of PySpark, Databricks, Snowflake, Redshift, Data Lakes, data products, Cloud Based Big data technologies and handling Metadata
Practical experience in developing spark-based Frameworks for end-to-end ETL, ELT & reporting solutions using key components like Spark SQL.
Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda, Step Functions, Event Bridge
Practical Cloud experience - AWS Services
Preferred qualifications, capabilities, and skills
- AWS Data Security: Good Understanding of security concepts such as: Lake formation, IAM, Service roles, Encryption, KMS, Secrets Manager
Proficient in Machine Learning Frameworks and Big Data technologies such as Spark & Hadoop.
Strong understanding of techniques such as Continuous Integration, Continuous Delivery, Test Driven Development, Cloud Development, application resiliency and security
Advanced understanding and experience of Devops/SRE
Strong troubleshooting/problem solving skills