Job responsibilities
- Develop and maintain applications using Apache Spark and Java
- Work with different aspects of spark echo system including Datasets, Spark SQL and Scalability support
- Work with business analysts and lead engineers to understand requirements and designs for implementing software solutions
- Work on performance improvement activities to support spark applications to process millions of data elements everyday
- Production support and troubleshooting activities to uncover the issues in the spark applications
- Contributes to software engineering communities of practice and events that explore new and emerging technologies
- Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 2+ years applied experience
- Work experience on Data Engineering domain
- Hands-on practical experience in system design (simple), application development, testing, and operational stability
- Proficient in coding in one or more languages including Java
- Experience in developing, debugging, and maintaining code in a corporate environment with Java, Spark Framework and Database querying languages (any SQL usage experience)
- Overall knowledge of the Software Development Life Cycle
- Experience working in an Agile Software Development Environment
Preferred qualifications, capabilities, and skills
- Exposure to cloud technologies such as AWS, Kubernetes and Kafka