Job responsibilities:
- Lead the strategic direction and execution of software solutions, encompassing design, development, and technical troubleshooting, with the ability to innovate beyond routine or conventional approaches to build solutions and resolve complex technical challenges.
- Collaborate with product and business teams to develop and execute a multi-year roadmap for platform features.
- Defines database back-up, recovery, and archiving strategy
- Promote the modernization and transformation of the platform, ensuring scalability, security, and performance.
- Oversee the end-to-end development process, including requirements definition, design, implementation, testing, and integration.
- Design & develop data pipelines end to end using Spark SQL, Java and AWS Services. Utilize programming languages like Java, Python, NoSQL databases, SQL, Container Orchestration services including Kubernetes, and a variety of AWS tools and services.
- Develop multi-year roadmaps aligned with business and technology strategies, designing reusable frameworks using new technologies, and setting the vision for future technological advancements.
- Ensure alignment with the firm’s Risk and Control agenda and security standards.
- Provide mentorship and training to new development teams, promoting continuous learning and improvement.
- Creates functional and technical documentation supporting best practices
Required qualifications, capabilities and skills:
- Formal training or certification on Software Engineering concepts and 5+ years applied experience
- Experience in aligning technology roadmap strategy to business goals and executing complex projects.
- Expertise in architecture disciplines and programming languages.
- Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying language.
- Deep knowledge of design, architecture, data modeling, integration, cloud data services, data domain driven design, best practices, and industry trends in engineering and product development
- Practical experience with AWS, big data technologies, and data engineering disciplines.
Cloud implementation experience with AWS including:
o AWS Data Services: Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Kinesis (or) MSK, Airflow (or) Lambda + Step Functions + Event Bridge
o Data De/Serialization: Expertise in at least 2 of the formats: Parquet, Iceberg, AVRO, JSON-LD
o AWS Data Security: Good Understanding of security concepts such as: Lake formation, IAM, Service roles, Encryption, KMS, Secrets Manager
- Proficiency in SQL and different on-prem databases and other cloud native relational databases, e.g. Aurora, Snowflake, Athena, Postgres, Databricks, Iceberg
- Proficiency in automation and continuous delivery methods.
Preferred qualifications, capabilities and skills:
- Strong experience in building highly scalable and high-throughput data platforms.
- Experience with AI/ML technologies
- Proficient in modern technologies such as Kafka streaming, Spark, Python, Java, Cloud, Airflow, Kubernetes
- Must have experience leading teams in an agile environment, with a strong commitment to teamwork and collaboration.ave an experience working in a team, and ability to tackle design and functionality problems independently with little to no oversight
- Familiarity with front-end technologies such as HTML5/CSS3 and JS frameworks (e.g., AngularJS, React, jQuery, Bootstrap).
- Knowledge of testing tools (e.g., JUnit, Selenium, Cucumber) and build/packaging tools (e.g., Jenkins, Maven). Experience with code versioning tools.