Your role and responsibilities
You will be part of an Application Development team that is responsible for supporting the full life cycle of development and enhancements. As a Data Engineer your responsibilities include –
- Work effectively individually and with team members toward customer satisfaction and success
- Load/Ingest, Process, Synthesis the data into Westpac’s Enterprise Data Platform (DDEP) and deliver enterprise information management advice and support.
- Understand the Data Storage, Processing, Maintenance, in bigdata world.
- Involve in Requirements gathering from business stakeholders
- Design the solution based on the requirements gathered and aligning with Westpac's standard solutioning patterns, and get it implemented to deliver the project
- Guide and Instruct the team members to get the solution built.
- Good understanding and work experience on any one of the data Cloud Platforms (Microsoft Azure, AWS, GCP)
- Automate the implementation processes using CICD DevOps and customised tools built on Westpac’s Release Platforms.
- Develop design documents and review technical documents from Solution Architects for projects in Banking/Finance domain and manage the alignment of the program’s architecture to the Bank’s Enterprise Architecture.
- Lead and participate in problem solving to deliver large scale change through process engineering, technology and people engagement.
- Be keenly aware of timelines and budgeting to deliver in a timely manner
Required education
Bachelor's Degree
Required technical and professional expertise
To ensure success in the role you will possess the following skills –
- Proficient with 10+ years technical experience in Data Engineering, Bigdata tech stack
- Proficient with 8+ years of working experience on Python and Linux Shell scripting. 4+ years’ experience as Implementation and Lead Engineer.
- Proficient with 6+ years of work experience on Spark, Hive, HBase (No SQL), SQL, Control-M, Spark Streaming, Data Mesh and Data Products.
- In depth knowledge and hands on experience on Westpac's Data Platforms (DDEP).
- Proficient with 6+ years of business domain knowledge of Banking and Finance Industry
- Ability to automate the implementation processes using CICD DevOps (DevSecOps, Git, Jenkins, etc).
- Coordinate with Solution Designers, Tech Leads and Business Analysts regularly to understand and adapt the new implementation processes that are being built to achieve Agile production releases in DDEP platform.
- Coordinate with and manage & lead large and complex Banking projects and teams across locations in Banking and Finance.
Preferred technical and professional experience
As Above
