Job Description:
Data Fabric team is building the next generation Data fabric to solve for Business, Analytics and growing regulatory needs. Vast amounts of data assets have been accumulated through the years. Data fabric built on emerging technologies will facilitate the data being inspected, cleansed, transformed for support decision-making
Key Responsibilities:
The Senior Big Data developer will be working very closely with and managing the work of a team of data engineers working on our Big Data Platform. This role needs below core skills:
- Work closely with the Olympus data model, core & product processor teams and drive the build out & migration of DMS SPIDER and LOPR feeds to Olympus using Olympus framework
- Accountable for all phases of development process – analysis, design, construction, testing and implementation in agile development lifecycles
- Perform Unit Testing, System Testing for all applications developed / enhancements and ensure that all critical and high-severity bugs are addressed.
- Subject Matter Expert (SME) in at least one area of Applications Development
- Align to Engineering Excellence Development principles and standards
- Promote and increase our Development Productivity scores for coding
- Fully adhere to and evangelize a full Continuous Integration and Continuous Deploy pipeline
- Strong SQL skills to extract, analyze and reconcile huge data sets
- Demonstrate ownership and initiative taking
- Project will run in iteration lifecycles with agile practices, so experience of agile development and scrums is highly beneficial.
Qualifications:
- Bachelor's degree/University degree or equivalent experience, Master's degree preferred
- 8-12 year’s experience in application / software development
Skills:
- Experience with Big Data technologies (Spark, Hadoop, Hive, Impala, Scala)
- Performance optimization on Big Data
- Solid understanding of the Big Data architecture and the ability to trouble shoot development / Performance issues on Hadoop (Cloudera preferably)
- Experience with Python and Shell scripting is a Must
- Prior work Experience in Capital/Regulatory Market or related industry
- Experience in Analysis, Design, Development, Testing and Implementation (all phases of software development life cycle - SDLC)
- Strong SQL development experience either Oracle, Sybase or MySQL
- Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
- Ability to work independently given general guidance
Applications Development
Time Type:
Full timeView the " " poster. View the .
View the .
View the