We are looking for a highly motivated, self-starter senior level Data Engineering Lead with a passion for data and with the ability to drive multiple projects on our Big Data Platform.
This role requires 12-15 years and minimum 8-10 years’ experience on Big Data & NoSQL platforms.
The position requires an experienced individual who is equal parts Problem Solver, Project Management and Execution Driver. We are looking for somebody who can do project management but if needed but also be technically involved in the day-to-day work and contribute technically as and when needed. Experience working in the financial industry within the Institutional business would be a plus. This is a Senior Lead role that will offer exposure to the full development cycle, Project Management, Safe Agile ceremonies as being Scrum Master, whilst working closely with our business and technology stakeholders.
As a key member of the data engineering team, you will work closely with full stack data engineers, product managers, cross-functional partners and the larger technology organization to get high-quality products and new features built, tested, and released on time for Data Technology, part of Treasury & Trade Services at Citi.
- You will be responsible for many fast-changing, moving parts and get them to come together as a product.
- You will need excellent communication and collaboration skills.
- You will be responsible for identifying and managing risks, making sound judgments about quality, and speed of deliverables and deployment to production.
- You will be a key player in our Data transformation to digitize our business.
- You will be responsible for leading development on Vanguard the TTS Big Data platform.
- 12-15 years’ experience as Project Management, Scrum Master and/or Product Development. Experience of working with Agile Methodologies and Tools.
- Ability to prioritize is key as is ability to juggle several tasks at once.
- Must work well under pressure whilst, enthusiastic, hard-working, be positive and desire to improve processes.
- Excellent oral and written communication skills and ability to facilitate discussions.
- Ability to quickly grasp and master new concepts / requirements and related product / functional knowledge.
- Day-to-day management of individual project responsibilities including milestone setting, task and actions management, co-ordination, and execution of plan within required timelines and to stakeholder quality expectations.
- Identify key project risks, whether stated or not, and manage to resolution or escalate accordingly.
- Has the ability to operate with a limited level of direct supervision.
The technology team is responsible for building and maintaining a multitude of applications including:
- Batch ingestion using Multiple frameworks using Big data tools
- Real-time ingestion/stream processing and data distribution via Big Data APIs
- Build out canonical models through data conformance.
- Implement best in class data management and data analytics platform.
- Build and implement best in class Data Quality tools for monitoring of Critical Data Elements
Core Responsibilities
This role is for a Data Engineering Tech Lead to work on the Vanguard Big Data Platform. The Senior Lead is responsible for the project management, product enhancement/maintenance and development of leading Big Data initiatives and use cases providing business value.
- Interface with product teams to understand their requirements to build the ingestion pipelines and conformance layer for consumption by business.
- Work closely with the data ingestion team to track the requirements and drive the build out of the canonical models.
- Provide guidance to the data conformance team for implementing the requirements/changes/enhancements to the conformance model.
- Do hands-on development as part of the conformance team to deliver the business requirements.
- Manage the workload of the team and the scrum process to align it with the objectives and priorities of the product owners.
- Participate in data management activities related to the Risk and Regulatory requirements as needed.
- Day-to-day management of individual project responsibilities including milestone setting, task and actions management, co-ordination, and execution of plan within required timelines and to stakeholder quality expectations.
- Acts as SME to senior stakeholders and /or other team members. Can exercise independence of judgement and autonomy.
Core Skills
The Data Engineering lead will be working very closely with and managing the work of a team of data engineers working on our Big Data Platform. The lead will need the below core skills –
- Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
- Working experience on Big Data Technology like Hive, Impala, Kafka and HBase for data curation/conformance related work.
- Strong proficiency in Project Management and software development lifecycle work related to data curation/conformance through Agile and Safe methodology.
- Strong data analysis skills and the ability to slice and dice the data as needed for business reporting.
- Experience working in an agile environment with a fast-paced changing requirements. Experience of working with Agile Methodologies and Tools
- Excellent planning and organizational skills
- Willingness to ask questions, challenge the process and seek out answers.
- Strong Communication skills
- Ability to work independently, multi-task, and take ownership of various parts of a project or initiative.
Additional Requirements (good to have)
- Cloudera/Hortonworks/AWS EMR, S3 experience a plus
- Relational and NoSQL database integration and data distribution principles experience
- Fully adhere to and evangelize a full Continuous Integration and Continuous Deploy pipeline.
- Analysis and development across Lines of business including Payments, Digital Channels, Liquidities, Trade
- Cross train and fertilize functional and technical knowledge,
- Align to Engineering Excellence Development principles and standards.
- Promote and increase our Development Productivity scores for coding.
- Fully adhere to and evangelize a full Continuous Integration and Continuous Deploy pipeline.
Education:
- Bachelor's degree/University degree or equivalent experience
- Master's degree preferred
Time Type:
Full timeView the " " poster. View the .
View the .
View the