Engage in new model validation activities for all Data Science models in the coverage area - evaluate conceptual soundness of model specification; reasonableness of assumptions and reliability of inputs; fit for purpose; completeness of testing performed to support the correctness of the implementation; robustness of numerical aspects; suitability and comprehensiveness of performance metrics and risk measures associated with use of model.
Conduct independent testing
Perform additional model review activities ranging from proposed enhancements to existing models, extensions to scope of existing models.
Liaise with Model Developers, Model Users, Risk and Finance professionals to provide oversight of and guidance on appropriate usage, controls around model restrictions & limitations, and findings for ongoing performance assessment & testing
Maintain model risk control apparatus of the bank for the coverage area & serve as first point of contact
Keep up with the latest developments in coverage area in terms of products, markets, models, risk management practices and industry standards
Required qualifications, capabilities, and skills :
Strong quantitative & analytical skills: The role requires a strong quantitative background based on a degree in a quantitative discipline such as Computer Science, Statistics, Data Science, Math, Economics or Math Finance. Masters (or equivalent) or PhD
Strong understanding of Machine Learning / Data Science theory, techniques and tools including Transformers, Large Language Models, NLP, GANs, Deep Learning, OCR, XGBoost, and Reinforcement Learning
Understanding of the machine learning lifecycle - feature engineering, training, validation, scaling, deployment, scoring, monitoring, and feedback loop is an asset
Proficiency in Python programming. Python machine learning library and ecosystem experience: Numpy Scipy Scikit-learn Theano TensorFlow Keras PyTorch Pandas
Prior experience in following backgrounds (2 years desirable): Data Science, Quantitative Model Development, Model Validation or Technology focused on Data Science including hands on experience with building/testing machine learning models
Excellent writing skills: previous experience in writing scientific text with the ability to describe evidence and present logical reasoning clearly.
Strong communication skills and ability to interface with other functional areas in the bank on model-related issues
Risk and control mindset: ability to ask incisive questions, converge on critical matters, assess materiality and escalate issues