Predicting European Bank Stress Tests: Survival of the Fittest

This paper develops an early warning system to predict whether European banks pass stress tests conducted by regulatory agencies. All banks participating in stress tests in 2010, 2011 and 2014 are examined. Using an AdaBoost classifier ensemble approach with financial ratio and macroeconomic variables, we are able to identify over 98 percent of failing and passing banks in the training subsample and predict about 90 percent of banks in the test validation sample. Additional analyses of predictor importance and robustness compared to other competing model approaches are conducted. Based on our findings, we conclude that ensemble methods can help identify the underlying risk dimensions of individual banks.

[1]  Junghwan Hyun Job Reallocation, Financial Crises, and Policy Reforms: Evidence from Korea , 2016 .

[2]  Zhichao Zhang,et al.  Determinants of Financial Distress in Large Financial Institutions: Evidence from U.S. Bank Holding Companies , 2016 .

[3]  P. Glasserman,et al.  Are the Federal Reserve’s Stress Test Results Predictable? , 2016, The Journal of Alternative Investments.

[4]  Oscar A. Mitnik,et al.  Stress Testing Banks: Whence and Whither? , 2015 .

[5]  Dimitri G. Demekas Designing Effective Macroprudential Stress Tests: Progress so Far and the Way Forward , 2015, SSRN Electronic Journal.

[6]  Oscar A. Mitnik,et al.  A Top-down Approach to Stress-testing Banks , 2015 .

[7]  K. Lim Predictability of EU Bank Stress Test Results , 2015 .

[8]  Artatrana Ratha,et al.  Asian Financial Crisis and Korean Trade Dynamics , 2014 .

[9]  M. Pritsker Stress-testing US bank holding companies: A dynamic panel quantile regression approach: A comment , 2014 .

[10]  Theophilos Papadimitriou,et al.  Forecasting the insolvency of US banks using support vector machines (SVMs) based on local learning feature selection , 2013 .

[11]  Francisco Covas,et al.  Stress-Testing U.S. Bank Holding Companies: A Dynamic Panel Quantile Regression Approach , 2013 .

[12]  R. Engle,et al.  Testing Macroprudential Stress Tests: The Risk of Regulatory Risk Weights , 2013 .

[13]  Fatih Ecer,et al.  Comparing the Bank Failure Prediction Performance of Neural Networks and Support Vector Machines: The Turkish Case , 2013 .

[14]  Klaus Rheinberger,et al.  How to Find Plausible, Severe and Useful Stress Scenarios , 2012 .

[15]  Rodrigo Alfaro,et al.  Macro Stress Tests and Crises: What Can We Learn? , 2012 .

[16]  M. Welch,et al.  Can Macro Variables Used in Stress Testing Forecast the Performance of Banks? , 2012 .

[17]  Wei-Yang Lin,et al.  Machine Learning in Financial Crisis Prediction: A Survey , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Andrea Resti,et al.  Supervisors as Information Producers: Do Stress Tests Reduce Bank Opaqueness? , 2012 .

[19]  Jian Ma,et al.  Two credit scoring models based on dual strategy ensemble trees , 2012, Knowl. Based Syst..

[20]  Claudio Borio,et al.  Stress-Testing Macro Stress Testing: Does it Live Up to Expectations? , 2012 .

[21]  Mathias Drehmann,et al.  Anchoring Countercyclical Capital Buffers: The Role of Credit Aggregates , 2011 .

[22]  Hui Li,et al.  AdaBoost ensemble for financial distress prediction: An empirical comparison with data from Chinese listed companies , 2011, Expert Syst. Appl..

[23]  Mwanza Nkusu,et al.  Nonperforming Loans and Macrofinancial Vulnerabilities in Advanced Economies , 2011, SSRN Electronic Journal.

[24]  Stephen C. H. Leung,et al.  Vertical bagging decision trees model for credit scoring , 2010, Expert Syst. Appl..

[25]  Raphael A. Espinoza,et al.  Nonperforming Loans in the GCC Banking System and Their Macroeconomic Effects , 2010, SSRN Electronic Journal.

[26]  Dae-Ki Kang,et al.  Ensemble with neural networks for bankruptcy prediction , 2010, Expert Syst. Appl..

[27]  A. Banerjee,et al.  Volatility and growth: Credit constraints and the composition of investment , 2010 .

[28]  Bhekisipho Twala,et al.  Multiple classifier application to credit risk assessment , 2010, Expert Syst. Appl..

[29]  Gianluca Antonini,et al.  Subagging for credit scoring models , 2010, Eur. J. Oper. Res..

[30]  M. Kawai,et al.  Regulating Systemic Risk , 2010 .

[31]  Jorge A. Chan-Lau,et al.  Regulatory Capital Charges for Too-Connected-To-Fail Institutions: A Practical Proposal , 2009, SSRN Electronic Journal.

[32]  C. Schmieder,et al.  Stress-testing German credit portfolios , 2009 .

[33]  Loris Nanni,et al.  An experimental comparison of ensemble of classifiers for bankruptcy prediction and credit scoring , 2009, Expert Syst. Appl..

[34]  Fotios Pasiouras,et al.  Assessing Bank Efficiency and Performance with Operational Research and Artificial Intelligence Techniques: A Survey , 2009, Eur. J. Oper. Res..

[35]  Mario Quagliariello,et al.  Stress Testing the Banking System: Methodologies and Applications , 2009 .

[36]  A. Foglia,et al.  Stress Testing Credit Risk: A Survey of Authorities' Approaches , 2008 .

[37]  Andrea Roli,et al.  A neural network approach for credit risk evaluation , 2008 .

[38]  Luc Laeven,et al.  Systemic Banking Crises: A New Database , 2008, SSRN Electronic Journal.

[39]  Chih-Fong Tsai,et al.  Using neural network ensembles for bankruptcy prediction and credit scoring , 2008, Expert Syst. Appl..

[40]  Vadlamani Ravi,et al.  Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review , 2007, Eur. J. Oper. Res..

[41]  Martin Čihák,et al.  Introduction to Applied Stress Testing , 2007, SSRN Electronic Journal.

[42]  Evan Kraft,et al.  Deposit interest rates, asset risk and bank failure in Croatia , 2007 .

[43]  J. Demšar Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[44]  David West,et al.  Neural network ensemble strategies for financial decision applications , 2005, Comput. Oper. Res..

[45]  Marco Sorge,et al.  Stress-Testing Financial Systems: An Overview of Current Methodologies , 2004 .

[46]  Asli Demirgüç-Kunt,et al.  Finance, Firm Size, and Growth , 2004 .

[47]  Kimmo Virolainen,et al.  Macro Stress Testing with a Macroeconomic Credit Risk Model for Finland , 2004, SSRN Electronic Journal.

[48]  Soushan Wu,et al.  Credit rating analysis with support vector machines and neural networks: a market comparative study , 2004, Decis. Support Syst..

[49]  Matthew T. Jones,et al.  Stress Testing Financial Systems: What to Do When the Governor Calls , 2004, SSRN Electronic Journal.

[50]  Kyoung-jae Kim,et al.  Financial time series forecasting using support vector machines , 2003, Neurocomputing.

[51]  David J. Hand,et al.  A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems , 2001, Machine Learning.

[52]  Lijuan Cao,et al.  Application of support vector machines in !nancial time series forecasting , 2001 .

[53]  Amir F. Atiya,et al.  Bankruptcy prediction for credit risk using neural networks: A survey and new results , 2001, IEEE Trans. Neural Networks.

[54]  Alfredo Vellido,et al.  Neural networks in business: a survey of applications (1992–1998) , 1999 .

[55]  Stijn Claessens,et al.  How Does Foreign Entry Affect the Domestic Banking Market? , 1998 .

[56]  Susan G. Watts,et al.  Bankruptcy classification errors in the 1980s: An empirical analysis of Altman's and Ohlson's models , 1996 .

[57]  J V Tu,et al.  Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. , 1996, Journal of clinical epidemiology.

[58]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[59]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[60]  Edward I. Altman,et al.  Corporate distress diagnosis: Comparisons using linear discriminant analysis and neural networks (the Italian experience) , 1994 .

[61]  H. Broadman,et al.  Finance and Growth: Schumpeter Might Be Right , 1993 .

[62]  James A. Ohlson FINANCIAL RATIOS AND THE PROBABILISTIC PREDICTION OF BANKRUPTCY , 1980 .

[63]  Daniel Martin,et al.  Early warning of bank failure: A logit regression approach , 1977 .

[64]  W. J. Conover,et al.  Practical Nonparametric Statistics , 1972 .

[65]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[66]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[67]  Martin Krzywinski,et al.  Points of Significance: Classification and regression trees , 2017, Nature Methods.

[68]  Savas Onder,et al.  Macro Stress Testing and an Application on Turkish Banking Sector1 , 2016 .

[69]  Cristina Gutiérrez López,et al.  ¿Permitían los estados financieros predecir los resultados de los tests de estrés de la banca española?: Una aplicación del modelo logit , 2014 .

[70]  Mukta Paliwal,et al.  Neural networks and statistical techniques: A review of applications , 2009, Expert Syst. Appl..

[71]  Chih-Chung Chang,et al.  A Practical Guide to Support Vector Classification , 2009 .

[72]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[73]  C. Goodhart,et al.  Monetary and Capital Markets Department Banking Stability Measures Prepared by , 2008 .

[74]  I. Lelyveld Stress Testing: The link between macro and micro , 2007 .

[75]  John C. Platt,et al.  Fast Training of Support Vector Machines using Sequential Minimal Optimization , 2000 .