An ordinal classification framework for bank failure prediction: Methodology and empirical evidence for US banks

Abstract Bank failure prediction models usually combine financial attributes through binary classification approaches. In this study we extend this standard framework in three main directions. First, we explore the predictive power of attributes that describe the diversification of banking operations. Second, we consider the prediction of failure in a multi-period context. Finally, an enhanced ordinal classification framework is introduced, which considers multiple instances of failed banks prior to failure (up to three years prior to bankruptcy). Various ordinal models are developed using techniques from multiple criteria decision analysis, statistics, and machine learning. Moreover, ensemble models based on error-correcting output codes are examined. The analysis is based on a sample consisting of approximately 60,000 observations for banks in the United States over the period 2006–2015. The results show that diversification attributes improve the predictive power of bank failure prediction models, mainly for mid to long-term prediction horizons. Moreover, ordinal classification models provide a better description of the state of the banks prior to failure and are competitive to standard binary classification models.

[1]  Martin Knaup,et al.  A Market-Based Measure of Credit Portfolio Quality and Banks' Performance During the Subprime Crisis , 2009, Manag. Sci..

[2]  Ross Levine,et al.  Is There a Diversification Discount in Financial Conglomerates? , 2005 .

[3]  Pedro Antonio Gutiérrez,et al.  Ordinal Regression Methods: Survey and Experimental Study , 2016, IEEE Transactions on Knowledge and Data Engineering.

[4]  Jeungbo Shim Loan portfolio diversification, market structure and bank stability , 2019, Journal of Banking & Finance.

[5]  Nikolaos I. Papanikolaou To Be Bailed Out or To Be Left to Fail? A Dynamic Competing Risks Hazard Analysis , 2018 .

[6]  Zeineb Affes,et al.  Predicting US Banks Bankruptcy: Logit Versus Canonical Discriminant Analysis , 2016 .

[7]  Steven Mark Miller,et al.  The relative contributions of equity and subordinated debt signals as predictors of bank distress during the financial crisis , 2015 .

[8]  Gokhan Torna,et al.  Nontraditional Banking Activities and Bank Failures During the Financial Crisis , 2013 .

[9]  Fotios Pasiouras,et al.  Assessing Bank Efficiency and Performance with Operational Research and Artificial Intelligence Techniques: A Survey , 2009, Eur. J. Oper. Res..

[10]  Jean-Pierre Fouque,et al.  Stability in a Model of Interbank Lending , 2013, SIAM J. Financial Math..

[11]  L. C. G. Rogers,et al.  Failure and Rescue in an Interbank Network , 2011, Manag. Sci..

[12]  Annalisa Riccardi,et al.  Cost-Sensitive AdaBoost Algorithm for Ordinal Regression Based on Extreme Learning Machine , 2014, IEEE Transactions on Cybernetics.

[13]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[14]  Paolo Giudici,et al.  Estimating bank default with generalised extreme value regression models , 2015, J. Oper. Res. Soc..

[15]  Wei Ge,et al.  Effects of feature construction on classification performance: An empirical study in bank failure prediction , 2009, Expert Syst. Appl..

[16]  René M. Stulz,et al.  The Credit Crisis Around the Globe: Why Did Some Banks Perform Better? , 2011 .

[17]  A. Hackethal,et al.  The Anatomy of Bank Diversification , 2006 .

[18]  Witold Pedrycz,et al.  Multistep Fuzzy Bridged Refinement Domain Adaptation Algorithm and Its Application to Bank Failure Prediction , 2015, IEEE Transactions on Fuzzy Systems.

[19]  Andreas Krause,et al.  Interbank Lending and the Spread of Bank Failures: A Network Model of Systemic Risk , 2012 .

[20]  Serpil Canbas,et al.  Prediction of commercial bank failure via multivariate statistical analysis of financial structures: The Turkish case , 2005, Eur. J. Oper. Res..

[21]  Ability of Accounting and Audit Quality Variables to Predict Bank Failure During the Financial Crisis , 2011 .

[22]  Constantin Zopounidis,et al.  Corporate failure prediction in the European energy sector: A multicriteria approach and the effect of country characteristics , 2017, Eur. J. Oper. Res..

[23]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[24]  J. Viviani,et al.  Predicting bank failure: An improvement by implementing machine learning approach on classical financial ratios , 2017 .

[25]  Lawrence J. White,et al.  Déjà Vu All Over Again: The Causes of U.S. Commercial Bank Failures This Time Around , 2011, Journal of Financial Services Research.

[26]  Peter J. Elmer,et al.  Equity market data, bank failures and market efficiency , 2007 .

[27]  Halil Ibrahim Erdal,et al.  Forecasting Bank Failure: Base Learners, Ensembles and Hybrid Ensembles , 2017 .

[28]  Sumit Sarkar,et al.  Bayesian Models for Early Warning of Bank Failures , 2001, Manag. Sci..

[29]  Xinlei Zhao,et al.  Systematic risk factors and bank failures , 2018, Journal of Economics and Business.

[30]  Constantin Zopounidis,et al.  Multiple criteria decision aiding , 2010 .

[31]  Allen N. Berger,et al.  The Effects of Focus versus Diversification on Bank Performance: Evidence from Chinese Banks , 2010 .

[32]  Shigeyuki Hamori,et al.  Random forests-based early warning system for bank failures , 2016 .

[33]  Theophilos Papadimitriou,et al.  Forecasting bank failures and stress testing: A machine learning approach , 2018, International Journal of Forecasting.

[34]  Shih-Wei Lin,et al.  Applying enhanced data mining approaches in predicting bank performance: A case of Taiwanese commercial banks , 2009, Expert Syst. Appl..

[35]  F. Schweitzer,et al.  Quantifying the Impact of Leveraging and Diversification on Systemic Risk , 2013, 1303.5552.

[36]  Kay Giesecke,et al.  Systemic Risk: What Defaults are Telling Us , 2009, Manag. Sci..

[37]  C. Zopounidis,et al.  Building additive utilities for multi-group hierarchical discrimination: the M.H.Dis method , 2000 .

[39]  Philip E. Strahan,et al.  Diversification, Size, and Risk at Bank Holding Companies , 1997 .

[40]  John Goddard,et al.  The diversification and financial performance of US credit unions. , 2008 .

[41]  Asli Demirgüç-Kunt,et al.  Cross-Country Empirical Studies of Systemic Bank Distress: A Survey , 2005, National Institute Economic Review.

[42]  J. Lopez Using CAMELS ratings to monitor bank conditions , 1999 .

[43]  Francisco José Climent Diranzo,et al.  Anticipating bank distress in the Eurozone: An Extreme Gradient Boosting approach , 2019, Journal of Business Research.

[44]  E. Croci,et al.  Decision-making during the credit crisis: Did the Treasury let commercial banks fail? , 2016 .

[45]  Carlos Serrano-Cinca,et al.  Partial Least Square Discriminant Analysis for bankruptcy prediction , 2013, Decis. Support Syst..

[46]  Francisco José Climent Diranzo,et al.  Predicting failure in the U.S. banking sector: An extreme gradient boosting approach , 2019, International Review of Economics & Finance.

[47]  K. Stiroh Diversification in Banking , 2014 .

[48]  Kadri Männasoo,et al.  Explaining bank distress in Eastern European transition economies. , 2009 .

[49]  Simon Wolfe,et al.  Small European banks: Benefits from diversification? , 2007 .

[50]  T. Conlon,et al.  Credit Default Swaps as Indicators of Bank Financial Distress , 2016, Journal of International Money and Finance.

[51]  Constantin Zopounidis,et al.  Assessing Bank Soundness with Classification Techniques , 2009 .

[52]  Wai-Man Liu,et al.  Elections, Political Competition and Bank Failure , 2012 .

[53]  Chrysovalantis Gaganis,et al.  Bank Diversification and Overall Financial Strength: International Evidence , 2016 .

[54]  I. Hasan,et al.  Financial Crises and Bank Failures: A Review of Prediction Methods , 2009 .

[55]  A. Milne Distance to default and the financial crisis , 2014 .

[56]  Kevin J. Stiroh,et al.  The dark side of diversification: The case of US financial holding companies , 2006 .

[57]  Amine Tarazi,et al.  Bank Income Structure and Risk: An Empirical Analysis of European Banks , 2008 .

[58]  Matthias Köhler Which Banks Are More Risky? The Impact of Business Models on Bank Stability , 2015 .

[59]  Yi Fang,et al.  Predicting US bank failures: A comparison of logit and data mining models , 2018 .

[60]  J. Suykens,et al.  Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research , 2015, Eur. J. Oper. Res..

[61]  Frederic S. Mishkin How Big a Problem is Too Big to Fail? A Review of Gary Stern and Ron Feldman's Too Big to Fail: The Hazards of Bank Bailouts , 2006 .

[62]  Vadlamani Ravi,et al.  Soft computing system for bank performance prediction , 2008, Appl. Soft Comput..

[63]  Bernard De Baets,et al.  ROC analysis in ordinal regression learning , 2008, Pattern Recognit. Lett..

[64]  Peter Sarlin,et al.  Predicting Distress in European Banks , 2013, SSRN Electronic Journal.

[65]  Taghi M. Khoshgoftaar,et al.  RUSBoost: A Hybrid Approach to Alleviating Class Imbalance , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[66]  V. Acharya A Theory of Systemic Risk and Design of Prudential Bank Regulation , 2001 .

[67]  C. Kao,et al.  Predicting bank performance with financial forecasts: A case of Taiwan commercial banks , 2004 .

[68]  Yener Altunbaş,et al.  Realized Bank Risk during the Great Recession , 2015 .

[69]  Wei Chu,et al.  Support Vector Ordinal Regression , 2007, Neural Computation.

[70]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[71]  Luc Laeven,et al.  Bank Size, Capital, and Systemic Risk: Some International Evidence , 2016 .

[72]  James W. Kolari,et al.  Predicting large US commercial bank failures , 2002 .

[73]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[74]  Peter Sarlin,et al.  Bank distress in the news: Describing events through deep learning , 2017, Neurocomputing.

[75]  Hiok Chai Quek,et al.  FCMAC-EWS: A bank failure early warning system based on a novel localized pattern learning and semantically associative fuzzy neural network , 2008, Expert Syst. Appl..

[76]  Silvia Angela Osmetti,et al.  The effectiveness of TARP-CPP on the US banking industry: A new copula-based approach , 2016, Eur. J. Oper. Res..

[77]  Qinghua Huang,et al.  Predicting financial distress and corporate failure: A review from the state-of-the-art definitions, modeling, sampling, and featuring approaches , 2014, Knowl. Based Syst..

[78]  S. Battiston,et al.  Portfolio diversification and systemic risk in interbank networks , 2017 .

[79]  Iván Pastor Sanz,et al.  Bankruptcy visualization and prediction using neural networks: A study of U.S. commercial banks , 2015, Expert Syst. Appl..

[80]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[81]  Do We Need Big Banks? Evidence on Performance, Strategy and Market Discipline , 2011 .

[82]  Davide Salvatore Mare,et al.  Contribution of Macroeconomic Factors to the Prediction of Small Bank Failures , 2012 .

[83]  Juan-Pablo Ortega,et al.  Predicting U.S. Bank Failures with MIDAS Logit Models , 2018, Journal of Financial and Quantitative Analysis.

[84]  P. V. D. Bergh,et al.  SUPERVISORY RISK ASSESSMENT AND EARLY WARNING SYSTEMS , 2000 .

[85]  Paolo Giudici,et al.  Measuring bank contagion in Europe using binary spatial regression models , 2017, J. Oper. Res. Soc..