Bankruptcy forecasting: An empirical comparison of AdaBoost and neural networks

The goal of this study is to show an alternative method to corporate failure prediction. In the last decades Artificial Neural Networks have been widely used for this task. These models have the advantage of being able to detect non-linear relationships and show a good performance in presence of noisy information, as it usually happens, in corporate failure prediction problems. AdaBoost is a novel ensemble learning algorithm that constructs its base classifiers in sequence using different versions of the training data set. In this paper, we compare the prediction accuracy of both techniques on a set of European firms, considering the usual predicting variables such as financial ratios, as well as qualitative variables, such as firm size, activity and legal structure. We show that our approach decreases the generalization error by about thirty percent with respect to the error produced with a neural network.

[1]  Ramesh Sharda,et al.  Performance comparison issues in neural network experiments for classification problems , 1993, [1993] Proceedings of the Twenty-sixth Hawaii International Conference on System Sciences.

[2]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[3]  Ingoo Han,et al.  Hybrid neural network models for bankruptcy predictions , 1996, Decis. Support Syst..

[4]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[5]  Amir F. Atiya,et al.  Bankruptcy prediction for credit risk using neural networks: A survey and new results , 2001, IEEE Trans. Neural Networks.

[6]  Carlos Serrano-Cinca,et al.  Self organizing neural networks for financial diagnosis , 1996, Decision Support Systems.

[7]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[8]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[9]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[10]  David J. Hand,et al.  Discrimination and Classification , 1982 .

[11]  Melody Y. Kiang,et al.  Predicting Bank Failures: A neural network approach , 1990, Appl. Artif. Intell..

[12]  Lawrence O. Hall,et al.  A Comparison of Ensemble Creation Techniques , 2004, Multiple Classifier Systems.

[13]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[14]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[15]  Muriel Perez,et al.  Artificial neural networks and bankruptcy forecasting: a state of the art , 2006, Neural Computing & Applications.

[16]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[17]  L. Breiman.  Arcing Classifiers , 1998 .

[18]  Kimmo Kiviluoto,et al.  Predicting bankruptcies with the self-organizing map , 1998, Neurocomputing.

[19]  Selwyn Piramuthu,et al.  Using Feature Construction to Improve the Performance of Neural Networks , 1998 .

[20]  L. Breiman.  Arcing classifier (with discussion and a rejoinder by the author) , 1998 .

[21]  Andreas Charitou,et al.  ANNALS OF OPERATIONS RESEARCH , 2000 .

[22]  Monica Lam,et al.  Neural network techniques for financial performance prediction: integrating fundamental and technical analysis , 2004, Decis. Support Syst..

[23]  Carlos Serrano-Cinca,et al.  Feedforward neural networks in the classification of financial information , 1997 .

[24]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[25]  W. Beaver.  Financial Ratios As Predictors Of Failure , 1966 .

[26]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[27]  Dov,et al.  The analysis and use of financial statements , 1993 .

[28]  Desmond Fletcher,et al.  Forecasting with neural networks: An application using bankruptcy data , 1993, Inf. Manag..

[29]  Samuel Kaski,et al.  Bankruptcy analysis with self-organizing maps in learning metrics , 2001, IEEE Trans. Neural Networks.

[30]  Teija Laitinen,et al.  Comparative analysis of failure prediction methods: the Finnish case , 1999 .

[31]  Edward I. Altman,et al.  Corporate distress diagnosis: Comparisons using linear discriminant analysis and neural networks (the Italian experience) , 1994 .

[32]  Moshe Leshno,et al.  Neural network prediction analysis: The bankruptcy case , 1996, Neurocomputing.

[33]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[34]  Junsei Tsukuda,et al.  Predicting Japanese corporate bankruptcy in terms of financial data using neural network , 1994 .

[35]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[36]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[37]  Pamela K. Coats,et al.  A neural network for classifying the financial health of a firm , 1995 .

[38]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[39]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[40]  H. Frydman,et al.  Introducing Recursive Partitioning for Financial Classification: The Case of Financial Distress , 1985 .

[41]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[42]  James A. Ohlson.  FINANCIAL RATIOS AND THE PROBABILISTIC PREDICTION OF BANKRUPTCY , 1980 .

[43]  J. Wyatt.  Decision support systems. , 2000, Journal of the Royal Society of Medicine.

[44]  Ran Barniv,et al.  Predicting the outcome following bankruptcy filing: a three-state classification using neural networks , 1997, Intell. Syst. Account. Finance Manag..

[45]  David E. Booth,et al.  A comparison of supervised and unsupervised neural networks in predicting bankruptcy of Korean firms , 2005, Expert Syst. Appl..

[46]  E. Mine Cinar,et al.  Neural Networks: A New Tool for Predicting Thrift Failures , 1992 .

[47]  Jeffrey A. Clark,et al.  Off-site monitoring systems for predicting bank underperformance: a comparison of neural networks, discriminant analysis, and professional human judgment , 2001, Intell. Syst. Account. Finance Manag..

[48]  Marjorie B. Platt,et al.  Probabilistic Neural Networks in Bankruptcy Prediction , 1999 .

[49]  J. Friedman.  Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[50]  Ramesh Sharda,et al.  Bankruptcy prediction using neural networks , 1994, Decis. Support Syst..

[51]  Mark J Funt.  Financial ratios. , 2009, Pennsylvania dental journal.

[52]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[53]  Sungzoon Cho,et al.  Bankruptcy prediction for credit risk using an auto-associative neural network in Korean firms , 2003, 2003 IEEE International Conference on Computational Intelligence for Financial Engineering, 2003. Proceedings..

[54]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[55]  M. Zmijewski.  METHODOLOGICAL ISSUES RELATED TO THE ESTIMATION OF FINANCIAL DISTRESS PREDICTION MODELS , 1984 .

[56]  Michael Y. Hu,et al.  Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis , 1999, Eur. J. Oper. Res..

[57]  Timothy B. Bell,et al.  Neural nets or the logit model? A comparison of each model's ability to predict commercial bank failures , 1997, Intell. Syst. Account. Finance Manag..

[58]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[59]  Kar Yan Tam,et al.  Neural network models and the prediction of bank bankruptcy , 1991 .

[60]  Vadlamani Ravi,et al.  Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review , 2007, Eur. J. Oper. Res..