A novel bankruptcy prediction model based on an adaptive fuzzy k-nearest neighbor method

Bankruptcy prediction is one of the most important issues in financial decision-making. Constructing effective corporate bankruptcy prediction models in time is essential to make companies or banks prevent bankruptcy. This study proposes a novel bankruptcy prediction model based on an adaptive fuzzy k-nearest neighbor (FKNN) method, where the neighborhood size k and the fuzzy strength parameter m are adaptively specified by the continuous particle swarm optimization (PSO) approach. In addition to performing the parameter optimization for FKNN, PSO is also utilized to choose the most discriminative subset of features for prediction. Adaptive control parameters including time-varying acceleration coefficients (TVAC) and time-varying inertia weight (TVIW) are employed to efficiently control the local and global search ability of PSO algorithm. Moreover, both the continuous and binary PSO are implemented in parallel on a multi-core platform. The proposed bankruptcy prediction model, named PTVPSO-FKNN, is compared with five other state-of-the-art classifiers on two real-life cases. The obtained results clearly confirm the superiority of the proposed model in terms of classification accuracy, Type I error, Type II error and area under the receiver operating characteristic curve (AUC) criterion. The proposed model also demonstrates its ability to identify the most discriminative financial ratios. Additionally, the proposed model has reduced a large amount of computational time owing to its parallel implementation. Promisingly, PTVPSO-FKNN might serve as a new candidate of powerful early warning systems for bankruptcy prediction with excellent performance.

[1]  Prakash P. Shenoy,et al.  Using Bayesian networks for bankruptcy prediction: Some methodological issues , 2007, Eur. J. Oper. Res..

[2]  Michael Y. Hu,et al.  Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis , 1999, Eur. J. Oper. Res..

[3]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[4]  Thomas E. McKee,et al.  Genetic programming and rough sets: A hybrid approach to bankruptcy classification , 2002, Eur. J. Oper. Res..

[5]  Kaisa Sere,et al.  Neural networks and genetic algorithms for bankruptcy predictions , 1996 .

[6]  Yi-Chung Hu,et al.  Incorporating a non-additive decision making method into multi-layer neural networks and its application to financial distress analysis , 2008, Knowl. Based Syst..

[7]  T. Warren Liao,et al.  Two manufacturing applications of the fuzzy K-NN algorithm , 1997, Fuzzy Sets Syst..

[8]  Vadlamani Ravi,et al.  Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review , 2007, Eur. J. Oper. Res..

[9]  Vadlamani Ravi,et al.  Financial distress prediction in banks using Group Method of Data Handling neural network, counter propagation neural network and fuzzy ARTMAP , 2010, Knowl. Based Syst..

[10]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[11]  David G. Stork,et al.  Pattern Classification , 1973 .

[12]  Young-Chan Lee,et al.  Bankruptcy prediction using support vector machine with optimal choice of kernel function parameters , 2005, Expert Syst. Appl..

[13]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[14]  Ching-Chiang Yeh,et al.  The use of hybrid manifold learning and support vector machines in the prediction of business failure , 2011, Knowl. Based Syst..

[15]  James A. Ohlson.  FINANCIAL RATIOS AND THE PROBABILISTIC PREDICTION OF BANKRUPTCY , 1980 .

[16]  Kuo-Chen Chou,et al.  Prediction protein structural classes with pseudo-amino acid composition: approximate entropy and hydrophobicity pattern. , 2008, Journal of theoretical biology.

[17]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[18]  W. Pietruszkiewicz,et al.  Dynamical systems and nonlinear Kalman filtering applied in classification , 2008, 2008 7th IEEE International Conference on Cybernetic Intelligent Systems.

[19]  Juan Luis Castro,et al.  Introducing attribute risk for retrieval in case-based reasoning , 2011, Knowl. Based Syst..

[20]  Chih-Fong Tsai.  Financial decision support using neural networks and support vector machines , 2008, Expert Syst. J. Knowl. Eng..

[21]  Ingoo Han,et al.  A case-based reasoning with the feature weights derived by analytic hierarchy process for bankruptcy prediction , 2002, Expert Syst. Appl..

[22]  T. Abdelwahed,et al.  New evolutionary bankruptcy forecasting model based on genetic algorithms and neural networks , 2005, 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05).

[23]  Steven Salzberg,et al.  On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach , 1997, Data Mining and Knowledge Discovery.

[24]  Kyung-shik Shin,et al.  An application of support vector machines in bankruptcy prediction model , 2005, Expert Syst. Appl..

[25]  Barbara Chapman,et al.  Using OpenMP - portable shared memory parallel programming , 2007, Scientific and engineering computation.

[26]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[27]  Constantin Zopounidis,et al.  Business failure prediction using rough sets , 1999, Eur. J. Oper. Res..

[28]  Sumit Sarkar,et al.  Bayesian Models for Early Warning of Bank Failures , 2001, Manag. Sci..

[29]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[30]  W. Beaver.  Financial Ratios As Predictors Of Failure , 1966 .

[31]  Vadlamani Ravi,et al.  Threshold accepting trained principal component neural network and feature subset selection: Application to bankruptcy prediction in banks , 2008, Appl. Soft Comput..

[32]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[33]  Constantin F. Aliferis,et al.  GEMS: A system for automated cancer diagnosis and biomarker discovery from microarray gene expression data , 2005, Int. J. Medical Informatics.

[34]  Chih-Fong Tsai,et al.  Feature selection in bankruptcy prediction , 2009, Knowl. Based Syst..

[35]  Ramesh Sharda,et al.  A neural network model for bankruptcy prediction , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[36]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[37]  Yi-Chung Hu,et al.  Functional-link net with fuzzy integral for bankruptcy prediction , 2007, Neurocomputing.

[38]  Philippe du Jardin,et al.  Predicting bankruptcy using neural networks and other classification methods: The influence of variable selection techniques on model accuracy , 2010, Neurocomputing.

[39]  Seung-Yeon Kim,et al.  Prediction of protein solvent accessibility using fuzzy k-nearest neighbor method , 2005, Bioinform..

[40]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[41]  R. C. West.  A factor-analytic approach to bank condition , 1985 .

[42]  H. Altay Güvenir,et al.  Modeling interestingness of streaming association rules as a benefit-maximizing classification problem , 2009, Knowl. Based Syst..

[43]  Amir F. Atiya,et al.  Bankruptcy prediction for credit risk using neural networks: A survey and new results , 2001, IEEE Trans. Neural Networks.

[44]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[45]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[46]  Ramesh Sharda,et al.  Bankruptcy prediction using neural networks , 1994, Decis. Support Syst..

[47]  Moshe Leshno,et al.  Neural network prediction analysis: The bankruptcy case , 1996, Neurocomputing.

[48]  Angela Y. N. Yip,et al.  Predicting Business Failure with a Case-Based Reasoning Approach , 2004, KES.

[49]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[50]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[51]  James P. Ignizio,et al.  Simultaneous design and training of ontogenic neural network classifiers , 1996, Comput. Oper. Res..

[52]  Ingoo Han,et al.  Hybrid genetic algorithms and support vector machines for bankruptcy prediction , 2006, Expert Syst. Appl..

[53]  Ying Huang,et al.  Prediction of protein subcellular locations using fuzzy k-NN method , 2004, Bioinform..

[54]  Antanas Verikas,et al.  Hybrid and ensemble-based soft computing techniques in bankruptcy prediction: a survey , 2010, Soft Comput..

[55]  Paul Scheunders,et al.  Genetic feature selection combined with composite fuzzy nearest neighbor classifiers for hyperspectral satellite imagery , 2002, Pattern Recognit. Lett..

[56]  Mark J Funt.  Financial ratios. , 2009, Pennsylvania dental journal.

[57]  HuYi-Chung.  Incorporating a non-additive decision making method into multi-layer neural networks and its application to financial distress analysis , 2008 .

[58]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[59]  Fernando Gustavo Tinetti,et al.  Using OpenMP: Portable Shared Memory Parallel Programming , 2010 .

[60]  Chih-Hung Wu,et al.  A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy , 2007, Expert Syst. Appl..

[61]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[62]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[63]  H. Bian,et al.  Fuzzy-rough nearest-neighbor classification approach , 2003, 22nd International Conference of the North American Fuzzy Information Processing Society, NAFIPS 2003.

[64]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[65]  Liang-Hsuan Chen,et al.  Feature selection to diagnose a business crisis by using a real GA-based support vector machine: An empirical study , 2008, Expert Syst. Appl..