Threshold accepting trained principal component neural network and feature subset selection: Application to bankruptcy prediction in banks

This paper proposes an application of new principal component neural network (PCNN) architecture to bankruptcy prediction problem in commercial banks. Further, a new feature subset selection (FSS) algorithm is proposed. In this architecture, the hidden layer is completely replaced by what is referred to as a 'principal component layer'. This layer consists of a few selected principal components that perform the function of hidden nodes. Moreover, this study proposes an algorithm based on the threshold accepting (TA) meta-heuristic to train the PCNN. The architecture reduces the number of weights by a great number as there are no formal connections between the input layer and the principal component layer. The efficacy of the algorithm is tested on the Spanish banks dataset and Turkish banks dataset. The results showed high generalization power of PCNN in the 10-fold cross-validation and also the feature subsets selected in each of the examples showed high discriminating power. PCNN is also compared with PCA-TANN and PCA-BPNN, which have PCA as the preprocessor and have one hidden layer each. Further comparisons are also made with TANN and BPNN. All these classifiers are compared with respect to the AUC (area under the receiver operating characteristic (ROC) curve) criterion. ROC curve is drawn for each classifier with sensitivity on the X-axis and one-specificity on the Y-axis. Based on the experiments conducted, it is inferred that the proposed PCNN hybrids outperformed other classifiers in terms of AUC. It is also observed that the proposed feature subset selection algorithm is very stable and powerful.

[1]  P. Ravikumar,et al.  Bankruptcy Prediction in Banks by an Ensemble Classifier , 2006, 2006 IEEE International Conference on Industrial Technology.

[2]  Vadlamani Ravi,et al.  Advances in Banking Technology and Management: Impacts of ICT and CRM , 2007 .

[3]  William W. Hsieh,et al.  Applying Neural Network Models to Prediction and Data Analysis in Meteorology and Oceanography. , 1998 .

[4]  Dimitrios I. Fotiadis,et al.  An automatic microcalcification detection system based on a hybrid neural network classifier , 2002, Artif. Intell. Medicine.

[5]  Ramesh Sharda,et al.  Bankruptcy prediction using neural networks , 1994, Decis. Support Syst..

[6]  I H Osman,et al.  Meta-Heuristics Theory and Applications , 2011 .

[7]  Christian Blum,et al.  Training feed-forward neural networks with ant colony optimization: an application to pattern classification , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[8]  Taghi M. Khoshgoftaar,et al.  Using neural networks to predict software faults during testing , 1996, IEEE Trans. Reliab..

[9]  Joni-Kristian Kämäräinen,et al.  Differential Evolution Training Algorithm for Feed-Forward Neural Networks , 2003, Neural Processing Letters.

[10]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[11]  A J O'Toole,et al.  More about the Difference between Men and Women: Evidence from Linear Neural Networks and the Principal-Component Approach , 1995, Perception.

[12]  Gerhard W. Dueck,et al.  Threshold accepting: a general purpose optimization algorithm appearing superior to simulated anneal , 1990 .

[13]  Bahram Alidaee,et al.  Global optimization for artificial neural networks: A tabu search application , 1998, Eur. J. Oper. Res..

[14]  Zelimir Kurtanjek.  Principal component analysis of bioreactor fed-batch operation by computer simulation , 1997 .

[15]  Vadlamani Ravi,et al.  Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review , 2007, Eur. J. Oper. Res..

[16]  Vadlamani Ravi,et al.  A Semi-Online Training Algorithm for the Radial Basis Function Neural Networks: Applications to Bankruptcy Prediction in Banks , 2008 .

[17]  Hans-Jürgen Zimmermann,et al.  Fuzzy rule based classification with FeatureSelector and modified threshold accepting , 2000, Eur. J. Oper. Res..

[18]  Randall S. Sexton,et al.  Toward global optimization of neural networks: A comparison of the genetic algorithm and backpropagation , 1998, Decis. Support Syst..

[19]  Amir F. Atiya,et al.  Bankruptcy prediction for credit risk using neural networks: A survey and new results , 2001, IEEE Trans. Neural Networks.

[20]  Hans-Jürgen Zimmermann,et al.  Fuzzy global optimization of complex system reliability , 2000, IEEE Trans. Fuzzy Syst..

[21]  Venkat Subramanian,et al.  A GRG2-Based System for Training Neural Networks: Design and Computational Experience , 1993, INFORMS J. Comput..

[22]  V. Ravi,et al.  Nonequilibrium simulated-annealing algorithm applied to reliability optimization of complex systems , 1997 .

[23]  Vadlamani Ravi,et al.  Bankruptcy Prediction in Banks by Fuzzy Rule Based Classifier , 2007, 2006 1st International Conference on Digital Information Management.

[24]  Ignacio Olmeda,et al.  Hybrid Classifiers for Financial Multicriteria Decision Making: The Case of Bankruptcy Prediction , 1997 .

[25]  Serpil Canbas,et al.  Prediction of commercial bank failure via multivariate statistical analysis of financial structures: The Turkish case , 2005, Eur. J. Oper. Res..

[26]  Shouhong Wang.  The unpredictability of standard back propagation neural networks in classification applications , 1995 .

[27]  Hans-Jürgen Zimmermann,et al.  A neural network and fuzzy rule base hybrid for pattern classification , 2001, Soft Comput..

[28]  M. Ringnér,et al.  Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks , 2001, Nature Medicine.

[29]  Ingoo Han,et al.  Hybrid neural network models for bankruptcy predictions , 1996, Decis. Support Syst..

[30]  James P. Kelly,et al.  Meta-Heuristics: An Overview , 1996 .

[31]  Stefan C. Kremer,et al.  Clustering unlabeled data with SOMs improves classification of labeled real-world data , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[32]  Gisbert Schneider,et al.  Optimized Particle Swarm Optimization (OPSO) and its application to artificial neural network training , 2006, BMC Bioinformatics.