A HYBRID BUSINESS FAILURE PREDICTION MODEL USING LOCALLY LINEAR EMBEDDING AND SUPPORT VECTOR MACHINES

The purpose of this paper is to propose a hybrid model which combines locally linear embedding (LLE) algorithm and support vector machines (SVM) to predict the failure of firms based on past financial performance data. By making use of the LLE algorithm to perform dimension reduction for feature extraction, is then utilized as a preprocessor to improve business failure prediction capability by SVM. The effectiveness of the methodology was verified by comparing principal component analysis (PCA) and SVM with our proposed hybrid approach. The results show that our hybrid approach not only has the best classification rate, but also produces the lowest incidence of Type I and Type II errors, and is capable to provide on time signals for better investment and government decisions with timely warnings.

[1]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[2]  Hui Li,et al.  Predicting business failure using multiple case-based reasoning combined with support vector machine , 2009, Expert Syst. Appl..

[3]  Chih-Jen Lin,et al.  Combining SVMs with Various Feature Selection Strategies , 2006, Feature Extraction.

[4]  W. Beaver.  Financial Ratios As Predictors Of Failure , 1966 .

[5]  A. Elgammal,et al.  Separating style and content on a nonlinear manifold , 2004, CVPR 2004.

[6]  Hui Li,et al.  Ranking-order case-based reasoning for financial distress prediction , 2008, Knowl. Based Syst..

[7]  Melody Y. Kiang,et al.  Managerial Applications of Neural Networks: The Case of Bank Failure Predictions , 1992 .

[8]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[9]  Matti Pietikäinen,et al.  Unsupervised learning using locally linear embedding: experiments with face pose analysis , 2002, Object recognition supported by user interaction for service robots.

[10]  Antanas Verikas,et al.  Hybrid and ensemble-based soft computing techniques in bankruptcy prediction: a survey , 2010, Soft Comput..

[11]  Maja J. Mataric,et al.  A spatio-temporal extension to Isomap nonlinear dimension reduction , 2004, ICML.

[12]  Olli Silven,et al.  Comparison of dimensionality reduction methods for wood surface inspection , 2003, International Conference on Quality Control by Artificial Vision.

[13]  Yongsheng Ding,et al.  Forecasting financial condition of Chinese listed companies based on support vector machine , 2008, Expert Syst. Appl..

[14]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[15]  Kevin G. Coleman,et al.  Neural networks for bankruptcy prediction: the power to solve financial problems , 1991 .

[16]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[17]  Ming-Hsuan Yang,et al.  Face recognition using extended isomap , 2002, Proceedings. International Conference on Image Processing.

[18]  Soushan Wu,et al.  Credit rating analysis with support vector machines and neural networks: a market comparative study , 2004, Decis. Support Syst..

[19]  Ching-Chiang Yeh,et al.  The use of hybrid manifold learning and support vector machines in the prediction of business failure , 2011, Knowl. Based Syst..

[20]  Johan A. K. Suykens,et al.  Bankruptcy prediction with least squares support vector machine classifiers , 2003, 2003 IEEE International Conference on Computational Intelligence for Financial Engineering, 2003. Proceedings..

[21]  Matthew Brand,et al.  Charting a Manifold , 2002, NIPS.

[22]  Anil K. Jain,et al.  An Intrinsic Dimensionality Estimator from Near-Neighbor Information , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Young-Chan Lee,et al.  Bankruptcy prediction using support vector machine with optimal choice of kernel function parameters , 2005, Expert Syst. Appl..

[24]  A. Elgammal,et al.  Inferring 3D body pose from silhouettes using activity manifold learning , 2004, CVPR 2004.

[25]  E. Deakin.  Discriminant Analysis Of Predictors Of Business Failure , 1972 .

[26]  Marc Blum.  FAILING COMPANY DISCRIMINANT-ANALYSIS , 1974 .

[27]  Michael Y. Hu,et al.  Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis , 1999, Eur. J. Oper. Res..

[28]  Ming-Fu Hsu,et al.  A hybrid approach of DEA, rough set and support vector machines for business failure prediction , 2010, Expert systems with applications.

[29]  Balázs Kégl,et al.  Intrinsic Dimension Estimation Using Packing Numbers , 2002, NIPS.

[30]  Stephanie M. Bryant,et al.  A case-based reasoning approach to bankruptcy prediction modeling , 1997, Intell. Syst. Account. Finance Manag..

[31]  Stan Z. Li,et al.  Nonlinear mapping from multi-view face patterns to a Gaussian distribution in a low dimensional space , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[32]  B. Ahn,et al.  The integrated methodology of rough set theory and artificial neural network for business failure prediction , 2000 .

[33]  Stan Z. Li,et al.  Nearest manifold approach for face recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[34]  Joshua B. Tenenbaum,et al.  Global Versus Local Methods in Nonlinear Dimensionality Reduction , 2002, NIPS.

[35]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[36]  C. Zavgren,et al.  The prediction of corporate failure: The state of the art , 1983 .

[37]  Kyung-shik Shin,et al.  An application of support vector machines in bankruptcy prediction model , 2005, Expert Syst. Appl..

[38]  Ingoo Han,et al.  Hybrid genetic algorithms and support vector machines for bankruptcy prediction , 2006, Expert Syst. Appl..

[39]  Manfred Wenzel,et al.  Neural Networks, a tool for prediction ? , 1993 .

[40]  Chih-Hung Wu,et al.  A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy , 2007, Expert Syst. Appl..

[41]  Marimuthu Palaniswami,et al.  Selecting bankruptcy predictors using a support vector machine approach , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[42]  Carl Gold,et al.  Model selection for support vector machine classification , 2002, Neurocomputing.

[43]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[44]  H. Sebastian Seung,et al.  The Manifold Ways of Perception , 2000, Science.

[45]  Vadlamani Ravi,et al.  Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review , 2007, Eur. J. Oper. Res..

[46]  Constantin Zopounidis,et al.  A survey of business failures with an emphasis on prediction methods and industrial applications , 1996 .

[47]  Carl-Fredrik Westin,et al.  Coloring of DT-MRI Fiber Traces Using Laplacian Eigenmaps , 2003, EUROCAST.

[48]  Changbo Hu,et al.  Probabilistic expression analysis on manifolds , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[49]  Bernardete Ribeiro,et al.  Supervised Isomap with Dissimilarity Measures in Embedding Learning , 2008, CIARP.

[50]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[51]  Qingzhong Liu,et al.  Learning Manifolds for Bankruptcy Analysis , 2008, ICONIP.

[52]  Ramesh Sharda,et al.  Bankruptcy prediction using neural networks , 1994, Decis. Support Syst..

[53]  Jezekiel Ben-Arie,et al.  Minimal classification method with error-correcting codes for multiclass recognition , 2005, Int. J. Pattern Recognit. Artif. Intell..

[54]  Steven Salzberg,et al.  On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach , 1997, Data Mining and Knowledge Discovery.

[55]  James A. Ohlson.  FINANCIAL RATIOS AND THE PROBABILISTIC PREDICTION OF BANKRUPTCY , 1980 .