Predicting business failure using support vector machines with straightforward wrapper: A re-sampling study

Business failure prediction (BFP) is an effective tool to help financial institutions and relevant people to make the right decision in investments, especially in the current competitive environment. This topic belongs to a classification-type task, one of whose aims is to generate more accurate hit ratios. Support vector machine (SVM) is a statistical learning technique, whose advantage is its high generalization performance. The objective of this context is threefold. Firstly, SVM is used to predict business failure by utilizing a straightforward wrapper approach to help the model produce more accurate prediction. The wrapper approach is fulfilled by employing a forward feature selection method, composed of feature ranking and feature selection. Meanwhile, this work attempts to investigate the feasibility of using linear SVMs to select features for all SVMs in the wrapper since non-linear SVMs yield to over-fit the data. Finally, a robust re-sampling approach is used to evaluate model performances for the task of BFP in China. In the empirical research, performances of linear SVM, polynomial SVM, Gaussian SVM, and sigmoid SVM with the best filter of stepwise MDA, and wrappers respectively using linear SVM and non-linear SVMs as evaluating functions are to be compared. The results indicate that the non-linear SVM with radial basis function kernel and features selected by linear SVM compare significantly superiorly to all the other SVMs. Meanwhile, all SVMs with features selected by linear SVM produce at least as good performances as SVMs with other optimal features.

[1]  Richard S. Barr,et al.  Predicting bank failure using DEA to quantify management quality , 1994 .

[2]  Yu-Chiang Hu,et al.  Retail default prediction by using sequential minimal optimization technique , 2009 .

[3]  Richard Weber,et al.  A wrapper method for feature selection using Support Vector Machines , 2009, Inf. Sci..

[4]  Vadlamani Ravi,et al.  Differential evolution trained wavelet neural networks: Application to bankruptcy prediction in banks , 2009, Expert Syst. Appl..

[5]  Gérard Bloch,et al.  Support vector regression from simulation data and few experimental samples , 2008, Inf. Sci..

[6]  Daniel Martin,et al.  Early warning of bank failure: A logit regression approach , 1977 .

[7]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[8]  Ioannis E. Tsolas,et al.  Evaluation of credit risk based on firm performance , 2010, Eur. J. Oper. Res..

[9]  Reshma Khemchandani,et al.  Regularized least squares support vector regression for the simultaneous learning of a function and its derivatives , 2008, Inf. Sci..

[10]  Chih-Hung Wu,et al.  A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy , 2007, Expert Syst. Appl..

[11]  Young-Chan Lee,et al.  Application of support vector machines to corporate credit rating prediction , 2007, Expert Syst. Appl..

[12]  Jie Sun,et al.  An Application of Support Vector Machine to Companies' Financial Distress Prediction , 2006, MDAI.

[13]  Kar Yan Tam,et al.  Neural network models and the prediction of bank bankruptcy , 1991 .

[14]  Chih-Hung Wu,et al.  Developing a business failure prediction model via RST, GRA and CBR , 2009, Expert Syst. Appl..

[15]  H. Frydman,et al.  Introducing Recursive Partitioning for Financial Classification: The Case of Financial Distress , 1985 .

[16]  Dae-Ki Kang,et al.  Ensemble with neural networks for bankruptcy prediction , 2010, Expert Syst. Appl..

[17]  Ming-Fu Hsu,et al.  A hybrid approach of DEA, rough set and support vector machines for business failure prediction , 2010, Expert systems with applications.

[18]  Roberto Kawakami Harrop Galvão,et al.  Neural and Wavelet Network Models for Financial Distress Classification , 2005, Data Mining and Knowledge Discovery.

[19]  Ingoo Han,et al.  Hybrid genetic algorithms and support vector machines for bankruptcy prediction , 2006, Expert Syst. Appl..

[20]  James A. Ohlson FINANCIAL RATIOS AND THE PROBABILISTIC PREDICTION OF BANKRUPTCY , 1980 .

[21]  Cory J. Butz,et al.  Rough set based 1-v-1 and 1-v-r approaches to support vector machine multi-classification , 2007, Inf. Sci..

[22]  Marjorie B. Platt,et al.  Probabilistic Neural Networks in Bankruptcy Prediction , 1999 .

[23]  Hui Li,et al.  Ranking-order case-based reasoning for financial distress prediction , 2008, Knowl. Based Syst..

[24]  Hong Qiao,et al.  Associated evolution of a support vector machine-based classifier for pedestrian detection , 2009, Inf. Sci..

[25]  Xiaoou Li,et al.  On-line fuzzy modeling via clustering and support vector machines , 2008, Inf. Sci..

[26]  Kuldeep Kumar,et al.  Business failure prediction using decision trees , 2010 .

[27]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[28]  Yongsheng Ding,et al.  Forecasting financial condition of Chinese listed companies based on support vector machine , 2008, Expert Syst. Appl..

[29]  Ron Kohavi,et al.  Wrappers for feature selection , 1997 .

[30]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[31]  Vadlamani Ravi,et al.  Financial distress prediction in banks using Group Method of Data Handling neural network, counter propagation neural network and fuzzy ARTMAP , 2010, Knowl. Based Syst..

[32]  Hui Li,et al.  Forecasting business failure in China using case‐based reasoning with hybrid case respresentation , 2009 .

[33]  Constantin Zopounidis,et al.  Business failure prediction using rough sets , 1999, Eur. J. Oper. Res..

[34]  Sumit Sarkar,et al.  Bayesian Models for Early Warning of Bank Failures , 2001, Manag. Sci..

[35]  Ingoo Han,et al.  Bankruptcy prediction using case-based reasoning, neural networks, and discriminant analysis , 1997 .

[36]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[37]  Yuanyuan Wang,et al.  A rough margin based support vector machine , 2008, Inf. Sci..

[38]  Zhongsheng Hua,et al.  Predicting corporate financial distress based on integration of support vector machine and logistic regression , 2007, Expert Syst. Appl..

[39]  Kyung-shik Shin,et al.  An application of support vector machines in bankruptcy prediction model , 2005, Expert Syst. Appl..

[40]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[41]  Wei-Sen Chen,et al.  Using neural networks and data mining techniques for the financial distress prediction model , 2009, Expert Syst. Appl..

[42]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[43]  Chih-Fong Tsai Financial decision support using neural networks and support vector machines , 2008, Expert Syst. J. Knowl. Eng..

[44]  W. Beaver Financial Ratios As Predictors Of Failure , 1966 .

[45]  Young-Chan Lee,et al.  A practical approach to credit scoring , 2008, Expert Syst. Appl..

[46]  I. Burhan Türksen,et al.  Fuzzy functions with support vector machines , 2007, Inf. Sci..

[47]  Yuh-Jye Lee,et al.  Variable selection and oversampling in the use of smooth support vector machines for predicting the default risk of companies , 2009 .

[48]  Young-Chan Lee,et al.  Bankruptcy prediction using support vector machine with optimal choice of kernel function parameters , 2005, Expert Syst. Appl..

[49]  Young S. Kwon,et al.  A practical approach to bankruptcy prediction for small businesses: Substituting the unavailable financial data for credit card sales information , 2010, Expert Syst. Appl..

[50]  Gary Whalen,et al.  A proportional hazards model of bank failure: an examination of its usefulness as an early warning tool , 1991 .

[51]  Yi-Chung Hu,et al.  Comparing four bankruptcy prediction models: Logit, quadratic interval logit, neural and fuzzy neural networks , 2010, Expert Syst. Appl..

[52]  Chih-Fong Tsai,et al.  Using neural network ensembles for bankruptcy prediction and credit scoring , 2008, Expert Syst. Appl..

[53]  Kyoung-jae Kim,et al.  Bankruptcy prediction modeling with hybrid case-based reasoning and genetic algorithms approach , 2009, Appl. Soft Comput..

[54]  Ramesh Sharda,et al.  Bankruptcy prediction using neural networks , 1994, Decis. Support Syst..

[55]  Shaio Yan Huang,et al.  Alternative diagnosis of corporate bankruptcy: A neuro fuzzy approach , 2009, Expert Syst. Appl..