Voting features based classifier with feature construction and its application to predicting financial distress

Voting features based classifiers, shortly VFC, have been shown to perform well on most real-world data sets. They are robust to irrelevant features and missing feature values. In this paper, we introduce an extension to VFC, called voting features based classifier with feature construction, VFCC for short, and show its application to the problem of predicting if a bank will encounter financial distress, by analyzing current financial statements. The previously developed VFC learn a set of rules that contain a single condition based on a single feature in their antecedent. The VFCC algorithm proposed in this work, on the other hand, constructs rules whose antecedents may contain conjuncts based on several features. Experimental results on recent financial ratios of banks in Turkey show that the VFCC algorithm achieves better accuracy than other well-known rule learning classification algorithms.

[1]  H. Altay Güvenir A Classification Learning Algorithm Robust to Irrelevant Features , 1998, AIMSA.

[2]  Chong-Ho Choi,et al.  A discriminant analysis using composite features for classification problems , 2007, Pattern Recognit..

[3]  H. Altay Güvenir,et al.  Learning differential diagnosis of erythemato-squamous diseases using voting feature intervals , 1998, Artif. Intell. Medicine.

[4]  Hiok Chai Quek,et al.  FCMAC-EWS: A bank failure early warning system based on a novel localized pattern learning and semantically associative fuzzy neural network , 2008, Expert Syst. Appl..

[5]  Paul E. Utgoff,et al.  Feature construction for game playing , 2001 .

[6]  Johannes Fürnkranz,et al.  Machines that learn to play games , 2001 .

[7]  Hiok Chai Quek,et al.  GenSo-EWS: a novel neural-fuzzy based early warning system for predicting bank failures , 2004, Neural Networks.

[8]  Selwyn Piramuthu Feature construction for reduction of tabular knowledge-based systems , 2004, Inf. Sci..

[9]  Munehisa Kasuya,et al.  Impaired Bank Health and Default Risk ( Forthcoming in "Pacific-Basin Finance Journal". ) , 2008 .

[10]  Munehisa Kasuya,et al.  Impaired Bank Health and Default Risk , 2005 .

[11]  H. A. Guvenir,et al.  Classification by Feature Partitioning , 1996, Machine Learning.

[12]  Blaise Hanczar,et al.  Feature construction from synergic pairs to improve microarray-based classification , 2007, Bioinform..

[13]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[14]  Dap Hartmann,et al.  MACHINES THAT LEARN TO PLAY GAMES , 2002 .

[15]  Gleb Lanine,et al.  Failure prediction in the Russian bank sector with logit and trait recognition models , 2006, Expert Syst. Appl..

[16]  Constance Apea,et al.  A Case Study of Ghana Co-operative Bank Ltd. , 2002 .

[17]  H. Altay Güvenir,et al.  Diagnosis of gastric carcinoma by classification on feature projections , 2004, Artif. Intell. Medicine.

[18]  Eiji Harada,et al.  Bank failures in mature economies , 2004 .