Setiono Sample selection for credit scoring SAMPLE SELECTION AND NEURAL NETWORK RULE EXTRACTION FOR CREDIT SCORING

We present an approach for sample selection using an ensemble of neural networks (NNs) for credit scoring. The ensemble determines samples that are outliers by checking the NN prediction accuracy on the original training data samples. Samples that are consistently misclassified by NNs in the ensemble are removed from the training data set. The remaining data samples are used to train another NN for rule extraction. Our experimental results show that by eliminating the outliers, NNs can be trained to achieve better predictive accuracy. The rule set extracted from one of these networks is more accurate than the rule set extracted from NNs trained with the original data.

[1]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[2]  Bart Baesens,et al.  Rule Extraction from Minimal Neural Networks for Credit Card Screening , 2011, Int. J. Neural Syst..

[3]  Rudy Setiono,et al.  A note on knowledge discovery using neural networks and its application to credit card screening , 2009, Eur. J. Oper. Res..

[4]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[5]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Bart BaesensRudy Using Neural Network Rule Extraction and Decision Tables for Credit-Risk Evaluation , 2003 .

[7]  Xiang Hui,et al.  Credit scoring model based on selective neural network ensemble , 2011, ICNC.

[8]  John A. Bullinaria,et al.  Neural network ensembles for time series forecasting , 2009, GECCO '09.

[9]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[10]  Steven Finlay,et al.  Multiple classifier architectures and their application to credit risk assessment , 2011, Eur. J. Oper. Res..

[11]  Donglin Wang,et al.  A novel nonlinear RBF neural network ensemble model for financial time series forecasting , 2010, Third International Workshop on Advanced Computational Intelligence.

[12]  Tony R. Martinez,et al.  Improving classification accuracy by identifying and removing instances that should be misclassified , 2011, The 2011 International Joint Conference on Neural Networks.

[13]  David West,et al.  Neural network ensemble strategies for financial decision applications , 2005, Comput. Oper. Res..

[14]  Michael C. Mozer,et al.  Optimizing Classifier Performance via an Approximation to the Wilcoxon-Mann-Whitney Statistic , 2003, ICML.

[15]  Chih-Fong Tsai,et al.  Using neural network ensembles for bankruptcy prediction and credit scoring , 2008, Expert Syst. Appl..