Building Credit-Risk Evaluation Expert Systems Using Neural Network Rule Extraction and Decision Tables

The problem of credit-risk evaluation is a very challenging and important financial analysis problem. Recently, researchers have found that neural networks perform very well for this complex and unstructured problem when compared to more traditional statistical approaches. A major drawback associated with the use of neural networks for decision making is their lack of explanation capability. While they can achieve a high predictive accuracy rate, the reasoning behind how they reach their decisions is not readily available. In this paper, we present the results from analyzing two real life credit-risk evaluation data sets using neural network rule extraction techniques. Clarifying the neural network decisions by explanatory rules that capture the learned knowledge embedded in the networks can help the human experts in explaining why a particular decision is made. Furthermore, we also discuss how these rules can be visualized as a decision table in a compact and intuitive graphical format. Hence, extracting rules from trained neural networks and representing these rules as a decision table may offer a viable and valuable alternative for building credit-risk evaluation expert systems.

[1]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[2]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[3]  Michael J. Darnell,et al.  Empirical evaluation of decision tables for constructing and comprehending expert system rules , 1992 .

[4]  R. A. Collins,et al.  Statistical methods for bankruptcy forecasting , 1982 .

[5]  Jan Vanthienen,et al.  An Illustration of Verification and Validation in the Modelling Phase of KBS Development , 1998, Data Knowl. Eng..

[6]  Wlodzislaw Duch,et al.  A new methodology of extraction, optimization and application of crisp and fuzzy logical rules , 2001, IEEE Trans. Neural Networks.

[7]  Rudy Setiono,et al.  A Penalty-Function Approach for Pruning Feedforward Neural Networks , 1997, Neural Computation.

[8]  Huan Liu,et al.  Symbolic Representation of Neural Networks , 1996, Computer.

[9]  Alexander Gammerman,et al.  Machine-learning algorithms for credit-card applications , 1992 .

[10]  Jude W. Shavlik,et al.  in Advances in Neural Information Processing , 1996 .

[11]  Murray Smith,et al.  Neural Networks for Statistical Modeling , 1993 .

[12]  Usama M. Fayyad,et al.  Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning , 1993, IJCAI.

[13]  D. Hand,et al.  A k-nearest-neighbour classifier for assessing consumer credit risk , 1996 .

[14]  David West,et al.  Neural network credit scoring models , 2000, Comput. Oper. Res..

[15]  Geert Wets,et al.  From Decision Tables to Expert System Shells , 1994, Data Knowl. Eng..

[16]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[17]  Geert Wets,et al.  Extending a tabular knowledge-based framework with feature selection , 1997 .

[18]  J. Fleiss Statistical methods for rates and proportions , 1974 .

[19]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[20]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .