Building contextual classifiers by integrating fuzzy rule based classification technique and k-nn method for credit scoring

Credit-risk evaluation is a very challenging and important problem in the domain of financial analysis. Many classification methods have been proposed in the literature to tackle this problem. Statistical and neural network based approaches are among the most popular paradigms. However, most of these methods produce so-called ''hard'' classifiers, those generate decisions without any accompanying confidence measure. In contrast, ''soft'' classifiers, such as those designed using fuzzy set theoretic approach; produce a measure of support for the decision (and also alternative decisions) that provides the analyst with greater insight. In this paper, we propose a method of building credit-scoring models using fuzzy rule based classifiers. First, the rule base is learned from the training data using a SOM based method. Then the fuzzy k-nn rule is incorporated with it to design a contextual classifier that integrates the context information from the training set for more robust and qualitatively better classification. Further, a method of seamlessly integrating business constraints into the model is also demonstrated.

[1]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[2]  Bart BaesensRudy Using Neural Network Rule Extraction and Decision Tables for Credit-Risk Evaluation , 2003 .

[3]  Nan-Chen Hsieh,et al.  Hybrid mining approach in the design of credit scoring models , 2005, Expert Syst. Appl..

[4]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[5]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[7]  Nikhil R. Pal,et al.  Dynamic generation of prototypes with self-organizing feature maps for classifier design , 2001, Pattern Recognit..

[8]  David G. Stork,et al.  Pattern Classification , 1973 .

[9]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[10]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[11]  W. Pedrycz,et al.  Generalized means as model of compensative connectives , 1984 .

[12]  Kate A. Smith,et al.  Introduction to Neural Networks and Data Mining for Business Applications , 2000 .

[13]  Luis Samaniego,et al.  Fuzzy rule-based classification of remotely sensed imagery , 2002, IEEE Trans. Geosci. Remote. Sens..

[14]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[15]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[16]  L. Thomas A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers , 2000 .

[17]  Jonathan E. Fieldsend,et al.  Estimating Classification Uncertainty of Bayesian Decision Tree Technique on Financial Data , 2005, Perception-based Data Mining and Decision Making in Economics and Finance.

[18]  Nikhil R. Pal,et al.  Some novel classifiers designed using prototypes extracted by a new scheme based on self-organizing feature map , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .