A Least Squares Fuzzy SVM Approach to Credit Risk Assessment

The support vector machine (SVM) is a class of powerful classification tools that have many successful applications. Their classification results usually belong to either one class or the other. But in many real-world applications, each data point no more exactly belongs to one of the two classes, it may 70% belong to one class and 30% to another. That is, there is a fuzzy membership associated with each data. In such an environment, fuzzy SVM (FSVM), which treats every sample as both positive and negative classes with the fuzzy membership, were introduced. In this way the FSVM will have more generalization ability, while preserving the merit of insensitive to outliers. Although the FSVM has good generalization capability, the computational complexity of the existing FSVM is rather large because the final solution is obtained from solving a quadratic programming (QP) problem. For reducing the complexity, this study proposes a least squares method to solve FSVM. In the proposed model, we consider equality constraints instead of inequalities for the classification problem with a formulation in a least squares sense. As a result the solutions follow directly from solving a set of linear equations instead of QP thus reducing the computational complexity greatly relative to the classical FSVM. For illustration purpose, a real-world credit risk assessment dataset is used to test the effectiveness of the LS-FSVM model.

[1]  R. Malhotra,et al.  Evaluating Consumer Loans Using Neural Networks , 2001 .

[2]  Chih-Chou Chiu,et al.  Credit scoring using the hybrid neural discriminant technique , 2002, Expert Syst. Appl..

[3]  Michael Conrad,et al.  Combining evolution with credit apportionment: A new learning algorithm for neural nets , 1994, Neural Networks.

[4]  Marc Toussaint,et al.  Extracting Motion Primitives from Natural Handwriting Data , 2006, ICANN.

[5]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[6]  J. Wiginton A Note on the Comparison of Logit and Discriminant Models of Consumer Credit Behavior , 1980, Journal of Financial and Quantitative Analysis.

[7]  L. Thomas A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers , 2000 .

[8]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[9]  Fred Glover,et al.  IMPROVED LINEAR PROGRAMMING MODELS FOR DISCRIMINANT ANALYSIS , 1990 .

[10]  Franco Varetto Genetic algorithms applications in the analysis of insolvency risk , 1998 .

[11]  Kin Keung Lai,et al.  A new fuzzy support vector machine to evaluate credit risk , 2005, IEEE Transactions on Fuzzy Systems.

[12]  R. Fletcher Practical Methods of Optimization , 1988 .

[13]  D. Hand,et al.  A k-nearest-neighbour classifier for assessing consumer credit risk , 1996 .

[14]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[15]  Kin Keung Lai,et al.  Credit Risk Analysis Using a Reliability-Based Neural Network Ensemble Model , 2006, ICANN.

[16]  B. Baesens,et al.  A support vector machine approach to credit scoring , 2003 .

[17]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[18]  Kin Keung Lai,et al.  A Novel Support Vector Machine Metamodel for Business Risk Identification , 2006, PRICAI.

[19]  Jonathan N. Crook,et al.  Credit Scoring and Its Applications , 2002, SIAM monographs on mathematical modeling and computation.

[20]  Kin Keung Lai,et al.  Credit Risk Evaluation with Least Square Support Vector Machine , 2006, RSKT.

[21]  Soushan Wu,et al.  Credit rating analysis with support vector machines and neural networks: a market comparative study , 2004, Decis. Support Syst..

[22]  Mu-Chen Chen,et al.  Credit scoring and rejected instances reassigning through evolutionary computation techniques , 2003, Expert Syst. Appl..

[23]  Selwyn Piramuthu,et al.  Financial credit-risk evaluation with neural and neurofuzzy systems , 1999, Eur. J. Oper. Res..

[24]  David J. Hand,et al.  A survey of the issues in consumer credit modelling research , 2005, J. Oper. Res. Soc..

[25]  Geoffrey I. Webb,et al.  PRICAI 2006: Trends in Artificial Intelligence, 9th Pacific Rim International Conference on Artificial Intelligence, Guilin, China, August 7-11, 2006, Proceedings , 2006, PRICAI.

[26]  O. Mangasarian Linear and Nonlinear Separation of Patterns by Linear Programming , 1965 .

[27]  Rashmi Malhotra,et al.  Differentiating between Good Credits and Bad Credits Using Neuro-Fuzzy Systems , 2001, Eur. J. Oper. Res..

[28]  Kin Keung Lai,et al.  Neural Network Metalearning for Credit Scoring , 2006, ICIC.