Credit scoring using support vector machines with direct search for parameters selection

Support vector machines (SVM) is an effective tool for building good credit scoring models. However, the performance of the model depends on its parameters’ setting. In this study, we use direct search method to optimize the SVM-based credit scoring model and compare it with other three parameters optimization methods, such as grid search, method based on design of experiment (DOE) and genetic algorithm (GA). Two real-world credit datasets are selected to demonstrate the effectiveness and feasibility of the method. The results show that the direct search method can find the effective model with high classification accuracy and good robustness and keep less dependency on the initial search space or point setting.

[1]  Charles P. Staelin.  Parameter selection for support vector machines , 2002 .

[2]  David West,et al.  Neural network credit scoring models , 2000, Comput. Oper. Res..

[3]  Jonathan Crook,et al.  Credit Scoring Models in the Credit Union Environment Using Neural Networks and Genetic Algorithms , 1997 .

[4]  William V. Gehrlein,et al.  A two-stage least cost credit scoring model , 1997, Ann. Oper. Res..

[5]  Fred Glover,et al.  IMPROVED LINEAR PROGRAMMING MODELS FOR DISCRIMINANT ANALYSIS , 1990 .

[6]  Jinwu Gao,et al.  Credibilistic Game with Fuzzy Information , 2007 .

[7]  John L. Adrian,et al.  A linear programming alternative to discriminant analysis in credit scoring , 1985 .

[8]  L. Thomas.  A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers , 2000 .

[9]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[10]  J. Crook,et al.  Credit scoring using neural and evolutionary techniques , 2000 .

[11]  Kin Keung Lai,et al.  Credit Risk Evaluation with Least Square Support Vector Machine , 2006, RSKT.

[12]  Mu-Chen Chen,et al.  Credit scoring with a data mining approach based on support vector machines , 2007, Expert Syst. Appl..

[13]  B. Baesens,et al.  A support vector machine approach to credit scoring , 2003 .

[14]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[15]  Johan A. K. Suykens,et al.  Benchmarking state-of-the-art classification algorithms for credit scoring , 2003, J. Oper. Res. Soc..

[16]  Eric Rosenberg,et al.  Quantitative Methods in Credit Management: A Survey , 1994, Oper. Res..

[17]  Ralf Stecking,et al.  Support vector machines for classifying and describing credit applicants: detecting typical and critical regions , 2005, J. Oper. Res. Soc..

[18]  Herbert L. Jensen,et al.  Using Neural Networks for Credit Scoring , 1992 .

[19]  J. Wiginton.  A Note on the Comparison of Logit and Discriminant Models of Consumer Credit Behavior , 1980, Journal of Financial and Quantitative Analysis.

[20]  David J. Hand,et al.  Construction of a k-nearest-neighbour credit-scoring system , 1997 .

[21]  James H. Myers,et al.  The Development of Numerical Credit Evaluation Systems , 1963 .