A Hybrid Credit Scoring Model Using Neural Networks and Logistic Regression

Credit scoring is one of important issues in banking to control a loss due to debtors who fail to meet their credit payment. Hence, the banks aim to develop their credit scoring model for accurately detecting their bad borrowers. In this study, we propose a hybrid credit scoring model using deep neural networks and logistic regression to improve its predictive accuracy. Our proposed hybrid credit scoring model consists of two phases. In the first phase, we train several neural network models and in the second phase, those models are merged by logistic regression. In experimental part, our model outperformed baseline models on over three benchmark datasets in terms of H-measure, area under the curve (AUC) and accuracy.

[1]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[2]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[3]  David West,et al.  Neural network credit scoring models , 2000, Comput. Oper. Res..

[4]  Anderson Ara,et al.  Classification methods applied to credit scoring: A systematic review and overall comparison , 2016, 1602.02137.

[5]  Paulo J. G. Lisboa,et al.  Making machine learning models interpretable , 2012, ESANN.

[6]  J. Suykens,et al.  Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research , 2015, Eur. J. Oper. Res..

[7]  Taylor B. Arnold,et al.  kerasR: R Interface to the Keras Deep Learning Library , 2017, J. Open Source Softw..

[8]  Yair E. Orgler A Credit Scoring Model for Commercial Loans , 1970 .

[9]  Tian-Shyug Lee,et al.  A two-stage hybrid credit scoring model using artificial neural networks and multivariate adaptive regression splines , 2005, Expert Syst. Appl..

[10]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[11]  Tomaso A. Poggio,et al.  Regularization Theory and Neural Networks Architectures , 1995, Neural Computation.

[12]  Christoforos Anagnostopoulos,et al.  A better Beta for the H measure of classification performance , 2012, Pattern Recognit. Lett..

[13]  D. Cox The Regression Analysis of Binary Sequences , 1958 .

[14]  Bo K. Wong,et al.  Neural network applications in finance: A review and analysis of literature (1990-1996) , 1998, Inf. Manag..

[15]  J. Suykens,et al.  Linear and Non-linear Credit Scoring by Combining Logistic Regression and Support Vector Machines , 2006 .