A literature review on the application of evolutionary computing to credit scoring

The last years have seen the development of many credit scoring models for assessing the creditworthiness of loan applicants. Traditional credit scoring methodology has involved the use of statistical and mathematical programming techniques such as discriminant analysis, linear and logistic regression, linear and quadratic programming, or decision trees. However, the importance of credit grant decisions for financial institutions has caused growing interest in using a variety of computational intelligence techniques. This paper concentrates on evolutionary computing, which is viewed as one of the most promising paradigms of computational intelligence. Taking into account the synergistic relationship between the communities of Economics and Computer Science, the aim of this paper is to summarize the most recent developments in the application of evolutionary algorithms to credit scoring by means of a thorough review of scientific articles published during the period 2000–2012.

[1]  F. Herrera,et al.  Genetic learning of fuzzy rule‐based classification systems cooperating with fuzzy reasoning methods , 1998 .

[2]  Bart Baesens,et al.  Inferring descriptive and approximate fuzzy rules for credit scoring using evolutionary algorithms , 2007, Eur. J. Oper. Res..

[3]  Shuai Lv,et al.  Application of Genetic Programming in credit scoring , 2008, 2008 Chinese Control and Decision Conference.

[4]  C ONG,et al.  Building credit scoring models using genetic programming , 2005, Expert Syst. Appl..

[5]  Jure Zupan,et al.  Consumer Credit Scoring Models with Limited Data , 2007, Expert Syst. Appl..

[6]  A. Neil Burgess,et al.  Neural networks in financial engineering: a study in methodology , 1997, IEEE Trans. Neural Networks.

[7]  Susan E. Bedingfield,et al.  Predicting Bad Credit Risk: An Evolutionary Approach , 2003, ICANN.

[8]  Bo K. Wong,et al.  Neural network applications in business: A review and analysis of the literature (1988-1995) , 1997, Decis. Support Syst..

[9]  Xiaoyong Liu,et al.  A Hybrid Model for Credit Evaluation Problem , 2011, ICSI.

[10]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[11]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[12]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[13]  David West,et al.  Neural network credit scoring models , 2000, Comput. Oper. Res..

[14]  Jonathan Crook,et al.  Credit Scoring Models in the Credit Union Environment Using Neural Networks and Genetic Algorithms , 1997 .

[15]  Wenxue Cai,et al.  A Genetic Algorithm Model for Personal Credit Scoring , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[16]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[17]  Kin Keung Lai,et al.  Credit scoring using support vector machines with direct search for parameters selection , 2008, Soft Comput..

[18]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[19]  E. George.  The Variable Selection Problem , 2000 .

[20]  Kin Keung Lai,et al.  Credit risk evaluation using a weighted least squares SVM classifier with design of experiment for parameter selection , 2011, Expert Syst. Appl..

[21]  Alex A. Freitas,et al.  Evolutionary Computation , 2002 .

[22]  Jonathan Crook,et al.  Does reject inference really improve the performance of application scoring models , 2004 .

[23]  Athanasios Tsakonas,et al.  Hierarchical classification trees using type-constrained genetic programming , 2002, Proceedings First International IEEE Symposium Intelligent Systems.

[24]  Jian-guo Zhou,et al.  Credit Risk Assessment Using Rough Set Theory and GA-Based SVM , 2008, 2008 The 3rd International Conference on Grid and Pervasive Computing - Workshops.

[25]  José Salvador Sánchez,et al.  On the use of data filtering techniques for credit risk prediction with instance-based models , 2012, Expert Syst. Appl..

[26]  Terence C. Fogarty,et al.  Evolving Bayesian classifiers for credit control—a comparison with other machine-learning methods , 1993 .

[27]  Constantin Zopounidis,et al.  A survey of business failures with an emphasis on prediction methods and industrial applications , 1996 .

[28]  Alfredo Vellido,et al.  Neural networks in business: a survey of applications (1992–1998) , 1999 .

[29]  N. Ampazis,et al.  Towards a Comprehensible and Accurate Credit Management Model: Application of Four Computational Intelligence Methodologies , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[30]  Stjepan Oreski,et al.  Hybrid system with genetic algorithm and artificial neural networks and its application to retail credit risk assessment , 2012, Expert Syst. Appl..

[31]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[32]  Dimitris K. Tasoulis,et al.  Adaptive consumer credit classification , 2012, J. Oper. Res. Soc..

[33]  Manoj Kumar Tiwari,et al.  Computational time reduction for credit scoring: An integrated approach based on support vector machine and stratified sampling method , 2012, Expert Syst. Appl..

[34]  Yi Jiang,et al.  A Comparison Study of Credit Scoring Models , 2007, Third International Conference on Natural Computation (ICNC 2007).

[35]  So Young Sohn,et al.  Cluster-based dynamic scoring model , 2007, Expert Syst. Appl..

[36]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[37]  Boris Delibasic,et al.  A case-based reasoning model that uses preference theory functions for credit scoring , 2012, Expert Syst. Appl..

[38]  Franco Varetto.  Genetic algorithms applications in the analysis of insolvency risk , 1998 .

[39]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[40]  Bart Baesens,et al.  Comparing a genetic fuzzy and a neurofuzzy classifier for credit scoring , 2002, Int. J. Intell. Syst..

[41]  Markus Leippold,et al.  Economic Benefit of Powerful Credit Scoring , 2005 .

[42]  Arash Bahrammirzaee,et al.  A comparative survey of artificial intelligence applications in finance: artificial neural networks, expert system and hybrid intelligent systems , 2010, Neural Computing and Applications.

[43]  Eivind Bernhardsen,et al.  Model for Analysing Credit Risk in the Enterprise Sector , 2001 .

[44]  J. Crook,et al.  Credit scoring using neural and evolutionary techniques , 2000 .

[45]  Raquel Florez-Lopez,et al.  Effects of missing data in credit risk scoring. A comparative analysis of methods to achieve robustness in the absence of sufficient data , 2010 .

[46]  Theodore Johnson,et al.  Exploratory Data Mining and Data Cleaning , 2003 .

[47]  Chengqi Zhang,et al.  Guest Editors' Introduction: Special Section on Intelligent Data Preparation , 2005, IEEE Trans. Knowl. Data Eng..

[48]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[49]  Mu-Chen Chen,et al.  Credit scoring and rejected instances reassigning through evolutionary computation techniques , 2003, Expert Syst. Appl..

[50]  Minghui Jiang,et al.  The Applied Research of Credit Scoring Combination Model Based on SA-GA Algorithm , 2011, 2011 Fourth International Conference on Business Intelligence and Financial Engineering.

[51]  David J. Hand,et al.  Statistical Classification Methods in Consumer Credit Scoring: a Review , 1997 .

[52]  Steven Finlay,et al.  Are we modelling the right thing? The impact of incorrect problem specification in credit scoring , 2009, Expert Syst. Appl..

[53]  Sebastian Fritz,et al.  Restructuring the credit process: behaviour scoring for german corporates , 2000, Intell. Syst. Account. Finance Manag..

[54]  Jih-Jeng Huang,et al.  Two-stage genetic programming (2SGP) for the credit scoring model , 2006, Appl. Math. Comput..

[55]  Mohammad Ebrahim Mohammad Pourzarandi,et al.  Using Genetic Algorithm in Optimizing Decision Trees for Credit Scoring of Banks Customers , 2010 .

[56]  Paulius Danenas,et al.  Credit risk evaluation modeling using evolutionary linear SVM classifiers and sliding window approach , 2012, ICCS.

[57]  Andres M. Gonzalez,et al.  Evolutionary Algorithms for Selecting the Architecture of a MLP Neural Network: A Credit Scoring Case , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[58]  Teh Ying Wah,et al.  Intelligent credit scoring model using soft computing approach , 2008, 2008 International Conference on Computer and Communication Engineering.

[59]  M. C. Sinclair,et al.  Classification rule mining for automatic credit approval using genetic programming , 2007, 2007 IEEE Congress on Evolutionary Computation.

[60]  Chiun-Chieh Hsu,et al.  A hybrid approach to integrate genetic algorithm into dual scoring model in enhancing the performance of credit scoring model , 2012, Expert Syst. Appl..

[61]  Amitabha Mukerjee,et al.  Multi–objective Evolutionary Algorithms for the Risk–return Trade–off in Bank Loan Management , 2002 .

[62]  Jui-Sheng Chou,et al.  Data pre-processing by genetic algorithms for bankruptcy prediction , 2011, 2011 IEEE International Conference on Industrial Engineering and Engineering Management.

[63]  Montserrat Guillén,et al.  Count data models for a credit scoring system , 1996 .

[64]  Hussein A. Abdou,et al.  Credit Scoring, Statistical Techniques and Evaluation Criteria: A Review of the Literature , 2011, Intell. Syst. Account. Finance Manag..

[65]  Shorouq Fathi Eletter,et al.  Neuro-Based Artificial Intelligence Model for Loan Decisions , 2010 .

[66]  Jonathan N. Crook,et al.  Credit Scoring and Its Applications , 2002, SIAM monographs on mathematical modeling and computation.

[67]  Jan Peters,et al.  Computational Intelligence: Principles, Techniques and Applications , 2007, Comput. J..

[68]  Yogesh Kumar Dwivedi,et al.  A profile of OR research and practice published in the Journal of the Operational Research Society , 2010, J. Oper. Res. Soc..

[69]  Jianping Li,et al.  Evolution strategy based adaptive Lq penalty support vector machines with Gauss kernel for credit risk analysis , 2012, Appl. Soft Comput..

[70]  Yin-Fu Huang,et al.  Evolutionary-based feature selection approaches with new criteria for data mining: A case study of credit approval data , 2009, Expert Syst. Appl..

[71]  Vijay S. Desai,et al.  A comparison of neural networks and linear scoring models in the credit union environment , 1996 .

[72]  Kostas S. Metaxiotis,et al.  The contribution of neural networks and genetic algorithms to business decision support: Academic myth or practical solution? , 2004 .

[73]  Jacek M. Zurada,et al.  Computational Intelligence: Imitating Life , 1994 .

[74]  Bart Baesens,et al.  Comprehensible Credit Scoring Models Using Rule Extraction from Support Vector Machines , 2007, Eur. J. Oper. Res..

[75]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[76]  Jonathan N. Crook,et al.  Recent developments in consumer credit risk assessment , 2007, Eur. J. Oper. Res..

[77]  Johan A. K. Suykens,et al.  Benchmarking state-of-the-art classification algorithms for credit scoring , 2003, J. Oper. Res. Soc..

[78]  Steven Finlay,et al.  Using genetic algorithms to develop scoring models for alternative measures of performance , 2005 .

[79]  Steven Finlay,et al.  Credit scoring for profitability objectives , 2010, Eur. J. Oper. Res..

[80]  María José del Jesús,et al.  Genetic learning of fuzzy rule-based classification systems cooperating with fuzzy reasoning methods , 1998, Int. J. Intell. Syst..

[81]  Ying Wah Teh,et al.  A Transparent Classification Model Using a Hybrid Soft Computing Method , 2009, 2009 Third Asia International Conference on Modelling & Simulation.

[82]  Randall S. Sexton,et al.  Knowledge discovery using a neural network simultaneous optimization algorithm on a real world classification problem , 2006, Eur. J. Oper. Res..

[83]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[84]  L. Thomas.  A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers , 2000 .

[85]  Magdalene Marinaki,et al.  Optimization of nearest neighbor classifiers via metaheuristic algorithms for credit risk assessment , 2008, J. Glob. Optim..

[86]  Ping Yao.  Hybrid Fuzzy SVM Model Using CART and MARS for Credit Scoring , 2009, 2009 International Conference on Intelligent Human-Machine Systems and Cybernetics.

[87]  Wei Xu,et al.  A Support Vector Machine Based Method for Credit Risk Assessment , 2010, 2010 IEEE 7th International Conference on E-Business Engineering.

[88]  Defu Zhang,et al.  A Decision Tree Scoring Model Based on Genetic Algorithm and K-Means Algorithm , 2008, 2008 Third International Conference on Convergence and Hybrid Information Technology.

[89]  Shian-Chang Huang,et al.  Customer credit quality assessments using data mining methods for banking industries , 2011 .

[90]  Jianping Li,et al.  An evolution strategy-based multiple kernels multi-criteria programming approach: The case of credit decision making , 2011, Decis. Support Syst..

[91]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[92]  Tom Fawcett,et al.  Adaptive Fraud Detection , 1997, Data Mining and Knowledge Discovery.

[93]  Clark R. Abrahams,et al.  Fair Lending Compliance: Intelligence and Implications for Credit Risk Management , 2008 .

[94]  Marley M. B. R. Vellasco,et al.  A new model for credit approval problems: A quantum-inspired neuro-evolutionary algorithm with binary-real representation , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[95]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[96]  Mhand Hifi,et al.  A Hybrid Credit Scoring Model Based on Genetic Programming and Support Vector Machines , 2008, 2008 Fourth International Conference on Natural Computation.

[97]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Evolutionary Radial Basis Functions for Credit Assessment , 2005, Applied Intelligence.

[98]  Kenneth Kennedy,et al.  Learning without Default: A Study of One-Class Classification and the Low-Default Portfolio Problem , 2009, AICS.

[99]  John Fulcher,et al.  Computational Intelligence: An Introduction , 2008, Computational Intelligence: A Compendium.

[100]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[101]  Georgios Dounias,et al.  Data Classification using Fuzzy Rule-Based Systems represented as Genetic Programming Type-Constrain , 2001 .

[102]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[103]  Jure Zupan,et al.  Optimisation of structure representation for QSAR studies , 1999 .

[104]  Eric Rosenberg,et al.  Quantitative Methods in Credit Management: A Survey , 1994, Oper. Res..

[105]  Dorian Pyle,et al.  Data Preparation for Data Mining , 1999 .

[106]  A. Lucas,et al.  Statistical challenges in credit card issuing , 2001 .

[107]  Minghui Jiang,et al.  Hybrid Neural Network Based on GA-BP for Personal Credit Scoring , 2008, 2008 Fourth International Conference on Natural Computation.

[108]  Fred W. Glover,et al.  Tabu Search - Part I , 1989, INFORMS J. Comput..

[109]  Hussein A. Abdou.  Genetic programming for credit scoring: The case of Egyptian public sector banks , 2009, Expert Syst. Appl..

[110]  Amit Konar,et al.  Computational Intelligence: Principles, Techniques and Applications , 2005 .

[111]  Mu-Chen Chen,et al.  Credit scoring with a data mining approach based on support vector machines , 2007, Expert Syst. Appl..

[112]  Suran Asitha Goonatilake,et al.  Intelligent Systems for Finance and Business , 1995 .