Credit scoring models for Egyptian banks : neural nets and genetic programming versus conventional techniques

Credit scoring has been regarded as a core appraisal tool of banks during the last few decades, and has been widely investigated in the area of finance, in general, and banking sectors, in particular. In this thesis, the main aims and objectives are: to identify the currently used techniques in the Egyptian banking credit evaluation process; and to build credit scoring models to evaluate personal bank loans. In addition, the subsidiary aims are to evaluate the impact of sample proportion selection on the Predictive capability of both advanced scoring techniques and conventional scoring techniques, for both public banks and a private banking case-study; and to determine the key characteristics that affect the personal loans' quality (default risk). The stages of the research comprised: firstly, an investigative phase, including an early pilot study, structured interviews and a questionnaire; and secondly, an evaluative phase, including an analysis of two different data-sets from the Egyptian private and public banks applying average correct classification rates and estimated misclassification costs as criteria. Both advanced scoring techniques, namely, neural nets (probabilistic neural nets and multi-layer feed-forward nets) and genetic programming, and conventional techniques, namely, a weight of evidence measure, multiple discriminant analysis, probit analysis and logistic regression were used to evaluate credit default risk in Egyptian banks. In addition, an analysis of the data-sets using Kohonen maps was undertaken to provide additional visual insights into cluster groupings. From the investigative stage, it was found that all public and the vast majority of private banks in Egypt are using judgemental approaches in their credit evaluation. From the evaluative stage, clear distinctions between the conventional techniques and the advanced techniques were found for the private banking case-study; and the advanced scoring techniques (such as powerful neural nets and genetic programming) were superior to the conventional techniques for the public sector banks. Concurrent loans from other banks and guarantees by the corporate employer of the loan applicant, which have not been used in other reported studies, are identified as key variables and recommended in the specific environment chosen, namely Egypt. Other variables, such as a feasibility study and the Central Bank of Egypt report also play a contributory role in affecting the loan quality. List of

[1]  D. M. Titterington,et al.  Statistics and Neural Networks , 2000, Technometrics.

[2]  Jih-Jeng Huang,et al.  Two-stage genetic programming (2SGP) for the credit scoring model , 2006, Appl. Math. Comput..

[3]  Jure Zupan,et al.  Consumer Credit Scoring Models with Limited Data , 2007, Expert Syst. Appl..

[4]  R. Malhotra,et al.  Evaluating Consumer Loans Using Neural Networks , 2001 .

[5]  Soumitra Dutta,et al.  Decision support in non-conservative domains: Generalization with neural networks , 1992, Decis. Support Syst..

[6]  Joe Whittaker,et al.  Quantile regression for modelling distributions of profit and loss , 2007, Eur. J. Oper. Res..

[7]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[8]  David J. Hand,et al.  Construction and Assessment of Classification Rules , 1997 .

[9]  Ahmet Burak Emel,et al.  A credit scoring approach for the commercial banking sector , 2003 .

[10]  Robert J. Elliott,et al.  A self tuning model for risk estimation , 2008, Expert Syst. Appl..

[11]  Daniel Enache,et al.  Analyzing Credit Risk Data: A Comparison of Logistic Discrimination, Classification Tree Analysis, a , 1997 .

[12]  Siew Lan Loo Neural networks for financial forecasting , 1994 .

[13]  Lyn C. Thomas,et al.  Readings in Credit Scoring , 2004 .

[14]  K. Leonard The development of credit scoring quality measures for consumer credit applications , 1995 .

[15]  Bahar Celikkol Erbas,et al.  An application of neural networks in microeconomics: Input-output mapping in a power generation subsector of the US electricity industry , 2009, Expert Syst. Appl..

[16]  Vijay S. Desai,et al.  A comparison of neural networks and linear scoring models in the credit union environment , 1996 .

[17]  A D Lovie,et al.  The bootstrapped model--Lessons for the acceptance of intellectual technology. , 1987, Applied ergonomics.

[18]  Dennis L. Hoffman,et al.  An econometric analysis of the bank credit scoring problem , 1989 .

[19]  Chih-Fong Tsai,et al.  Using neural network ensembles for bankruptcy prediction and credit scoring , 2008, Expert Syst. Appl..

[20]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[21]  B. Casu,et al.  Introduction to Banking , 2006 .

[22]  Michael Y. Hu,et al.  Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis , 1999, Eur. J. Oper. Res..

[23]  Akhil Kumar,et al.  An empirical comparison of neural network and logistic regression models , 1995 .

[24]  Hsin-Vonn Seow,et al.  Using adaptive learning in credit scoring to estimate take-up probability distribution , 2006, Eur. J. Oper. Res..

[25]  Laura Núñez-Letamendia Trading systems designed by genetic algorithms , 2002 .

[26]  Jake Ansell,et al.  Measuring retail company performance using credit scoring techniques , 2007, Eur. J. Oper. Res..

[27]  Markus Leippold,et al.  Economic Benefit of Powerful Credit Scoring , 2005 .

[28]  M. Long Credit scoring development for optimal credit extension and management control , 1974 .

[29]  Jonathan Crook,et al.  Scoring by usage , 2001, J. Oper. Res. Soc..

[30]  P. Falbo,et al.  Credit-scoring by enlarged discriminant models , 1991 .

[31]  Loris Nanni,et al.  An experimental comparison of ensemble of classifiers for bankruptcy prediction and credit scoring , 2009, Expert Syst. Appl..

[32]  Minsoo Lee,et al.  An analysis of credit scoring for agricultural loans in Thailand , 2005 .

[33]  N. Šarlija,et al.  Multinomial model in consumer credit scoring , 2005 .

[34]  Dimitris K. Tasoulis,et al.  Generalized locally recurrent probabilistic neural networks with application to text-independent speaker verification , 2007, Neurocomputing.

[35]  P. Krishnan,et al.  Nozzle wear rate prediction using regression and neural network , 2002 .

[36]  Brad Warner,et al.  Understanding Neural Networks as Statistical Tools , 1996 .

[37]  P. Molyneux,et al.  Technical change in banking , 1999 .

[38]  E. Altman,et al.  Managing Credit Risk: The Next Great Financial Challenge , 1998 .

[39]  Tian-Shyug Lee,et al.  A two-stage hybrid credit scoring model using artificial neural networks and multivariate adaptive regression splines , 2005, Expert Syst. Appl..

[40]  So Young Sohn,et al.  Cluster-based dynamic scoring model , 2007, Expert Syst. Appl..

[41]  Ravinder Nath,et al.  Determining the saliency of input variables in neural network classifiers , 1997, Comput. Oper. Res..

[42]  Yi-Chung Hu,et al.  Incorporating a non-additive decision making method into multi-layer neural networks and its application to financial distress analysis , 2008, Knowl. Based Syst..

[43]  George W. Irwin,et al.  Neural network applications in control , 1995 .

[44]  Gregory R. Madey,et al.  The Application of Neural Networks and a Qualitative Response Model to the Auditor's Going Concern Uncertainty Decision* , 1995 .

[45]  Jonathan Crook,et al.  Reject inference, augmentation, and sample selection , 2007, Eur. J. Oper. Res..

[46]  A. Steenackers,et al.  A credit scoring model for personal loans , 1989 .

[47]  Usha A. Kumar,et al.  Comparison of neural networks and regression analysis: A new insight , 2005, Expert Syst. Appl..

[48]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[49]  Gary G. Chandler,et al.  A COMPARATIVE ANALYSIS OF EMPIRICAL VS. JUDGMENTAL CREDIT EVALUATION , 1979 .

[50]  W. Scott Frame,et al.  Credit Scoring and the Availability of Small Business Credit in Low‐ and Moderate‐Income Areas , 2004 .

[51]  Q. Liang Corporate Financial Distress Diagnosis in China : Empirical Analysis Using Credit Scoring Models , 2003 .

[52]  David West,et al.  Neural network credit scoring models , 2000, Comput. Oper. Res..

[53]  Emi Nakamura,et al.  Inflation forecasting using a neural network , 2005 .

[54]  Chun-Ling Chuang,et al.  Constructing a reassigning credit scoring model , 2009, Expert Syst. Appl..

[55]  D. E. Dimla,et al.  On-line metal cutting tool condition monitoring.: I: force and vibration analyses , 2000 .

[56]  Robert A. Eisenbeis,et al.  Problems in applying discriminant analysis in credit scoring models , 1978 .

[57]  R MULCAHY,et al.  University College, Dublin and its teaching hospitals. , 1955, Journal of the Irish Medical Association.

[58]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[59]  謝楠楨 An integrated data mining and behavioral scoring model for analyzing bank customers , 2004 .

[60]  Jonathan Crook,et al.  Credit Scoring Models in the Credit Union Environment Using Neural Networks and Genetic Algorithms , 1997 .

[61]  William Remus,et al.  Neural network models for intelligent support of managerial decision making , 1994, Decis. Support Syst..

[62]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[63]  Thomas E. McKee,et al.  Genetic programming and rough sets: A hybrid approach to bankruptcy classification , 2002, Eur. J. Oper. Res..

[64]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[65]  John Banasik,et al.  Credit scoring, augmentation and lean models , 2005, J. Oper. Res. Soc..

[66]  Alice E. Smith,et al.  COST ESTIMATION PREDICTIVE MODELING: REGRESSION VERSUS NEURAL NETWORK , 1997 .

[67]  Chulwoo Jeong,et al.  A binary classification method for bankruptcy prediction , 2009, Expert Syst. Appl..

[68]  E. Yesilnacar,et al.  Landslide susceptibility mapping : A comparison of logistic regression and neural networks methods in a medium scale study, Hendek Region (Turkey) , 2005 .

[69]  M. Jackson,et al.  Advanced modelling in finance using Excel and VBA , 2001 .

[70]  Sebastiano Laviola,et al.  Multiple banking relationships and the fragility of corporate borrowers , 1998 .

[71]  David J. Hand,et al.  Discriminant analysis when the classes arise from a continuum , 1998, Pattern Recognit..

[72]  David West,et al.  Neural network ensemble strategies for financial decision applications , 2005, Comput. Oper. Res..

[73]  Mu-Chen Chen,et al.  Credit scoring and rejected instances reassigning through evolutionary computation techniques , 2003, Expert Syst. Appl..

[74]  Manuel Landajo,et al.  Robust neural modeling for the cross-sectional analysis of accounting information , 2007, Eur. J. Oper. Res..

[75]  Siddhartha Bhattacharyya,et al.  Genetic programming in classifying large-scale data: an ensemble method , 2004, Inf. Sci..

[76]  J. Cramer,et al.  Scoring Bank Loans that may go wrong – A Case Study , 2000 .

[77]  David J. Hand,et al.  Optimal bipartite scorecards , 2005, Expert Syst. Appl..

[78]  Yan Ma,et al.  Developing Intelligent Systems for Distinguishing Benign and Malignant Tumors , 2006 .

[79]  J. Efrim Boritz,et al.  Effectiveness of neural network types for prediction of business failure , 1995 .

[80]  E. Mine Cinar,et al.  Neural Networks: A New Tool for Predicting Thrift Failures , 1992 .

[81]  Jonathan Crook,et al.  Sample selection bias in credit scoring models , 2003, J. Oper. Res. Soc..

[82]  Nasser A. Spear,et al.  Artificial neural networks and the accounting method choice in the oil and gas industry , 1997 .

[83]  K. A. Duliba,et al.  Contrasting neural nets with regression in predicting performance in the transportation industry , 1990, Proceedings of the Twenty-Fourth Annual Hawaii International Conference on System Sciences.

[84]  Edward I. Altman,et al.  An emerging market credit scoring system for corporate bonds , 2005 .

[85]  Jonathan Crook,et al.  Support vector machines for credit scoring and discovery of significant features , 2009, Expert Syst. Appl..

[86]  Chandan Sengupta,et al.  Financial Modeling Using Excel and VBA , 2004 .

[87]  Montserrat Guillén,et al.  Count data models for a credit scoring system , 1996 .

[88]  David J. Hand,et al.  Statistical Classification Methods in Consumer Credit Scoring: a Review , 1997 .

[89]  Edward I. Altman,et al.  Corporate distress diagnosis: Comparisons using linear discriminant analysis and neural networks (the Italian experience) , 1994 .

[90]  Galina Andreeva,et al.  European generic scoring models using survival analysis , 2006, J. Oper. Res. Soc..

[91]  Parag C. Pendharkar,et al.  A threshold-varying artificial neural network approach for classification and its application to bankruptcy prediction problem , 2005, Comput. Oper. Res..

[92]  Hussein A. Abdou An evaluation of alternative scoring models in private banking , 2009 .

[93]  Eibe Frank,et al.  Accuracy of machine learning models versus "hand crafted" expert systems - A credit scoring case study , 2009, Expert Syst. Appl..

[94]  Hussein A. Abdou,et al.  On the applicability of credit scoring models in Egyptian banks , 2007 .

[95]  Mukta Paliwal,et al.  Neural networks and statistical techniques: A review of applications , 2009, Expert Syst. Appl..

[96]  William Edward Henley,et al.  Statistical aspects of credit scoring , 1995 .

[97]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[98]  J S Shang,et al.  Diagnosis of MRSA with neural networks and logistic regression approach , 2000, Health care management science.

[99]  G. Goudswaard,et al.  Introduction to Econometrics , 1961 .

[100]  Hossein Etemadi,et al.  A Genetic Programming Model for Bankruptcy Prediction: Empirical Evidence from Iran , 2009, Expert Syst. Appl..

[101]  W. Scott Frame,et al.  The Effect of Credit Scoring on Small-Business Lending , 2001 .

[102]  Abbas Heiat,et al.  Comparison of artificial neural network and regression models for estimating software development effort , 2002, Inf. Softw. Technol..

[103]  Johan A. K. Suykens,et al.  Benchmarking state-of-the-art classification algorithms for credit scoring , 2003, J. Oper. Res. Soc..

[104]  Manuela M. Veloso,et al.  Internal reinforcement in a connectionist genetic programming approach , 2000, Artif. Intell..

[105]  Yue Wang,et al.  Measuring Scorecard Performance , 2004, International Conference on Computational Science.

[106]  James H. Myers,et al.  The Development of Numerical Credit Evaluation Systems , 1963 .

[107]  C ONG,et al.  Building credit scoring models using genetic programming , 2005, Expert Syst. Appl..

[108]  Yingxu Yang,et al.  Adaptive credit scoring with kernel learning methods , 2007, Eur. J. Oper. Res..

[109]  D. Hand,et al.  A k-nearest-neighbour classifier for assessing consumer credit risk , 1996 .

[110]  Amir F. Atiya,et al.  Bankruptcy prediction for credit risk using neural networks: A survey and new results , 2001, IEEE Trans. Neural Networks.

[111]  James W. Kolari,et al.  Commercial Banking: The Management of Risk , 1995 .

[112]  N. Capon Credit Scoring Systems: A Critical Analysis , 1982 .

[113]  Dirk Van den Poel,et al.  The impact of sample bias on consumer credit scoring performance and profitability , 2005, J. Oper. Res. Soc..

[114]  Ray Tsaih,et al.  Credit scoring system for small business loans , 2004, Decis. Support Syst..

[115]  Thomas L. Ainscough,et al.  An empirical investigation and comparison of neural networks and regression for scanner data analysis , 1999 .

[116]  Johan A. K. Suykens,et al.  Faculteit Economie En Bedrijfskunde Hoveniersberg 24 B-9000 Gent Bayesian Kernel-based Classification for Financial Distress Detection Dirk Van Den Poel 4 Bayesian Kernel Based Classification for Financial Distress Detection , 2022 .

[117]  Yair E. Orgler A Credit Scoring Model for Commercial Loans , 1970 .

[118]  Ray H. Anderson The Credit Scoring Toolkit: Theory and Practice for Retail Credit Risk Management and Decision Automation , 2007 .

[119]  Kin Keung Lai,et al.  A model for portfolio selection with order of expected returns , 2000, Comput. Oper. Res..

[120]  E. Altman,et al.  Corporate Credit Scoring Models: Approaches and Standards for Successful Implementation , 1995 .

[121]  Juliana Yim,et al.  Comparison of country risk models: hybrid neural networks, logit models, discriminant analysis and cluster techniques , 2005, Expert Syst. Appl..

[122]  Chih-Chou Chiu,et al.  Credit scoring using the hybrid neural discriminant technique , 2002, Expert Syst. Appl..

[123]  James P. Ignizio,et al.  An ontogenic neural network for bankruptcy classification , 1996 .

[124]  T. Dinh,et al.  A credit scoring model for Vietnam's retail banking market , 2007 .

[125]  Timothy Masters,et al.  Advanced algorithms for neural networks: a C++ sourcebook , 1995 .

[126]  Desmond Fletcher,et al.  Forecasting with neural networks: An application using bankruptcy data , 1993, Inf. Manag..

[127]  L. Buydens,et al.  Supervised Kohonen networks for classification problems , 2006 .

[128]  Naeem Siddiqi,et al.  Credit Risk Scorecards: Developing and Implementing Intelligent Credit Scoring , 2005 .

[129]  Mu-Chen Chen,et al.  Credit scoring with a data mining approach based on support vector machines , 2007, Expert Syst. Appl..

[130]  Kin Keung Lai,et al.  An intelligent-agent-based fuzzy group decision making model for financial multicriteria decision support: The case of credit scoring , 2009, Eur. J. Oper. Res..

[131]  R. McGrath Enhancing Accuracy in Observational Test Scoring: The Comprehensive System As a Case Example , 2003, Journal of personality assessment.

[132]  Young-Chan Lee,et al.  A practical approach to credit scoring , 2008, Expert Syst. Appl..

[133]  Melody Y. Kiang,et al.  Managerial Applications of Neural Networks: The Case of Bank Failure Predictions , 1992 .

[134]  Jonathan N. Crook,et al.  Credit Scoring and Its Applications , 2002, SIAM monographs on mathematical modeling and computation.

[135]  Pravin K. Trivedi,et al.  12 Count data models for financial data , 1996 .

[136]  Moshe Leshno,et al.  Neural network prediction analysis: The bankruptcy case , 1996, Neurocomputing.

[137]  P. Thompson Bank lending and the environment: policies and opportunities , 1998 .

[138]  K. Leonard Detecting credit card fraud using expert systems , 1993 .

[139]  J. Motwani,et al.  Reengineering the lending procedure for small businesses: a case study , 1999 .

[140]  W. Greene Sample selection in credit-scoring models1 , 1998 .

[141]  Dongsong Zhang,et al.  Predicting and explaining patronage behavior toward web and traditional stores using neural networks: a comparative analysis with logistic regression , 2006, Decis. Support Syst..

[142]  W. T. Illingworth,et al.  Practical guide to neural nets , 1991 .

[143]  Henry W. Altland,et al.  Regression Analysis: Statistical Modeling of a Response Variable , 1998, Technometrics.

[144]  J. Schmee An Introduction to Multivariate Statistical Analysis , 1986 .

[145]  Sanjoy Ghose,et al.  Comparing the predictive performance of a neural network model with some traditional market response models , 1994 .

[146]  Kevin J. Leonard,et al.  Credit-scoring models for the evaluation of small-business loan applications , 1992 .

[147]  Thomas E. McKee,et al.  Bankruptcy theory development and classification via genetic programming , 2006, Eur. J. Oper. Res..

[148]  Dennis Glennon,et al.  Commercial Lending Distance and Historically Underserved Areas , 2007 .

[149]  D. Durand Risk elements in consumer instalment financing , 1942 .

[150]  Edward Gately Neural networks for financial forecasting , 1995 .

[151]  Roger Kumra,et al.  Assessing a knowledge-based approach to commercial loan underwriting , 2006, Expert Syst. Appl..

[152]  Ingoo Han,et al.  Bankruptcy prediction using case-based reasoning, neural networks, and discriminant analysis , 1997 .

[153]  Credit Scoring and Mortgage Securitization: Implications for Mortgage Rates and Credit Availability , 2000 .

[154]  Bart Baesens,et al.  Inferring descriptive and approximate fuzzy rules for credit scoring using evolutionary algorithms , 2007, Eur. J. Oper. Res..

[155]  M. Bailey Consumer Credit Quality: Underwriting, Scoring, Fraud Prevention and Collections , 2004 .

[156]  C. Sehgal,et al.  Comparative analysis of logistic regression and artificial neural network for computer-aided diagnosis of breast masses. , 2005, Academic radiology.

[157]  Bart Baesens,et al.  Neural network survival analysis for personal loan data , 2005, J. Oper. Res. Soc..