Faculteit Economie En Bedrijfskunde Hoveniersberg 24 B-9000 Gent Bayesian Kernel-based Classification for Financial Distress Detection Dirk Van Den Poel 4 Bayesian Kernel Based Classification for Financial Distress Detection

Corporate credit granting is a key commercial activity of financial institutions nowadays. A critical first step in the credit granting process usually involves a careful financial analysis of the creditworthiness of the potential client. Wrong decisions result either in foregoing valuable clients or, more severely, in substantial capital losses if the client subsequently defaults. It is thus of crucial importance to develop models that estimate the probability of corporate bankruptcy with a high degree of accuracy. Many studies focused on the use of financial ratios in linear statistical models, such as linear discriminant analysis and logistic regression. However, the obtained error rates are often high. In this paper, Least Squares Support Vector Machine (LS-SVM) classifiers, also known as kernel Fisher discriminant analysis, are applied within the Bayesian evidence framework in order to automatically infer and analyze the creditworthiness of potential corporate clients. The inferred posterior class probabilities of bankruptcy are then used to analyze the sensitivity of the classifier output with respect to the given inputs and to assist in the credit assignment decision making process. The suggested nonlinear kernel based classifiers yield better performances than linear discriminant analysis and logistic regression when applied to a real-life data set concerning commercial credit granting to mid-cap Belgian and Dutch firms.

[1]  Bart Baesens,et al.  Using Neural Network Rule Extraction and Decision Tables for Credit - Risk Evaluation , 2003, Manag. Sci..

[2]  Tom Verbeke,et al.  The income-environment relationship: Does a logit model offer an alternative empirical strategy? , 2003 .

[3]  Hubert Ooghe,et al.  Oorzaken van faling en falingspaden: literatuuroverzicht en conceptueel verklaringsmodel , 2004 .

[4]  Lieven Baele Volatility Spillover Effects in European Equity Markets , 2004, Journal of Financial and Quantitative Analysis.

[5]  Sophie Manigart,et al.  Venture capital, private equity and earnings quality , 2004 .

[6]  Edward I. Altman,et al.  Corporate distress diagnosis: Comparisons using linear discriminant analysis and neural networks (the Italian experience) , 1994 .

[7]  Dirk Van den Poel,et al.  Customer attrition analysis for financial services using proportional hazard models , 2004, Eur. J. Oper. Res..

[8]  Jan Camerlynck,et al.  Profile of multiple versus single acquirers and their targets: a research note , 2006 .

[9]  M. Neyt,et al.  Comparing the cost of delayed and immediate autologous breast reconstruction in Belgium. , 2005, British journal of plastic surgery.

[10]  Carlos Serrano-Cinca,et al.  Self organizing neural networks for financial diagnosis , 1996, Decision Support Systems.

[11]  G. Rayp,et al.  Inequality and Growth: Does Time Change Anything? , 2004 .

[12]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[13]  Erik Schokkaert,et al.  Equality of Opportunity versus Equality of Opportunity Sets , 2007, Soc. Choice Welf..

[14]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[15]  Maggie Geuens,et al.  Media Context and Advertising Effectiveness: The Role of Context Appreciation and Context/Ad Similarity , 2002 .

[16]  Maggie Geuens,et al.  Developing a Short Affect Intensity Scale , 2002, Psychological reports.

[17]  Bart Clarysse,et al.  How and Why Do Firms Differ at Start-Up? A Resource-Based Configurational Perspective , 2003 .

[18]  Marc Buelens,et al.  Vlerick Leuven Gent Working Paper Series 2003/10 MAKING COMPETENCIES CROSS BUSINESS UNIT BOUNDARIES: THE INTERPLAY BETWEEN INTER-UNIT COORDINATION, TRUST AND KNOWLEDGE TRANSFERABILITY , 2003 .

[19]  G. Poels,et al.  Faculteit Economie En Bedrijfskunde Hoveniersberg 24 B-9000 Gent Defining and Validating Metrics for Assessing the Maintainability of Entity-relationship Diagrams Defining and Validating Metrics for Assessing the Maintainability of Entity-relationship Diagrams , 2022 .

[20]  Marc Deloof,et al.  The Debt Maturity Structure of Small Firms in a Creditor Oriented Environment , 2003 .

[21]  Scott M. Smith,et al.  Segmenting Internet shoppers based on their web-usage-related lifestyle: a cross-cultural validation , 2005 .

[22]  Selwyn Piramuthu,et al.  Using Feature Construction to Improve the Performance of Neural Networks , 1998 .

[23]  D. De Clercq,et al.  Human capital, social capital, and innovation: a multi-country study , 2004 .

[24]  K. de Wulf,et al.  Does Attitudinal Commitment to Stores Always Lead to Behavioral Loyalty? The Moderating Effect of Age , 2003 .

[25]  Faculteit Economie,et al.  Disclosure of improvement activities related to tangible assets , 2003 .

[26]  Sophie Claeys,et al.  Determinants of bank interest margins in Central and Eastern Europe. Convergence to the West , 2003 .

[27]  J. Christiaens,et al.  Capital Assets in Governmental Accounting Reforms , 2003 .

[28]  Bart Clarysse,et al.  Cost-effectiveness of Herceptin®: A standard cost model for breast-cancer treatment in a Belgian university hospital , 2005, International Journal of Technology Assessment in Health Care.

[29]  Jan De Schamphelaere,et al.  Direct and Indirect Effects of Retail Promotions , 2003 .

[30]  Dirk Van den Poel,et al.  Customer base analysis: partial defection of behaviourally loyal clients in a non-contractual FMCG retail setting , 2005, Eur. J. Oper. Res..

[31]  B. Clarysse,et al.  Do Intangible Assets and Pre-Founding R&D Efforts Matter for Innovation Speed in Start-Ups? , 2004 .

[32]  L. Pozzi,et al.  Imperfect information and the excess sensitivity of private consumption to government expenditures , 2003 .

[33]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[34]  Mario Vanhoucke New computational results for the discrete time/cost trade-off problem with time-switch constraints , 2005 .

[35]  K. Johana,et al.  Benchmarking Least Squares Support Vector Machine Classifiers , 2022 .

[36]  D. Buyens,et al.  Making Sense of a New Employment Relationship: Psychological Contract-Related Information Seeking and the Role of Work Values and Locus of Control , 2005 .

[37]  S. Schiller,et al.  Disclosure of improvement activities related to tangible assets , 2003 .

[38]  L. M. M.-T. Theory of Probability , 1929, Nature.

[39]  Bert De Reyck,et al.  A hybrid scatter search/electromagnetism meta-heuristic for project scheduling , 2006, Eur. J. Oper. Res..

[40]  H. Ooghe,et al.  Het financieel profiel van Waalse groeiondernemingen op basis van de positioneringsroos , 2004 .

[41]  D. Buyens,et al.  Information seeking about the psychological contract: the impact on newcomers' evaluations of their employment relationship , 2004 .

[42]  Johan Christiaens Een praktijkonderzoek naar de gemeentelijke financiering van het deeltijds kunstonderwijs in Vlaanderen , 2004 .

[43]  Dirk Van den Poel,et al.  Investigating Purchasing Patterns for Financial Services using Markov , MTD and MTDg Models , 2004 .

[44]  Johan A. K. Suykens,et al.  Financial time series prediction using least squares support vector machines within the evidence framework , 2001, IEEE Trans. Neural Networks.

[45]  Dustin Boswell,et al.  Introduction to Support Vector Machines , 2002 .

[46]  Eddy Omey,et al.  What determines measured overeducation , 2004 .

[47]  Malaika Brengman,et al.  Developing a typology of airport shoppers , 2004 .

[48]  Dirk-Emma Baestaens,et al.  Neural Network Solutions for Trading in Financial Markets , 1994 .

[49]  G. Peersman,et al.  Determinants of consumption smoothing , 2004 .

[50]  D. Buyens,et al.  The Role of Career-Self-Management in Determining Employees’Perceptions and Evaluations of their Psychological Contract and their Esteemed Value of Career Activities Offered by the Organization , 2004 .

[51]  Tom Verbeke,et al.  The Environmental Kuznets Curve: some really disturbing Monte Carlo evidence , 2004 .

[52]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[53]  Tom Verbeke,et al.  Environmental policy uncertainty, policy coordination and relocation decisions , 2003 .

[54]  B. Clarysse,et al.  Institutional Change and the Resource Flows going to Spin off Projects: The case of IMEC , 2004 .

[55]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[56]  Dieter Verhaest,et al.  The Impact of Overeducation and its Measurement , 2006 .

[57]  Dirk Van de gaer,et al.  Mobility as distributional difference , 2003 .

[58]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[59]  Amir F. Atiya,et al.  Bankruptcy prediction for credit risk using neural networks: A survey and new results , 2001, IEEE Trans. Neural Networks.

[60]  G. Peersman What Caused the Early Millennium Slowdown? Evidence Based on Vector Autoregressions , 2003 .

[61]  Dirk Van den Poel,et al.  The impact of sample bias on consumer credit scoring performance and profitability , 2005, J. Oper. Res. Soc..

[62]  Dirk Van den Poel,et al.  Predicting online-purchasing behaviour , 2005, Eur. J. Oper. Res..

[63]  K. Schoors,et al.  Gradualism versus Big Bang: Evidence from Transition Countries , 2004 .

[64]  Sabien Dobbelaere,et al.  Joint Estimation of Price-Cost Margins and Union Bargaining Power for Belgian Manufacturing , 2005, SSRN Electronic Journal.

[65]  F. Economie Environmental policy uncertainty, policy coordination and relocation decisions , 2003 .

[66]  D. De Clercq,et al.  When Do Venture Capital Firms Learn from Their Portfolio Companies? , 2005 .

[67]  M. Wright,et al.  WHY DO VENTURE CAPITAL COMPANIES SYNDICATE , 2004 .

[68]  Dirk Van den Poel,et al.  Joint optimization of customer segmentation and marketing policy to maximize long-term profitability , 2002, Expert Syst. Appl..

[69]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[70]  Bo K. Wong,et al.  Neural network applications in business: A review and analysis of the literature (1988-1995) , 1997, Decis. Support Syst..

[71]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[72]  Johan A. K. Suykens,et al.  Benchmarking state-of-the-art classification algorithms for credit scoring , 2003, J. Oper. Res. Soc..

[73]  R. Fletcher Practical Methods of Optimization , 1988 .

[74]  Malaika Brengman,et al.  The Four Dimensional Impact Of Color On Shoppers’ Emotions , 2004 .

[75]  Dirk-Emma Baestaens Credit risk modeling strategies: the road to serfdom? , 1999, Intell. Syst. Account. Finance Manag..

[76]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[77]  Jan Annaert,et al.  The value of asset allocation advice: Evidence from The Economist's quarterly portfolio poll , 2005 .

[78]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .

[79]  Glenn Rayp,et al.  Are fair trade labels good business ? Ethics and coffee buying intentions , 2003 .

[80]  Mario Vanhoucke,et al.  Optimal due date assignment in project scheduling , 2002 .

[81]  James A. Ohlson FINANCIAL RATIOS AND THE PROBABILISTIC PREDICTION OF BANKRUPTCY , 1980 .

[82]  Olivier Thas,et al.  Correcting Standard Errors in Two-Stage Estimation Procedures with Generated Regressands , 2005 .

[83]  Sabien Dobbelaere,et al.  Ownership, firm size and rent sharing in a transition country , 2003 .

[84]  Hubert Ooghe,et al.  Het type controleverslag: resultaten van een empirisch onderzoek in België/La nature du rapport de révision: résultats d'une étude empirique en Belgique , 2003 .

[85]  R. Vander Vennet,et al.  Bank Risk Strategies and Cyclical Variation in Bank Stock Returns , 2004 .

[86]  Dirk Van den Poel,et al.  Faculteit Economie En Bedrijfskunde Hoveniersberg 24 B-9000 Gent Predicting Mail-order Repeat Buying: Which Variables Matter? Predicting Mail-order Repeat Buying: Which Variables Matter? , 2022 .

[87]  Oscar Pastor,et al.  Faculteit Economie En Bedrijfskunde Hoveniersberg 24 B-9000 Gent Functional Size Measurement Method for Object-oriented Conceptual Schemas: Design and Evaluation Issues a Functional Size Measurement Method for Object-oriented Conceptual Schemas: Design and Evaluation Issues , 2022 .

[88]  Oscar Pastor,et al.  Comparative Evaluation of Functional Size Measurement Methods: An Experimental Analysis , 2004 .

[89]  Roger M. Stein,et al.  Validation methodologies for default risk models , 2022 .

[90]  Sarah Steenhaut,et al.  The Relationship between Consumers' Unethical Behavior and Customer Loyalty in a Retail Environment , 2003 .

[91]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[92]  Gerdie Everaert,et al.  Inflation and human capital formation: theory and panel data evidence , 2003 .

[93]  Mario Vanhoucke,et al.  New computational results for the discrete time/cost trade-off problem with time-switch constraints , 2005, Eur. J. Oper. Res..

[94]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[95]  Ingoo Han,et al.  Hybrid neural network models for bankruptcy predictions , 1996, Decis. Support Syst..

[96]  Valerie Decoene,et al.  Strategic alignment of manufacturing processes in a Balanced Scorecard-based compensation plan: a theory illustration case , 2003 .

[97]  James Joseph Biundo,et al.  Analysis of Contingency Tables , 1969 .

[98]  Johan A. K. Suykens,et al.  Bayesian Framework for Least-Squares Support Vector Machine Classifiers, Gaussian Processes, and Kernel Fisher Discriminant Analysis , 2002, Neural Computation.

[99]  Dirk Van de gaer,et al.  Lorenz Dominance and Non-welfaristic Redistribution , 2007, Soc. Choice Welf..

[100]  M. Wright,et al.  Spinning Out New Ventures: A Typology of Incubation Strategies from European Research Institutions , 2005 .

[101]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[102]  Geert Wets,et al.  Customer-adapted coupon targeting using feature selection , 2004, Expert Syst. Appl..

[103]  Aimé Heene,et al.  Reputation management: Sending the right signal to the right stakeholder , 2003 .

[104]  Bert Weijters,et al.  Vlerick Leuven Gent Working Paper Series 2003/04 Assessing the Impact of Offline Url Advertising Assessing the Impact of Offline Url Advertising , 2022 .

[105]  Geert Poels,et al.  Functional Size Measurement of Multi-layer Object-Oriented Conceptual Models , 2003, OOIS.

[106]  Paul Gemmel,et al.  Service Level Agreements: een literatuuroverzicht , 2004 .

[107]  Dirk Deschoolmeester,et al.  A Classification of Programmes and its Managerial Impact , 2003 .

[108]  Tomaso A. Poggio,et al.  Regularization Networks and Support Vector Machines , 2000, Adv. Comput. Math..

[109]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[110]  D. Clercq,et al.  THE INTERNATIONALIZATION OF SMALL AND MEDIUM-SIZED FIRMS: THE ROLE OF ORGANIZATIONAL LEARNING EFFORT AND ENTREPRENEURIAL ORIENTATION , 2003 .

[111]  Jagdip Singh,et al.  Vlerick Leuven Gent Working Paper Series 2003/29 PSYCHOLOGICAL EMPOWERMENT IN THE WORKPLACE: REVIEWING THE EMPOWERMENT EFFECTS ON CRITICAL WORK OUTCOMES , 2003 .

[112]  Jan De Houwer,et al.  Implicit Attitudes toward Green Consumer Behavior , 2004 .

[113]  E. Altman Corporate Financial Distress and Bankruptcy: A Complete Guide to Predicting & Avoiding Distress and Profiting from Bankruptcy , 1993 .

[114]  Dirk-Emma Baestaens Credit risk modeling strategies: the road to serfdom? , 1999, Intell. Syst. Account. Finance Manag..

[115]  P. Kenhove,et al.  Consumers’ Reactions to “Receiving Too Much Change at the Checkout” , 2003 .

[116]  Aimé Heene,et al.  Toward stakeholder responsibility and stakeholder motivation: Systemic and holistic perspectives on corporate sustainability* , 2003 .

[117]  Dirk Van den Poel,et al.  Investigating the role of product features in preventing customer churn, by using survival analysis and choice modeling: The case of financial services , 2004, Expert Syst. Appl..

[118]  Faculteit Economie,et al.  The EKC for SO 2 : does firm size matter? , 2004 .

[119]  Ans De Vos,et al.  Psychological Contract Development during Organizational Socialization: Adaptation to Reality and the Role of Reciprocity , 2003 .

[120]  W. Beaver Financial Ratios As Predictors Of Failure , 1966 .

[121]  Elsy Verhofstadt,et al.  The impact of education on job satisfaction in the first job , 2003 .

[122]  Robert A. Eisenbeis,et al.  PITFALLS IN THE APPLICATION OF DISCRIMINANT ANALYSIS IN BUSINESS, FINANCE, AND ECONOMICS , 1977 .

[123]  V. Vapnik Pattern recognition using generalized portrait method , 1963 .

[124]  David Mackay,et al.  Probable networks and plausible predictions - a review of practical Bayesian methods for supervised neural networks , 1995 .

[125]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[126]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[127]  P. Gemmel,et al.  The waiting experience and consumer perception of service quality in outpatient clinics , 2004 .

[128]  T. Marchant Rationing : dynamic considerations, equivalent sacrifice and links between the two approaches , 2004 .

[129]  Bruno Merlevede,et al.  A Note on Reform Reversals and Output Growth in Transition Economies , 2003 .