A window of opportunity: Assessing behavioural scoring

After credit has been granted, lenders use behavioural scoring to assess the likelihood of default occurring during some specific outcome period. This assessment is based on customers' repayment performance over a given fixed period. Often the outcome period and fixed performance period are arbitrarily selected, causing instability in making predictions. Behavioural scoring has failed to receive the same attention from researchers as application scoring. The bias for application scoring research can be attributed, in part, to the large volume of data required for behavioural scoring studies. Furthermore, the commercial sensitivities associated with such a large pool of customer data often prohibits the publication of work in this area. This paper focuses on behavioural scoring and evaluates the contrasting effects of altering the performance period and outcome period using 7-years worth of data from the Irish market. The results of this work indicate that a 12-month performance period yields an easier prediction task when compared with other historical payment periods of varying lengths. This article also quantifies differences in the classification performance of logistic regression arising from different outcome periods length. Our findings show that the performance of a logistic regression classifier degrades significantly when the outcome window is extended beyond 6-month. Finally we consider different approaches to how the concept of default is defined. Typically whether the customer is identified as a default risk or not is set based on either (i) whether the account is in default at the end of the outcome period or (ii) at any time during the outcome period. This paper studies both approaches and finds that the latter approach resulted in an easier classification problem, that is, it gives the highest assurance that the classification will be correct.

[1]  Bart Baesens,et al.  Credit Risk Management: Basic Concepts: Financial Risk Components, Rating Analysis, Models, Economic and Regulatory Capital , 2009 .

[2]  Galina Andreeva,et al.  European generic scoring models using survival analysis , 2006, J. Oper. Res. Soc..

[3]  Elizabeth Mays,et al.  Credit Scoring for Risk Managers: The Handbook for Lenders , 2003 .

[4]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[5]  Dirk Van den Poel,et al.  Handling class imbalance in customer churn prediction , 2009, Expert Syst. Appl..

[6]  H. McNab,et al.  Principles and practice of consumer credit risk management , 2003 .

[7]  Somnath Chatterjee,et al.  Modelling credit risk , 2015 .

[8]  Philip H. Ramsey Nonparametric Statistical Methods , 1974, Technometrics.

[9]  Keith Smith,et al.  Non-linearity of scorecard log-odds , 2012 .

[10]  Steven Finlay,et al.  Credit scoring for profitability objectives , 2010, Eur. J. Oper. Res..

[11]  Tian-Shyug Lee,et al.  A two-stage hybrid credit scoring model using artificial neural networks and multivariate adaptive regression splines , 2005, Expert Syst. Appl..

[12]  Douglas A. Wolfe,et al.  Nonparametric Statistical Methods , 1973 .

[13]  Sven F. Crone,et al.  Instance sampling in credit scoring: An empirical study of sample size and balancing , 2012 .

[14]  Ray H. Anderson The Credit Scoring Toolkit: Theory and Practice for Retail Credit Risk Management and Decision Automation , 2007 .

[15]  A. Savvopoulos Consumer Credit Models: Pricing, Profit and Portfolios , 2010 .

[16]  Jonathan N. Crook,et al.  Credit Scoring and Its Applications , 2002, SIAM monographs on mathematical modeling and computation.

[17]  John Banasik,et al.  Not if but when will borrowers default , 1999, J. Oper. Res. Soc..

[18]  Lyn C. Thomas,et al.  Does segmentation always improve model performance in credit scoring? , 2012, Expert Syst. Appl..

[19]  Chih-Fong Tsai,et al.  Feature selection in bankruptcy prediction , 2009, Knowl. Based Syst..

[20]  Lyn C. Thomas,et al.  PHAB scores: proportional hazards analysis behavioural scores , 2001, J. Oper. Res. Soc..

[21]  Jonathan N. Crook,et al.  Modelling the purchase propensity: analysis of a revolving store card , 2005, J. Oper. Res. Soc..

[22]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[23]  David J. Hand,et al.  Statistical Classification Methods in Consumer Credit Scoring: a Review , 1997 .

[24]  Marijana Zekic-Susac,et al.  Comparison procedure of predicting the time to default in behavioural scoring , 2009, Expert Syst. Appl..

[25]  William T. Scherer,et al.  Time will tell: behavioural scoring and the dynamics of consumer credit assessment , 2001 .

[26]  D. J. Hand,et al.  Evaluating models for classifying customers in retail banking collections , 2010, J. Oper. Res. Soc..

[27]  Bart Baesens,et al.  Neural network survival analysis for personal loan data , 2005, J. Oper. Res. Soc..

[28]  Ruud H. Koning,et al.  A Practical Approach to Validating a PD Model , 2009 .

[29]  David J. Hand,et al.  Behavioural models of credit card usage , 2003 .