The relationship between default prediction and lending profits: Integrating ROC analysis and loan pricing

Abstract In evaluating credit risk models, it is common to use metrics such as power curves and their associated statistics. However, power curves are not necessarily easily linked intuitively to common lending practices. Bankers often request a specific rule for defining a cut-off above which credit will be granted and below which it will be denied. In this paper we provide some quantitative insight into how such cut-offs can be developed. This framework accommodates real-world complications (e.g., “relationship” clients). We show that the simple cut-off approach can be extended to a more complete pricing approach that is more flexible and more profitable. We demonstrate that in general more powerful models are more profitable than weaker ones and we provide a simulation example. We also report results of another study that conservatively concludes a mid-sized bank might generate additional profits on the order of about $4.8 million per year after adopting a moderately more powerful model.

[1]  André Güttler,et al.  The Adjustment of Credit Ratings in Advance of Defaults , 2007 .

[2]  E. Altman,et al.  ZETATM analysis A new model to identify bankruptcy risk of corporations , 1977 .

[3]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[4]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[5]  Comparing the Performance of Market-Based and Accounting-Based Bankruptcy Prediction Models , 2006 .

[6]  Roger M. Stein Benchmarking default prediction models: pitfalls and remedies in model validation , 2007 .

[7]  Roger M. Stein,et al.  Benchmarking Quantitative Default Risk Models: A Validation Methodology , 2000 .

[8]  T. Birdsall The Theory of Signal Detectability: ROC Curves and Their Character , 1966 .

[9]  Tom Fawcett,et al.  Analysis and Visualization of Classifier Performance: Comparison under Imprecise Class and Cost Distributions , 1997, KDD.

[10]  John A. Swets,et al.  Signal Detection Theory and ROC Analysis in Psychology and Diagnostics: Collected Papers , 1996 .

[11]  Margaret S. Pepe,et al.  Receiver Operating Characteristic Methodology , 2000 .

[12]  Dirk-Emma Baestaens Credit risk modeling strategies: the road to serfdom? , 1999, Intell. Syst. Account. Finance Manag..

[13]  Stein,et al.  WHAT IS A MORE POWERFUL MODEL WORTH ? , 2003 .

[14]  Adrian E. Raftery,et al.  Statistics for the 21st Century , 2001 .

[15]  J. Hanley Receiver operating characteristic (ROC) methodology: the state of the art. , 1989, Critical reviews in diagnostic imaging.

[16]  Markus Leippold,et al.  Economic Benefit of Powerful Credit Scoring , 2005 .

[17]  J A Swets,et al.  Measuring the accuracy of diagnostic systems. , 1988, Science.

[18]  Clive W. J. Granger,et al.  A Decision_Theoretic Approach to Forecast Evaluation , 2000 .