A Practical Approach to Validating a PD Model

The capital adequacy framework Basel II aims to promote the adoption of stronger risk management practices by the banking industry. The implementation makes validation of credit risk models more important. Lenders therefore need a validation methodology to convince their supervisors that their credit scoring models are performing well. In this paper we take up the challenge to propose and implement a simple validation methodology that can be used by banks to validate their credit risk modelling exercise. We will contextualise the proposed methodology by applying it to a default model of mortgage loans of a commercial bank in the Netherlands.

[1]  Saul I. Gass,et al.  Letter to the Editor - Guidelines for Model Evaluation: An Abridged Version of the U.S. General Accounting Office Exposure Draft , 1980, Oper. Res..

[2]  John D. Kalbfleisch,et al.  The Statistical Analysis of Failure Data , 1986, IEEE Transactions on Reliability.

[3]  Kenneth J. Singleton,et al.  Credit Risk: Pricing, Measurement, and Management , 2003 .

[4]  Douglas W. Dwyer,et al.  Inferring the default rate in a population by comparing two incomplete default databases , 2006 .

[5]  Teresa D. Harrison,et al.  Lessons from the JMCB Archive , 2006 .

[6]  Teddy Seidenfeld,et al.  Calibration, Coherence, and Scoring Rules , 1985, Philosophy of Science.

[7]  Brian D. Ripley,et al.  Modern applied statistics with S, 4th Edition , 2002, Statistics and computing.

[8]  D. Pregibon.  Logistic Regression Diagnostics , 1981 .

[9]  W. W. Muir,et al.  Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1980 .

[10]  A. Cameron,et al.  Microeconometrics: Methods and Applications , 2005 .

[11]  S. Lipsitz,et al.  Missing-Data Methods for Generalized Linear Models , 2005 .

[12]  E. Steyerberg,et al.  [Regression modeling strategies]. , 2011, Revista espanola de cardiologia.

[13]  D. Andrews.  Tests for Parameter Instability and Structural Change with Unknown Change Point , 1993 .

[14]  Kenneth Carling,et al.  Corporate credit risk modeling and the macroeconomy , 2007 .

[15]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[16]  P. Grambsch,et al.  Modeling Survival Data: Extending the Cox Model , 2000 .

[17]  Lung-fei Lee,et al.  Specification error in multinomial logit models : Analysis of the omitted variable bias , 1982 .

[18]  Bernd Engelmann,et al.  The Basel II risk parameters : estimation, validation, and stress testing , 2006 .

[19]  R. Little.  A Test of Missing Completely at Random for Multivariate Data with Missing Values , 1988 .

[20]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[21]  P. Perron,et al.  Estimating and testing linear models with multiple structural changes , 1995 .

[22]  D. Rubin,et al.  Statistical Analysis with Missing Data , 1988 .

[23]  J. Cramer,et al.  Scoring Bank Loans that may go wrong – A Case Study , 2000 .

[24]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[25]  Jerry G. Thursby,et al.  Replication in Empirical Economics: The Journal of Money, Credit and Banking Project , 1986 .

[26]  Jürg M. Blum.  Why 'Basel II' May Need a Leverage Ratio Restriction , 2008 .

[27]  Gail Gong.  Cross-Validation, the Jackknife, and the Bootstrap: Excess Error Estimation in Forward Logistic Regression , 1986 .

[28]  Markus Leippold,et al.  Economic Benefit of Powerful Credit Scoring , 2005 .

[29]  B. Efron.  More Efficient Bootstrap Computations , 1990 .

[30]  Francis X. Diebold,et al.  Testing structural stability with endogenous breakpoint A size comparison of analytic and bootstrap procedures , 1996 .

[31]  Roger M. Stein.  The relationship between default prediction and lending profits: Integrating ROC analysis and loan pricing , 2005 .