Confidence Intervals for Probabilities of Default

In this paper we conduct a systematic comparison of confidence intervals around estimated probabilities of default (PD) using several analytical approaches as well as parametric and nonparametric bootstrap methods. We do so for two different PD estimation methods, cohort and duration (intensity), with 22 years of credit ratings data. We find that the bootstrapped intervals for the duration based estimates are relatively tight when compared to either analytic or bootstrapped intervals around the less efficient cohort estimator. We show how the large differences between the point estimates and confidence intervals of these two estimators are consistent with non-Markovian migration behavior. Surprisingly, even with these relatively tight confidence intervals, it is impossible to distinguish notch-level PDs for investment grade ratings, e.g. a PDAA- from a PDA+. However, once the speculative grade barrier is crossed, we are able to distinguish quite cleanly notch-level estimated PDs. Conditioning on the state of the business cycle helps: it is easier to distinguish adjacent PDs in recessions than in expansions.

[1]  Benton E. Gup,et al.  The New Basel Capital Accord , 2004 .

[2]  Halina Frydman,et al.  Credit Rating Dynamics and Markov Mixture Models , 2004 .

[3]  L. Brown,et al.  Interval Estimation for a Binomial Proportion , 2001 .

[4]  On the Number of Bootstrap Repetitions for Bootstrap Standard Errors, Confidence Intervals, and Tests , 1996 .

[5]  Stefan Trück,et al.  Credit Portfolio Risk and Pd Confidence Sets Through the Business Cycle , 2005 .

[6]  W. Perraudin,et al.  Stability of ratings transitions , 2001 .

[7]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[8]  Non-Parametric Analysis of Rating Transition and Default Data , 2004 .

[9]  Dirk Tasche,et al.  Estimating Probabilities of Default for Low Default Portfolios , 2004 .

[10]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[11]  David Lando,et al.  Confidence Sets for Continuous-Time Rating Transition Probabilities , 2004 .

[12]  B. Maris,et al.  How Rating Agencies Achieve Rating Stability , 2005 .

[13]  Roger M. Stein.  ARE THE PROBABILITIES RIGHT ? , 2003 .

[14]  Mortgage Lending,et al.  Position Paper on the New Basel Capital Accord - Consultative Document from the Basel Committee on Banking Supervision (January 2001) , 2001 .

[15]  Francis X. Diebold,et al.  Ratings Migration and the Business Cycle, With Application to Credit Portfolio Stress Testing , 2002 .

[16]  C. Marrison,et al.  The Fundamentals of Risk Management , 2002 .

[17]  A. Agresti,et al.  Approximate is Better than “Exact” for Interval Estimation of Binomial Proportions , 1998 .

[18]  Til Schuermann,et al.  Measurement, estimation and comparison of credit migration matrices , 2004 .

[19]  Ren Johansen.  An Empirical Transition Matrix for Non-homogeneous Markov Chains Based on Censored Observations , 1978 .

[20]  David Lando,et al.  Analyzing rating transitions and rating drift with continuous observations , 2002 .

[21]  Mark S. Carey,et al.  Credit risk rating systems at large US banks , 2000 .

[22]  Richard M Cantor,et al.  Testing for Rating Consistency in Annual Default Rates , 2001 .

[23]  Tyler Shumway.  Forecasting Bankruptcy More Accurately: A Simple Hazard Model , 1999 .

[24]  Til Schuermann,et al.  Ratings Migration and the Business Cycle, with Application to Credit Portfolio Stress Testing , 2000 .

[25]  Paul Vos,et al.  Evaluation Criteria for Discrete Confidence Intervals , 2005 .

[26]  Daniel Egloff,et al.  A Simple Model of Credit Contagion , 2004 .

[27]  Edward I. Altman,et al.  Rating Drift in High-Yield Bonds , 1992 .

[28]  W. Perraudin,et al.  Stability of ratings transitions , 2001 .

[29]  D. Shimko.  Credit risk : models and management , 1999 .

[30]  Jose A. Lopez,et al.  Evaluating Credit Risk Models , 1999 .

[31]  David T. Hamilton.  Rating Transitions and Defaults Conditional on Watchlist, Outlook and Rating History , 2004 .