Evaluating Value-at-Risk Models via Quantile Regression

This article is concerned with evaluating Value-at-Risk estimates. It is well known that using only binary variables, such as whether or not there was an exception, sacrifices too much information. However, most of the specification tests (also called backtests) available in the literature, such as Christoffersen (1998) and Engle and Manganelli (2004) are based on such variables. In this article we propose a new backtest that does not rely solely on binary variables. It is shown that the new backtest provides a sufficient condition to assess the finite sample performance of a quantile model whereas the existing ones do not. The proposed methodology allows us to identify periods of an increased risk exposure based on a quantile regression model (Koenker and Xiao 2002). Our theoretical findings are corroborated through a Monte Carlo simulation and an empirical exercise with daily S&P500 time series.

[1]  Luiz Renato Lima,et al.  A panel data approach to economic forecasting: the bias-corrected average forecast , 2009 .

[2]  C. Perignon,et al.  The Level and Quality of Value-at-Risk Disclosure by Commercial Banks , 2009 .

[3]  K. Lindsay,et al.  Developing analytical distributions for temperature indices for the purposes of pricing temperature-based weather derivatives , 2008 .

[4]  Oliver Linton,et al.  The quantilogram: With an application to evaluating directional predictability , 2007 .

[5]  J. Waldén,et al.  Value at Risk Under Dependence and Heavy-Tailedness: Models with Common Shocks , 2007 .

[6]  Marcelo Yoshio Takami,et al.  Evaluation of Default Risk for The Brazilian Banking Sector , 2007 .

[7]  Luiz Renato Lima,et al.  Comparing value-at-risk methodologies , 2007 .

[8]  J. Jurečková.  Quantile Regression , 2006 .

[9]  Roger Koenker,et al.  Quantile Autoregression , 2006 .

[10]  T. Barnhill,et al.  An Analysis of Off-Site Supervision of Banks' Profitability, Risk and Capital Adequacy: a portfolio simulation approach applied to brazilian banks , 2006 .

[11]  A. Clements,et al.  Estimating Stochastic Volatility Models Using a Discrete Non-linear Filter. Working paper #3 , 2006 .

[12]  A. Zapp,et al.  Backtesting within the Trading Book , 2006 .

[13]  Juan Romo,et al.  Bootstrap prediction for returns and volatilities in GARCH models , 2006, Comput. Stat. Data Anal..

[14]  Markus Haas,et al.  Improved Duration-Based Backtesting of Value-at-Risk , 2006 .

[15]  Ross Maller,et al.  Bias and consistency of the maximum Sharpe ratio , 2005 .

[16]  Jón Dańıelsson,et al.  On Time-Scaling of Risk and the Square-Root-Of-Time Rule , 2005 .

[17]  Gennady Samorodnitsky,et al.  Subadditivity Re–Examined: the Case for Value-at-Risk , 2005 .

[18]  Marc S. Paolella,et al.  Value-at-Risk Prediction: A Comparison of Alternative Strategies , 2005 .

[19]  Meiyuan Chen,et al.  Application of Quantile Regression to Estimation of Value at Risk , 2005 .

[20]  Sean D. Campbell.  A review of backtesting and backtesting procedures , 2005 .

[21]  Roger Koenker,et al.  Inference for Quantile Regression , 2005 .

[22]  Olivier Darné,et al.  Outliers and GARCH models in financial data , 2005 .

[23]  Peter F. Christoffersen.  Elements of Financial Risk Management , 2003 .

[24]  Peter Christoffersen,et al.  Backtesting Value-at-Risk: A Duration-Based Approach , 2003 .

[25]  J. Stock,et al.  Forecasting Using Principal Components From a Large Number of Predictors , 2002 .

[26]  Zhijie Xiao,et al.  An analysis of risk measures , 2002 .

[27]  Ivana Komunjer,et al.  Evaluation and Combination of Conditional Quantile Forecasts , 2002 .

[28]  Tae-Hwan Kim,et al.  Estimation, Inference, and Specification Testing for Possibly Misspecified Quantile Regression , 2002 .

[29]  Pedro Fachada.  Inflation Targeting in Brazil: Reviewing Two Years of Monetary Policy 1999/00 , 2001 .

[30]  Matthew Pritsker,et al.  The Hidden Dangers of Historical Simulation , 2001 .

[31]  Jeremy Berkowitz,et al.  How Accurate are Value-at-Risk Models at Commercial Banks , 2001 .

[32]  R. Huisman,et al.  Tail-Index Estimates in Small Samples , 2001 .

[33]  José A.F. Machado,et al.  Earning functions in Portugal 1982–1994: Evidence from quantile regressions , 2001 .

[34]  Andrew J. Patton,et al.  What good is a volatility model? , 2001 .

[35]  A. McNeil,et al.  Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach , 2000 .

[36]  V. Chernozhukov,et al.  Conditional value-at-risk: Aspects of modeling and estimation , 2000 .

[37]  Marc S. Paolella,et al.  Conditional density and value‐at‐risk prediction of Asian currency exchange rates , 2000 .

[38]  Roger Koenker,et al.  Inference on the Quantile Regression Process , 2000 .

[39]  James W. Taylor.  A Quantile Regression Approach to Estimating the Distribution of Multiperiod Returns , 1999 .

[40]  Philippe Artzner,et al.  Coherent Measures of Risk , 1999 .

[41]  S. Resnick,et al.  Extreme Value Theory as a Risk Management Tool , 1999 .

[42]  R. Koenker,et al.  Goodness of Fit and Related Inference Processes for Quantile Regression , 1999 .

[43]  P. Franses,et al.  Additive outliers, GARCH and forecasting volatility , 1999 .

[44]  Jose A. Lopez,et al.  Methods for Evaluating Value-at-Risk Estimates , 1998 .

[45]  Jón Dańıelsson,et al.  The Cost of Conservatism: Extreme Returns, Value-at Risk, and the Basle Multiplicaiton Factor , 1998 .

[46]  Jón Dańıelsson,et al.  Tail Index and Quantile Estimation with Very High Frequency Data , 1997 .

[47]  Roger Koenker,et al.  Conditional Quantile Estimation and Inference for Arch Models , 1996, Econometric Theory.

[48]  P. Chaudhuri.  On a geometric notion of quantiles for multivariate data , 1996 .

[49]  Paul H. Kupiec,et al.  Techniques for Verifying the Accuracy of Risk Measurement Models , 1995 .

[50]  Z. Ying,et al.  A resampling method based on pivotal estimating functions , 1994 .

[51]  J. Powell,et al.  Nonparametric and Semiparametric Methods in Econometrics and Statistics , 1993 .

[52]  C. Granger,et al.  A long memory property of stock market returns and a new model , 1993 .

[53]  R. Koenker,et al.  Hierarchical Spline Models for Conditional Quantiles and the Demand for Electricity , 1990 .

[54]  D. Schmeidler.  Integral representation without additivity , 1986 .

[55]  H. White.  Asymptotic theory for econometricians , 1985 .

[56]  Least absolute deviations estimation for the censored regression model , 1984 .

[57]  R. Engle.  Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[58]  D. Ruppert,et al.  Trimmed Least Squares Estimation in the Linear Model , 1980 .

[59]  D. H. Freeman.  Distributions in Statistics: Continuous Multivariate Distributions , 1972 .

[60]  Peter Christoffersen,et al.  Value–at–Risk Models , 2009 .

[61]  E. Chang,et al.  Forecasting Exchange Rate Density Using Parametric Models: the Case of Brazil , 2007 .

[62]  P. Robinson.  Comment on "quantile Autoregression" , 2006 .

[63]  C. Hafner,et al.  Discussion of quantile autoregression by Koenker and Xiao , 2006 .

[64]  Marc S. Paolella,et al.  Accurate value-at-risk forecasting based on the normal-GARCH model , 2006, Comput. Stat. Data Anal..

[65]  Nonstandard Asymptotics,et al.  Monte Carlo Tests with Nuisance Parameters: A General Approach to Finite-Sample Inference and , 2005 .

[66]  Gustavo Silva Araújo,et al.  Evaluation of Foreign Exchange Risk Capital Requirement Models , 2005 .

[67]  Niels Schulze.  Applied Quantile Regression: Microeconometric, Financial, and Environmental Analyses , 2004 .

[68]  K. Dowd.  Measuring Market Risk , 2002 .

[69]  Phhilippe Jorion.  Value at Risk: The New Benchmark for Managing Financial Risk , 2000 .

[70]  Wouter den Haan,et al.  CAViaR : Conditional Autoregressive Value at Risk by Regression Quantiles , 1999 .

[71]  Moshe Buchinsky.  Recent Advances in Quantile Regression Models: A Practical Guideline for Empirical Research , 1998 .

[72]  Jon Danielsson,et al.  The Cost of Conservatism : Extreme Returns , Value-at-Risk , and the Basle ‘ Multiplication Factor ’ , 1998 .

[73]  C. Klüppelberg,et al.  Modelling Extremal Events , 1997 .

[74]  M. Hall.  The amendment to the capital accord to incorporate market risk , 1996 .

[75]  J. Hull.  Options, Futures, and Other Derivatives , 1989 .

[76]  Robert Fildes,et al.  Journal of business and economic statistics 5: Garcia-Ferrer, A. et al., Macroeconomic forecasting using pooled international data, (1987), 53-67 , 1988 .

[77]  W. Newey,et al.  Large sample estimation and hypothesis testing , 1986 .

[78]  R. Koenker,et al.  Robust Tests for Heteroscedasticity Based on Regression Quantiles , 1982 .

[79]  P. R. Fisk,et al.  Distributions in Statistics: Continuous Multivariate Distributions , 1971 .

[80]  P. J. Huber.  The behavior of maximum likelihood estimates under nonstandard conditions , 1967 .

[81]  Jinyong Hahn,et al.  Série Scientifique Scientific Series Testing and Comparing Value-at-risk Measures , 2022 .

[82]  Peter Christoffersen,et al.  Série Scientifique Scientific Series Estimation Risk in Financial Risk Management , 2022 .