Bias-corrected peaks-over-threshold estimation of the CVaR

The conditional value-at-risk (CVaR) is a useful risk measure in fields such as machine learning, finance, insurance, energy, etc. When measuring very extreme risk, the commonly used CVaR estimation method of sample averaging does not work well due to limited data above the value-at-risk (VaR), the quantile corresponding to the CVaR level. To mitigate this problem, the CVaR can be estimated by extrapolating above a lower threshold than the VaR using a generalized Pareto distribution (GPD), which is often referred to as the peaksover-threshold (POT) approach. This method often requires a very high threshold to fit well, leading to high variance in estimation, and can induce significant bias if the threshold is chosen too low. In this paper, we address this bias-variance tradeoff by deriving a new expression for the GPD approximation error of the CVaR, a bias term induced by the choice of threshold, as well as a bias correction method for the estimated GPD parameters. This leads to the derivation of a new CVaR estimator that is asymptotically unbiased and less sensitive to lower thresholds being used. An asymptotic confidence interval for the estimator is also constructed. In a practical setting, we show through experiments that our estimator provides a significant performance improvement compared with competing CVaR estimators in finite samples from heavy-tailed distributions.

[1]  Devendra Kumar,et al.  The Singh–Maddala distribution: properties and estimation , 2017, Int. J. Syst. Assur. Eng. Manag..

[2]  Christoph Dann,et al.  Being Optimistic to Be Conservative: Quickly Learning a CVaR Policy , 2020, AAAI.

[3]  Carlo Marinelli,et al.  A Comparison of Some Univariate Models for Value-at-Risk and Expected Shortfall , 2006 .

[4]  Mohammad Ghavamzadeh,et al.  Algorithms for CVaR Optimization in MDPs , 2014, NIPS.

[5]  Krishna Jagannathan,et al.  Distribution oblivious, risk-aware algorithms for multi-armed bandits with unbounded rewards , 2019, NeurIPS.

[6]  S. Grimshaw Computing Maximum Likelihood Estimates for the Generalized Pareto Distribution , 1993 .

[7]  A. Shapiro,et al.  Financial prediction with constrained tail risk , 2007 .

[8]  Tatsuya Mori,et al.  Learning Robust Options by Conditional Value at Risk Optimization , 2019, NeurIPS.

[9]  Aurélien Garivier,et al.  $\mathcal{X}$-Armed Bandits: Optimizing Quantiles, CVaR and Other Risks , 2019, ACML.

[10]  Liang Peng,et al.  Asymptotically unbiased estimators for the extreme-value index , 1998 .

[11]  S. Uryasev,et al.  Calculating CVaR and bPOE for common probability distributions with application to portfolio optimization and density estimation , 2018, Annals of Operations Research.

[12]  Bias reduction in the estimation of a shape second-order parameter of a heavy-tailed model , 2015 .

[13]  M. Gilli,et al.  An Application of Extreme Value Theory for Measuring Financial Risk , 2006 .

[14]  David B. Brown,et al.  Large deviations bounds for estimating conditional value-at-risk , 2007, Oper. Res. Lett..

[15]  Konstantinos Gkillas,et al.  An application of extreme value theory to cryptocurrencies , 2018 .

[16]  Sanjay P. Bhat,et al.  Concentration of risk measures: A Wasserstein distance approach , 2019, NeurIPS.

[17]  Lihua Sun,et al.  Asymptotic representations for importance-sampling estimators of value-at-risk and conditional value-at-risk , 2010, Oper. Res. Lett..

[18]  Vytaras Brazauskas,et al.  Estimating conditional tail expectation with actuarial applications in view , 2008 .

[19]  A. Necir,et al.  Estimating the Second-Order Parameter of Regular Variation and Bias Reduction in Tail Index Estimation Under Random Truncation , 2016, Journal of Statistical Theory and Practice.

[20]  M. Chlebus,et al.  Comparison of Block Maxima and Peaks Over Threshold Value-at-Risk models for market risk in various economic conditions , 2019, Central European Economic Journal.

[21]  On the Relative Approximation Error of the Generalized Pareto Approximation for a High Quantile , 2003 .

[22]  L. Haan,et al.  Extreme value theory : an introduction , 2006 .

[23]  M. Ivette Gomes,et al.  A new class of semi-parametric estimators of the second order parameter. , 2003 .

[24]  S. Kotz,et al.  Parameter estimation of the generalized Pareto distribution—Part II , 2010 .

[25]  Krishna P. Jagannathan,et al.  Concentration bounds for CVaR estimation: The cases of light-tailed and heavy-tailed distributions , 2019, ICML.

[26]  Sanjay P. Bhat,et al.  Concentration bounds for empirical conditional value-at-risk: The unbounded case , 2019, Oper. Res. Lett..

[27]  P. Hall On Some Simple Estimates of an Exponent of Regular Variation , 1982 .

[28]  Johan Segers,et al.  Second-order refined peaks-over-threshold modelling for heavy-tailed distributions , 2009, 0901.1518.

[29]  M. J. Martins,et al.  “Asymptotically Unbiased” Estimators of the Tail Index Based on External Estimation of the Second Order Parameter , 2002 .

[30]  S. Girard,et al.  Estimation of tail risk based on extreme expectiles , 2016 .

[31]  J. Pickands Statistical Inference Using Extreme Order Statistics , 1975 .

[32]  J.-P. Raoult,et al.  Rate of convergence for the generalized Pareto approximation of the excesses , 2003, Advances in Applied Probability.

[33]  Vartan Choulakian,et al.  Goodness-of-Fit Tests for the Generalized Pareto Distribution , 2001, Technometrics.

[34]  Philip S. Thomas,et al.  Concentration Inequalities for Conditional Value at Risk , 2019, ICML.

[35]  Carl Scarrott,et al.  A Review of Extreme Value Threshold Estimation and Uncertainty Quantification , 2012 .

[36]  Liang Peng,et al.  Semi-parametric Estimation of the Second Order Parameter in Statistics of Extremes , 2002 .

[37]  U. Mansmann,et al.  Distributional challenges regarding data on death and incidences during the SARS-CoV-2 pandemic up to July 2020 , 2020, medRxiv.

[38]  L. Haan,et al.  Residual Life Time at Great Age , 1974 .

[39]  P. Embrechts,et al.  Quantitative Risk Management: Concepts, Techniques, and Tools , 2005 .

[40]  D. Tasche,et al.  On the coherence of expected shortfall , 2001, cond-mat/0104295.

[41]  Christine M. Anderson-Cook,et al.  Book review: quantitative risk management: concepts, techniques and tools, revised edition, by A.F. McNeil, R. Frey and P. Embrechts. Princeton University Press, 2015, ISBN 978-0-691-16627-8, xix + 700 pp. , 2017, Extremes.

[42]  Weihu Cheng,et al.  Extreme tail risk estimation with the generalized Pareto distribution under the peaks-over-threshold framework , 2018, Communications in Statistics - Theory and Methods.

[43]  Laurens de Haan,et al.  On maximum likelihood estimation of the extreme value index , 2004, math/0407062.

[44]  J. Michael Statistical Methods for Financial Engineering , 2014 .

[45]  Jun Yan,et al.  Automated threshold selection for extreme value analysis via ordered goodness-of-fit tests with adjustment for false discovery rate , 2018 .

[46]  R. Tibshirani,et al.  Sequential selection procedures and false discovery rate control , 2013, 1309.5352.

[47]  Shie Mannor,et al.  Optimizing the CVaR via Sampling , 2014, AAAI.