Divergence based robust estimation of the tail index through an exponential regression model

The extreme value theory is very popular in applied sciences including finance, economics, hydrology and many other disciplines. In univariate extreme value theory, we model the data by a suitable distribution from the general max-domain of attraction characterized by its tail index; there are three broad classes of tails—the Pareto type, the Weibull type and the Gumbel type. The simplest and most common estimator of the tail index is the Hill estimator that works only for Pareto type tails and has a high bias; it is also highly non-robust in presence of outliers with respect to the assumed model. There have been some recent attempts to produce asymptotically unbiased or robust alternative to the Hill estimator; however all the robust alternatives work for any one type of tail. This paper proposes a new general estimator of the tail index that is both robust and has smaller bias under all the three tail types compared to the existing robust estimators. This essentially produces a robust generalization of the estimator proposed by Matthys and Beirlant (Stat Sin 13:853–880, 2003) under the same model approximation through a suitable exponential regression framework using the density power divergence. The robustness properties of the estimator are derived in the paper along with an extensive simulation study. A method for bias correction is also proposed with application to some real data examples.

[1]  M. C. Jones,et al.  Robust and efficient estimation by minimising a density power divergence , 1998 .

[2]  Matthias Templ,et al.  Estimation of Social Exclusion Indicators from Complex Surveys: The R Package Laeken , 2012 .

[3]  B. Gnedenko Sur La Distribution Limite Du Terme Maximum D'Une Serie Aleatoire , 1943 .

[4]  Jan Beirlant,et al.  ESTIMATING THE EXTREME VALUE INDEX AND HIGH QUANTILES WITH EXPONENTIAL REGRESSION MODELS , 2003 .

[5]  S. Berman On Regular Variation and Its Application to the Weak Convergence of Sample Extremes , 1972 .

[6]  J. Hosking,et al.  Parameter and quantile estimation for the generalized pareto distribution , 1987 .

[7]  F. Hampel The Influence Curve and Its Role in Robust Estimation , 1974 .

[8]  Robust estimation of economic indicators from survey samples based on Pareto tail modelling , 2013 .

[9]  Alfio Marazzi,et al.  Adaptively truncated maximum likelihood regression with asymmetric errors , 2004 .

[10]  A. Guillou,et al.  Robust conditional Weibull-type estimation , 2015 .

[11]  Sangyeol Lee,et al.  Estimation of a tail index based on minimum density power divergence , 2008 .

[12]  A. Basu,et al.  Robust estimation for independent non-homogeneous observations using density power divergence with applications to linear regression , 2013 .

[13]  Peter Filzmoser,et al.  Robust Pareto Tail Modeling for the Estimation of Indicators on Social Exclusion using the R Package laeken , 2012 .

[14]  L. Haan,et al.  A moment estimator for the index of an extreme-value distribution , 1989 .

[15]  Mia Hubert,et al.  A Robust Estimator of the Tail Index Based on an Exponential Regression Model , 2004 .

[16]  Richard L. Smith Estimating tails of probability distributions , 1987 .

[17]  Peter Filzmoser,et al.  Robust estimation of economic indicators from survey samples based on Pareto tail modelling , 2012 .

[18]  Jan Beirlant,et al.  Tail Index Estimation and an Exponential Regression Model , 1999 .

[19]  Peter Filzmoser,et al.  Simulation of close-to-reality population data for household surveys with application to EU-SILC , 2011, Stat. Methods Appl..

[20]  Andreas Christmann,et al.  A robust estimator for the tail index of Pareto-type distributions , 2007, Comput. Stat. Data Anal..

[21]  F. Hampel Contributions to the theory of robust estimation , 1968 .

[22]  R. Pak A Robust Estimation for the Composite Lognormal-Pareto Model , 2013 .

[23]  J. Teugels,et al.  Tail Index Estimation, Pareto Quantile Plots, and Regression Diagnostics , 1996 .

[24]  B. M. Hill,et al.  A Simple General Approach to Inference About the Tail of a Distribution , 1975 .

[25]  S. Stigler Do Robust Estimators Work with Real Data , 1977 .

[26]  J. Pickands Statistical Inference Using Extreme Order Statistics , 1975 .