Bias Robust Estimation of Scale

Abstract : In this paper we consider the problem of robust estimation of the scale of the location residuals when the underlying distribution of the data belongs to a contamination neighborhood of a parametric location-scale family. We define the class of M-estimates of scale with general location, and show that under certain regularity assumptions, these scale estimates converge to their asymptotic functionals uniformly with respect to the underlying distribution, and with respect to the M-estimate defining score function x. We establish expressions for the maximum asymptotic bias of M-estimates of scale over the contamination neighborhood as a function of the fraction of contamination. Using these expressions we construct asymptotically min-max bias robust estimates of scale. In particular, we show that a scaled version of the Madm (median of absolute residuals about the median) is approximately min-max bias-robust within the class of Huber's proposal 2 joint estimates of location and scale. We also consider the larger class of M-estimates of scale with general location, and show that a scaled version of the Shorth (the shortest half of the data) is approximately min-max bias robust in this class. Finally, we present the results of a Monte Carlo study showing that the Shorth has attractive finite sample size mean squared error properties for contaminated Gaussian data.

[1]  V. Yohai,et al.  Min-Max Bias Robust Regression. , 1989 .

[2]  R. Martin,et al.  Asymptotically Min—Max Bias Robust M-Estimates of Scale for Positive Random Variables , 1989 .

[3]  P. Rousseeuw,et al.  A robust scale estimator based on the shortest half , 1988 .

[4]  R. Grübel.  The Length of the Shorth , 1988 .

[5]  D. Donoho,et al.  The "Automatic" Robustness of Minimum Distance Functionals , 1988 .

[6]  V. Yohai,et al.  High Breakdown-Point Estimates of Regression by Means of the Minimization of an Efficient Scale , 1988 .

[7]  J. Simonoff.  Outlier detection and robust estimation of scale , 1987 .

[8]  John Law,et al.  Robust Statistics—The Approach Based on Influence Functions , 1986 .

[9]  R. Martin,et al.  Min-Max Bias Robust M-Estimates of Scale. , 1986 .

[10]  D. Lax.  Robust Estimators of Scale: Finite-Sample Performance in Long-Tailed Symmetric Distributions , 1985 .

[11]  Peter J. Rousseeuw,et al.  ROBUST REGRESSION BY MEANS OF S-ESTIMATORS , 1984 .

[12]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[13]  C. J. Lawrence.  Robust estimates of location : survey and advances , 1975 .

[14]  F. Hampel.  The Influence Curve and Its Role in Robust Estimation , 1974 .

[15]  D. F. Andrews,et al.  Robust Estimates of Location: Survey and Advances. , 1975 .

[16]  F. Hampel.  A General Qualitative Definition of Robustness , 1971 .

[17]  F. Hampel.  Contributions to the theory of robust estimation , 1968 .