A Bounded Influence, High Breakdown, Efficient Regression Estimator

Abstract We consider the multiple linear regression model y i = x′ i β + e i , i = 1, 2, …, n, with random carriers and focus on the estimation of β. This article's main contribution is to present an estimator that is affine, regression, and scale equivariant; has both a high breakdown point and a bounded influence function; and has an asymptotic efficiency greater than .95 versus least squares under Gaussian errors. We give conditions under which the estimator—a one-step general M estimator that uses Schweppe weights and is based on a high breakdown initial estimator—satisfies these properties. The major conditions necessary for the estimator are (a) it must be based on a √n-consistent initial estimator with a 50% breakdown point, and (b) it must be based on a psi function that is odd, bounded, and strictly increasing. The advantage of this estimator over previous approaches is that it does not downweight high leverage points without first considering how they fit the bulk of the data. Methods of computi...

[1]  C. R. Rao,et al.  Linear Statistical Inference and its Applications , 1968 .

[2]  F. Hampel.  The Influence Curve and Its Role in Robust Estimation , 1974 .

[3]  P. Bickel.  One-Step Huber Estimates in the Linear Model , 1975 .

[4]  E. Handschin,et al.  Bad data analysis for power system state estimation , 1975, IEEE Transactions on Power Apparatus and Systems.

[5]  S. R. Searle,et al.  The theory of linear models and multivariate analysis , 1981 .

[6]  V. Yohai,et al.  Asymptotic behavior of general M-estimates for regression and scale with random carriers , 1981 .

[7]  R. Welsch,et al.  Efficient Bounded-Influence Regression Estimation , 1982 .

[8]  Peter J. Rousseeuw,et al.  ROBUST REGRESSION BY MEANS OF S-ESTIMATORS , 1984 .

[9]  P. Rousseeuw.  Least Median of Squares Regression , 1984 .

[10]  P. Rousseeuw.  Multivariate estimation with high breakdown point , 1985 .

[11]  Jana Jurečková,et al.  Asymptotics for one-step m-estimators in regression with application to combining efficiency and high breakdown point , 1987 .

[12]  V. Yohai.  HIGH BREAKDOWN-POINT AND HIGH EFFICIENCY ROBUST ESTIMATES FOR REGRESSION , 1987 .

[13]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[14]  Peter J. Rousseeuw.  PROGRESS: a program for robust regression , 1988 .

[15]  V. Yohai,et al.  High Breakdown-Point Estimates of Regression by Means of the Minimization of an Efficient Scale , 1988 .

[16]  V. Yohai,et al.  Min-Max Bias Robust Regression. , 1989 .

[17]  P. Rousseeuw,et al.  Unmasking Multivariate Outliers and Leverage Points , 1990 .

[18]  Simon J. Sheather,et al.  Regression Diagnostics for Rank-Based Methods , 1990 .

[19]  T. Hettmansperger,et al.  Robust Bounded Influence Tests in Linear Models , 1990 .

[20]  Marianthi Markatou,et al.  Robust M-type testing procedures for linear models , 1991 .

[21]  Victor J. Yohai,et al.  The Breakdown Point of Simultaneous General M Estimates of Regression and Scale , 1991 .

[22]  D. Ruppert.  Computing S Estimators for Regression and Multivariate Location/Dispersion , 1992 .

[23]  D. G. Simpson,et al.  On One-Step GM Estimates and Stability of Inferences in Linear Regression , 1992 .