Algorithms to compute CM- and S-estimates for regression

Abstract. Constrained M-estimators for regression were introduced by Mendes and Tyler in 1995 as an alternative class of robust regression estimators with high breakdown point and high asymptotic efficiency. To compute the CM-estimate, the global minimum of an objective function with an inequality constraint has to be localized. To find the S-estimate for the same problem, we instead restrict ourselves to the boundary of the feasible region. The algorithm presented for computing CM-estimates can easily be modified to compute S-estimates as well. Testing is carried out with a comparison to the algorithm SURREAL by Ruppert.

[1]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[2]  O. Edlund,et al.  Linear M-estimation with bounded variables , 1997 .

[3]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[4]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[5]  P. J. Huber.  Robust Regression: Asymptotics, Conjectures and Monte Carlo , 1973 .

[6]  Werner A. Stahel,et al.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[7]  P. Rousseeuw.  Least Median of Squares Regression , 1984 .

[8]  D. Ruppert.  Computing S Estimators for Regression and Multivariate Location/Dispersion , 1992 .

[9]  W. Härdle,et al.  Robust and Nonlinear Time Series Analysis , 1984 .

[10]  H. P. Lopuhaä.  On the relation between S-estimators and M-estimators of multivariate location and covariance , 1989 .

[11]  A. Siegel.  Robust regression using repeated medians , 1982 .

[12]  V. Yohai,et al.  Bias- and efficiency-robustness of general M-estimators for regression with random carriers , 1979 .

[13]  Theo Gasser,et al.  Smoothing Techniques for Curve Estimation , 1979 .

[14]  David E. Tyler,et al.  Constrained M-estimation for multivariate location and scatter , 1996 .

[15]  Peter J. Rousseeuw,et al.  ROBUST REGRESSION BY MEANS OF S-ESTIMATORS , 1984 .

[16]  D. G. Simpson,et al.  On One-Step GM Estimates and Stability of Inferences in Linear Regression , 1992 .

[17]  David E. Tyler,et al.  Constrained M-Estimation for Regression , 1996 .