Diagnostics for comparing robust and least squares fits

Is a simple least squares (LS) fit appropriate for the data at hand? How different would a more robust estimate be from LS? Is a high breakdown estimator necessary, or is a highly efficient robust estimator sufficient? We propose diagnostics which help answer these questions by measuring the difference in fits between least squares and, successively, a highly efficient robust estimate and a bounded influence robust estimate. Our diagnostic TDBETAS measures the overall change in parameter estimates among these three fits, while the casewise diagnostic CFITS measures change in individual fitted values. We also propose a plot based on CFITS which provides an effective graphical summary of underlying data structure.

[1]  Joshua D. Naranjo,et al.  Influence functions for rank-based procedures in the linear model , 1995 .

[2]  D. G. Simpson,et al.  On One-Step GM Estimates and Stability of Inferences in Linear Regression , 1992 .

[3]  Simon J. Sheather,et al.  The Use and Interpretation of Residuals Based on Robust Estimation , 1993 .

[4]  Simon J. Sheather,et al.  Regression Diagnostics for Rank-Based Methods , 1990 .

[5]  Thomas P. Hettmansperger,et al.  Statistical inference based on ranks , 1985 .

[6]  Louis A. Jaeckel.  Estimating Regression Coefficients by Minimizing the Dispersion of the Residuals , 1972 .

[7]  Peter J. Rousseeuw,et al.  Robust Distances: Simulations and Cutoff Values , 1991 .

[8]  W. W. Muir,et al.  Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1980 .

[9]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[10]  Joshua D. Naranjo,et al.  Bounded influence rank regression , 1994 .

[11]  Hira L. Koul,et al.  An Estimator of the Scale Parameter for the Rank Analysis of Linear Models under General Score Functions , 1987 .

[12]  S. Weisberg,et al.  Residuals and Influence in Regression , 1982 .

[13]  R. Dennis Cook,et al.  Regression Diagnostics With Dynamic Graphics , 1989 .

[14]  Joshua D. Naranjo,et al.  An efficient and high breakdown procedure for model criticism , 1996 .

[15]  Simon J. Sheather,et al.  Robust and High-Breakdown Fits of Polynomial Models , 1994 .

[16]  C. W. Coakley,et al.  A Bounded Influence, High Breakdown, Efficient Regression Estimator , 1993 .

[17]  S. Weisberg,et al.  An Introduction to Regression Graphics , 1994 .

[18]  Roy E. Welsch,et al.  Regression Diagnostics with Dynamic Graphics: [With Discussions and Response] , 1989 .

[19]  Simon J. Sheather,et al.  Diagnostics to detect differences in Robust fits of linear models , 1996 .

[20]  Joseph W. McKean,et al.  A comparison of methods for studentizing the sample median , 1984 .