Rank-Based Robust Analysis of Linear Models. I. Exposition and Review

Linear models are widely used in many branches of empirical inquiry. The classical analysis of linear models, however, is based on a number of technical assumptions whose failure to apply to the data at hand can result in poor performance of the classical techniques. Two methods of dealing with this that have gained some acceptance are the data-analytic and model expansion approaches, in which graphical and numerical methods are employed to detect the ways in which the data do not meet the classical assumptions, and either the data are modified appropriately before the classical techniques are applied (data-analytic) or the model is broadened to take account of the departures discovered (model expansion). Another approach involves the use of robust methods, which are intended to be sufficiently insensitive to deviations from the classical assumptions that the data may be analyzed without modification or additional (explicit) modeling. In this article a comparison is made between the data-analytic, model expansion and robust approaches to linear models analysis, and the application of one type of robust methods, those based on R-estimators (which use the logic of rank tests to motivate inference on the raw data scale), to problems of estimation, testing and confidence and multiple comparison procedures in the general linear model is reviewed.

[1]  Thomas P. Hettmansperger,et al.  A Robust Alternative Based on Ranks to Least Squares in Analyzing Linear Models , 1977 .

[2]  C. Tsokos,et al.  Developments in Nonparametric Density-Estimation , 1980 .

[3]  Beat Kleiner,et al.  Graphical Methods for Data Analysis , 1983 .

[4]  P. McCullagh,et al.  Generalized Linear Models , 1972, Predictive Analytics.

[5]  S. Portnoy.  Further Remarks on Robust Estimation in Dependent Situations , 1979 .

[6]  W. Kruskal,et al.  Use of Ranks in One-Criterion Variance Analysis , 1952 .

[7]  Ronald Schrader,et al.  Robust analysis of variance , 1977 .

[8]  David Ruppert,et al.  On prediction and the power transformation family , 1981 .

[9]  E. L. Lehmann,et al.  Nonparametric Confidence Intervals for a Shift Parameter , 1963 .

[10]  E. Schuster.  On the rate of convergence of an estimate of a functional of a probability density , 1974 .

[11]  E. Lehmann.  Asymptotically Nonparametric Inference in some Linear Models with One Observation per Cell , 1964 .

[12]  R. Tapia,et al.  Nonparametric Probability Density Estimation , 1978 .

[13]  P. K. Sen,et al.  A Note on Asymptotically Distribution Free Tests for Subhypotheses in Multiple Linear Regression , 1973 .

[14]  James C. Aubuchon,et al.  A note on the estimation of the integral of ⨍2(x) , 1984 .

[15]  W. Cleveland.  Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[16]  J. L. Hodges,et al.  Estimates of Location Based on Rank Tests , 1963 .

[17]  David A. Belsley,et al.  Regression Analysis and its Application: A Data-Oriented Approach.@@@Applied Linear Regression.@@@Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1981 .

[18]  J. Jurečková.  Central Limit Theorem for Wilcoxon Rank Statistics Process , 1973 .

[19]  G. Box.  NON-NORMALITY AND TESTS ON VARIANCES , 1953 .

[20]  S. Sheather,et al.  A Data Based Algorithm for Choosing the Window Width when Estimating the Integral of f2(x). , 1985 .

[21]  J. N. Adichie.  ESTIMATES OF REGRESSION PARAMETERS BASED ON RANK TESTS , 1967 .

[22]  Hira L. Koul,et al.  An Estimator of the Scale Parameter for the Rank Analysis of Linear Models under General Score Functions , 1987 .

[23]  Stephen M. Stigler,et al.  The History of Statistics: The Measurement of Uncertainty before 1900 , 1986 .

[24]  R. A. Groeneveld,et al.  Practical Nonparametric Statistics (2nd ed). , 1981 .

[25]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[26]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[27]  S. Weisberg.  Plots, transformations, and regression , 1985 .

[28]  Thomas P. Hettmansperger,et al.  Tests of hypotheses based on ranks in the general linear model , 1976 .

[29]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[30]  D. R. Cox,et al.  Nonlinear models, residuals and transformations 1 , 1977 .

[31]  Anthony C. Atkinson,et al.  Plots, transformations, and regression : an introduction to graphical methods of diagnostic regression analysis , 1987 .

[32]  S. Portnoy.  Robust Estimation in Dependent Situations , 1977 .

[33]  E. Spjøtvoll.  A Note on Robust Estimation in Analysis of Variance , 1968 .

[34]  R. Serfling,et al.  On estimation of a class of efficacy-related parameters , 1981 .

[35]  C. D. Kemp,et al.  Statistical Inference Based on Ranks , 1986 .

[36]  Asymptotic Behavior of Wilcoxon Type Confidence Regions in Multiple Linear Regression , 1969 .

[37]  Raymond J. Carroll,et al.  Studentizing Robust Estimates. , 1975 .

[38]  G. Box.  Some Theorems on Quadratic Forms Applied in the Study of Analysis of Variance Problems, I. Effect of Inequality of Variance in the One-Way Classification , 1954 .

[39]  P. J. Huber.  Robust Regression: Asymptotics, Conjectures and Monte Carlo , 1973 .

[40]  C. J. Stone,et al.  Consistent Nonparametric Regression , 1977 .

[41]  G. C. Tiao,et al.  A Further Look at Robustness via Bayes's Theorem , 1962 .

[42]  Pranab Kumar Sen,et al.  On M tests in linear models , 1982 .

[43]  D. Ruppert,et al.  Trimmed Least Squares Estimation in the Linear Model , 1980 .

[44]  M. Friedman.  The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[45]  George E. Policello,et al.  Adaptive Robust Procedures for the One-Sample Location Problem , 1976 .

[46]  W. Dixon,et al.  BMDP statistical software , 1983 .

[47]  David Ruppert,et al.  Robust Estimation in Heteroscedastic Linear Models. , 1982 .

[48]  E. L. Lehmann,et al.  Asymptotically Nonparametric Inference: An Alternative Approach to Linear Models , 1963 .

[49]  M. Srivastava.  Asymptotically most powerful rank tests for regression parameters in manova , 1972 .

[50]  Norman R. Draper,et al.  Applied regression analysis (2. ed.) , 1981, Wiley series in probability and mathematical statistics.

[51]  C. Spearman.  The proof and measurement of association between two things. By C. Spearman, 1904. , 1987, The American journal of psychology.

[52]  Andre Antille,et al.  A Linearized Version of the Hodges-Lehmann Estimator , 1974 .

[53]  A. Antille.  Asymptotic Linearity of Wilcoxon Signed-Rank Statistics , 1976 .

[54]  Tore Schweder,et al.  Window Estimation of the Asymptotic Variance of Rank Estimators of Location. , 1973 .

[55]  E. L. Lehmann,et al.  Robust Estimation in Analysis of Variance , 1963 .

[56]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[57]  J. Jurecková,et al.  Nonparametric Estimate of Regression Coefficients , 1971 .

[58]  Roger Koenker,et al.  An empirical quantile function for linear models with iid errors , 1981 .

[59]  P. Bickel,et al.  On Some Analogues to Linear Combinations of Order Statistics in the Linear Model , 1973 .

[60]  Louis A. Jaeckel.  Estimating Regression Coefficients by Minimizing the Dispersion of the Residuals , 1972 .

[61]  S. Weisberg,et al.  Applied Linear Regression (2nd ed.). , 1986 .

[62]  Pranab Kumar Sen,et al.  A Class of Rank Order Tests for a General Linear Hypothesis , 1969 .