Sensitivity Analysis for m‐Estimates, Tests, and Confidence Intervals in Matched Observational Studies

Huber's m-estimates use an estimating equation in which observations are permitted a controlled level of influence. The family of m-estimates includes least squares and maximum likelihood, but typical applications give extreme observations limited weight. Maritz proposed methods of exact and approximate permutation inference for m-tests, confidence intervals, and estimators, which can be derived from random assignment of paired subjects to treatment or control. In contrast, in observational studies, where treatments are not randomly assigned, subjects matched for observed covariates may differ in terms of unobserved covariates, so differing outcomes may not be treatment effects. In observational studies, a method of sensitivity analysis is developed for m-tests, m-intervals, and m-estimates: it shows the extent to which inferences would be altered by biases of various magnitudes due to nonrandom treatment assignment. The method is developed for both matched pairs, with one treated subject matched to one control, and for matched sets, with one treated subject matched to one or more controls. The method is illustrated using two studies: (i) a paired study of damage to DNA from exposure to chromium and nickel and (ii) a study with one or two matched controls comparing side effects of two drug regimes to treat tuberculosis. The approach yields sensitivity analyses for: (i) m-tests with Huber's weight function and other robust weight functions, (ii) the permutational t-test which uses the observations directly, and (iii) various other procedures such as the sign test, Noether's test, and the permutation distribution of the efficient score test for a location family of distributions. Permutation inference with covariance adjustment is briefly discussed.

[1]  Joseph L. Gastwirth,et al.  Asymptotic separability in sensitivity analysis , 2000 .

[2]  J. S. Maritz,et al.  A note on exact robust confidence intervals for location , 1979 .

[3]  G. W. Imbens Sensitivity to Exogeneity Assumptions in Program Evaluation , 2003 .

[4]  D. F. Andrews,et al.  Robust Estimates of Location , 1972 .

[5]  Gottfried E. Noether Some Simple Distribution-Free Confidence Intervals for the Center of a Symmetric Distribution , 1973 .

[6]  P. Rosenbaum,et al.  Randomization Inference With Imperfect Compliance in the ACE-Inhibitor After Anthracycline Randomized Trial , 2004 .

[7]  J. Robins,et al.  Sensitivity Analysis for Selection bias and unmeasured Confounding in missing Data and Causal inference models , 2000 .

[8]  B. L. Welch ON THE z-TEST IN RANDOMIZED BLOCKS AND LATIN SQUARES , 1937 .

[9]  R. Zieliński,et al.  Robust statistical procedures: A general approach , 1983 .

[10]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[11]  W Popp,et al.  Elevated DNA single-strand breakage frequencies in lymphocytes of welders exposed to chromium and nickel. , 1998, Carcinogenesis.

[12]  P. Rosenbaum Covariance Adjustment in Randomized Experiments and Observational Studies , 2002 .

[13]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[14]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[15]  K E Warner,et al.  Smoking and lung cancer: an overview. , 1984, Cancer research.

[16]  J. Copas,et al.  Local sensitivity approximations for selectivity bias , 2001 .

[17]  J. S. Maritz Distribution-Free Statistical Methods , 1981 .

[18]  E. C. Hammond,et al.  Smoking and lung cancer: recent evidence and a discussion of some questions. , 1959, Journal of the National Cancer Institute.

[19]  R. Kronmal,et al.  Assessing the sensitivity of regression results to unmeasured confounders in observational studies. , 1998, Biometrics.

[20]  T. Speed,et al.  On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9 , 1990 .

[21]  Paul R. Rosenbaum,et al.  Exact Confidence Intervals for Nonconstant Effects by Inverting the Signed Rank Test , 2003 .

[22]  Paul R. Rosenbaum,et al.  A Note on Optimal Matching With Variable Controls Using the Assignment Algorithm , 2001 .

[23]  P. Rosenbaum Hodges-Lehmann Point Estimates of Treatment Effect in Observational Studies , 1993 .

[24]  J. S. Maritz,et al.  Distribution-Free Statistical Methods , 1996 .

[25]  J. I The Design of Experiments , 1936, Nature.

[26]  I. Thomas,et al.  Chromosomal aberrations in tuberculosis patients before and after treatment with short-term chemotherapy. , 1991, Mutation research.

[27]  James M. Robins,et al.  Association, Causation, And Marginal Structural Models , 1999, Synthese.

[28]  Ven-Shion Shu,et al.  Robust estimation of a location parameter in the presence of outliers , 1978 .

[29]  Terence P. Speed,et al.  Introductory Remarks on Neyman (1923) , 1990 .