Simpson's Paradox, Lord's Paradox, and Suppression Effects are the same phenomenon – the reversal paradox

This article discusses three statistical paradoxes that pervade epidemiological research: Simpson's paradox, Lord's paradox, and suppression. These paradoxes have important implications for the interpretation of evidence from observational studies. This article uses hypothetical scenarios to illustrate how the three paradoxes are different manifestations of one phenomenon – the reversal paradox – depending on whether the outcome and explanatory variables are categorical, continuous or a combination of both; this renders the issues and remedies for any one to be similar for all three. Although the three statistical paradoxes occur in different types of variables, they share the same characteristic: the association between two variables can be reversed, diminished, or enhanced when another variable is statistically controlled for. Understanding the concepts and theory behind these paradoxes provides insights into some controversial or contradictory research findings. These paradoxes show that prior knowledge and underlying causal theory play an important role in the statistical modelling of epidemiological data, where incorrect use of statistical models might produce consistent, replicable, yet erroneous results.

[1]  R. Collins,et al.  Unravelling the fetal origins hypothesis: is there really an inverse association between birthweight and subsequent blood pressure? , 2002, The Lancet.

[2]  D J Barker,et al.  Fetal origins of coronary heart disease , 1995, BMJ.

[3]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[4]  Lawrence B. Mohr,et al.  Regression artifacts and other customs of dubious desert , 2000 .

[5]  K. Pearson,et al.  Mathematical Contributions to the Theory of Evolution. VI. Genetic (Reproductive) Selection: Inheritance of Fertility in Man, and of Fecundity in Thoroughbred Racehorses , 1899 .

[6]  G. Yule NOTES ON THE THEORY OF ASSOCIATION OF ATTRIBUTES IN STATISTICS , 1903 .

[7]  Yu-Kang Tu,et al.  Growth, current size and the role of the 'reversal paradox' in the foetal origins of adult disease: an illustration using vector geometry , 2006, Epidemiologic perspectives & innovations : EP+I.

[8]  J. Robins,et al.  When is baseline adjustment useful in analyses of change? An example with education and cognitive change. , 2005, American journal of epidemiology.

[9]  H. Wainer Adjusting for differential base rates: Lord's paradox again. , 1991, Psychological bulletin.

[10]  Minja K. Paik A Graphic Representation of a Three-Way Contingency Table: Simpson's Paradox and Correlation , 1985 .

[11]  Nanny Wermuth,et al.  A general condition for avoiding effect reversal after marginalization , 2003 .

[12]  N Paneth,et al.  Early nutritional origins of hypertension: a hypothesis still lacking support. , 1996, Journal of hypertension. Supplement : official journal of the International Society of Hypertension.

[13]  F. Lord A paradox in the interpretation of group comparisons. , 1967, Psychological bulletin.

[14]  D. Altman,et al.  Analysing controlled trials with baseline and follow up measurements , 2001, BMJ : British Medical Journal.

[15]  David J. Hand,et al.  Deconstructing Statistical Questions , 1994 .

[16]  T. Cole,et al.  Statistical issues in life course epidemiology. , 2006, American journal of epidemiology.

[17]  A. Wilcox,et al.  Invited commentary: the perils of birth weight--a lesson from directed acyclic graphs. , 2006, American journal of epidemiology.

[18]  Geraldine McNeill,et al.  Blood pressure in relation to birth weight in twins and singleton controls matched for gestational age. , 2003, American journal of epidemiology.

[19]  Matthias Egger,et al.  The scandal of poor epidemiological research , 2004, BMJ : British Medical Journal.

[20]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[21]  E. Alberman,et al.  Intergenerational influences affecting birth outcome. II. Preterm delivery and gestational age in the children of the 1958 British birth cohort. , 1998, Paediatric and perinatal epidemiology.

[22]  N. Jewell Statistics for Epidemiology , 2003 .

[23]  Rosemary A. Roberts,et al.  The Relationship among Sums of Squares, Correlation Coefficients, and Suppression , 1997 .

[24]  Luis A. Escobar,et al.  Suppression and Enhancement in Bivariate Regression , 1986 .

[25]  J. Eriksson,et al.  Fetal origins of adult disease: strength of effects and biological basis. , 2002, International journal of epidemiology.

[26]  Richie Poulton,et al.  Birth size, growth, and blood pressure between the ages of 7 and 26 years: failure to support the fetal origins hypothesis. , 2002, American journal of epidemiology.

[27]  Paul Horst,et al.  The prediction of personal adjustment. , 1942 .

[28]  M S Gilthorpe,et al.  What is the effect of adjusting for more than one measure of current body size on the relation between birthweight and blood pressure? , 2006, Journal of Human Hypertension.

[29]  G. Smith,et al.  Blood pressure and birthweight in first year university students aged 18-25. , 1999, Public health.

[30]  J. Pearl,et al.  Confounding and Collapsibility in Causal Inference , 1999 .

[31]  Charles S. Reichardt,et al.  Regression Facts and Artifacts. , 2000 .

[32]  C R Weinberg,et al.  Invited commentary: Barker meets Simpson. , 2005, American journal of epidemiology.

[33]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[34]  Roger Holder,et al.  A Quirk in Multiple Regression: The Whole Regression Can be Greater than the Sum of its Parts , 1988 .

[35]  F. Lord STATISTICAL ADJUSTMENTS WHEN COMPARING PREEXISTING GROUPS , 1968 .

[36]  Yu-Kang Tu,et al.  Why evidence for the fetal origins of adult disease might be a statistical artifact: the "reversal paradox" for the relation between birth weight and blood pressure in later life. , 2005, American journal of epidemiology.

[37]  E. H. Simpson,et al.  The Interpretation of Interaction in Contingency Tables , 1951 .

[38]  Statistics on the Table , 2001 .

[39]  E. Pedhazur Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .

[40]  D. Mackinnon,et al.  Equivalence of the Mediation, Confounding and Suppression Effect , 2000, Prevention Science.

[41]  V Clerehugh,et al.  Statistical Power for Analyses of Changes in Randomized Controlled Trials , 2005, Journal of dental research.

[42]  Ronald Christensen,et al.  GRAPHICAL VIEWS OF SUPPRESSION AND MULTICOLLINEARITY IN MULTIPLE LINEAR REGRESSION , 2006 .

[43]  T. Cole,et al.  Fetal origins of adult disease—the hypothesis revisited , 1999, BMJ.

[44]  M. Hernán,et al.  The birth weight "paradox" uncovered? , 2006, American journal of epidemiology.