A structural equation modelling approach to the analysis of change.

Analysis of change is probably the most commonly adopted study design in medical and dental research when comparing the efficacy of two or more treatment modalities. The most commonly used methods for testing the difference in treatment efficacy are the two-sample t-test and the analysis of covariance (ANCOVA). It has been suggested that ancova should be used in the analysis of change for data from randomized controlled trials (RCTs) as a result of its greater statistical power. However, it is less well known that although both methods will give rise to similar results in the analysis of change for RCTs, there are different assumptions behind these methods in terms of the relationship between baseline value and the subsequent change, and the results may therefore differ if baseline values are not balanced between groups. This article uses structural equation modelling as a conceptual framework to explain the assumptions behind these methods, and two examples are used to show when the two methods yield similar results and why, in some non-randomized studies, the two methods might give substantially different results, known as 'Lord's paradox' in the statistical literature. For the appropriate interpretation of non-randomized studies, the assumptions underlying these methods therefore need to be taken into consideration.

[1]  M. Gilthorpe,et al.  Statistical issues on the analysis of change in follow-up studies in dental research. , 2007, Community dentistry and oral epidemiology.

[2]  William R Shadish,et al.  Propensity Scores , 2005, Evaluation review.

[3]  V Clerehugh,et al.  Statistical Power for Analyses of Changes in Randomized Controlled Trials , 2005, Journal of dental research.

[4]  H. Wainer,et al.  Two statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data , 2004 .

[5]  Andrew J Vickers,et al.  The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: a simulation study , 2001, BMC medical research methodology.

[6]  I. Moon,et al.  Effects of pretreatment clinical parameters on bioactive glass implantation in intrabony periodontal defects. , 2001, Journal of periodontology.

[7]  Lawrence B. Mohr,et al.  Regression artifacts and other customs of dubious desert , 2000 .

[8]  P. Rosenbaum,et al.  Invited commentary: propensity scores. , 1999, American journal of epidemiology.

[9]  Z. Artzi,et al.  Rotated split palatal flap for soft tissue primary coverage over extraction sites with immediate implant placement. Description of the surgical procedure and clinical results. , 1999, Journal of periodontology.

[10]  Donald Rubin,et al.  Estimating Causal Effects from Large Data Sets Using Propensity Scores , 1997, Annals of Internal Medicine.

[11]  R. Grainger,et al.  Use of analysis of covariance in periodontal clinical trials. , 1974, Journal of periodontal research. Supplement.

[12]  F. Lord A paradox in the interpretation of group comparisons. , 1967, Psychological bulletin.