A more powerful familywise error control procedure for evaluating mean equivalence

Abstract When one wishes to show no meaningful differences among group means, equivalence tests should be used, as a nonsignificant test of mean difference does not provide evidence supporting equivalence. This research proposes two modified stepwise procedures for controlling the familywise Type I error rate, based on the Bonferroni-type correction of k2/4 (where k is the number of groups to be compared) proposed by Caffo, Lauzon and Rohmel (2013 Correction to “easy multiplicity control in equivalence testing using two One-Sided tests. The American Statistician 67 (2):115–6) Bonferroni-type correction of k2/4 (where k is the number of groups to be compared). Using a Monte Carlo simulation method, we show that adopting a stepwise procedure increases power, while maintaining the familywise error rate at or below α. Implications for applied research and directions for future study are discussed.

[1]  D G Altman,et al.  Statistics notes: Absence of evidence is not evidence of absence , 1995 .

[2]  Walter W. Hauck,et al.  A new procedure for testing equivalence in comparative bioavailability and other clinical trials , 1983 .

[3]  E. Lehmann.  Some Concepts of Dependence , 1966 .

[4]  Carolyn B. Lauzon,et al.  Easy Multiplicity Control in Equivalence Testing Using Two One-Sided Tests , 2009, The American statistician.

[5]  Nicole A. Lazar,et al.  Testing Statistical Hypotheses of Equivalence , 2003, Technometrics.

[6]  W. Westlake,et al.  Symmetrical confidence intervals for bioequivalence trials. , 1976, Biometrics.

[7]  R. Cribbie,et al.  Evaluating clinical significance through equivalence testing: Extending the normative comparisons approach , 2009, Psychotherapy research : journal of the Society for Psychotherapy Research.

[8]  P. Kendall,et al.  Normative comparisons for the evaluation of clinical significance. , 1999, Journal of consulting and clinical psychology.

[9]  Donald J. Schuirmann.  A comparison of the Two One-Sided Tests Procedure and the Power Approach for assessing the equivalence of average bioavailability , 1987, Journal of Pharmacokinetics and Biopharmaceutics.

[10]  Ronald C. Serlin,et al.  Equivalence confidence intervals for two-group comparisons of means , 1998 .

[11]  A. Beck,et al.  Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. , 1996, Journal of personality assessment.

[12]  Brian S. Yandell,et al.  Multiple Comparisons of Means , 1997 .

[13]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[14]  Correction to “Easy Multiplicity Control in Equivalence Testing Using Two One-Sided Tests” , 2013 .

[15]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[16]  R. Cribbie,et al.  Testing for negligible interaction: A coherent and robust approach. , 2016, The British journal of mathematical and statistical psychology.

[17]  Robert A. Cribbie,et al.  Tests of Equivalence for One-Way Independent Groups Designs , 2009 .

[18]  O. J. Dunn.  Multiple Comparisons among Means , 1961 .

[19]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[20]  H J Keselman,et al.  Controlling the rate of Type I error over a large set of statistical tests. , 2002, The British journal of mathematical and statistical psychology.

[21]  J. Tukey.  Comparing individual means in the analysis of variance. , 1949, Biometrics.

[22]  Joachim Röhmel,et al.  On familywise type I error control for multiplicity in equivalence trials with three or more treatments , 2011, Biometrical journal. Biometrische Zeitschrift.

[23]  Y. Hochberg.  A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[24]  Zhuang Fengqing,et al.  Patients’ Responsibilities in Medical Ethics , 2016 .

[25]  G. Hancock,et al.  The Quest for α: Developments in Multiple Comparison Procedures in the Quarter Century Since Games (1971) , 1996 .

[26]  J. L. Rogers,et al.  Using significance tests to evaluate equivalence between two experimental groups. , 1993, Psychological bulletin.