Statistical Power of Randomization Tests Used with Multiple-Baseline Designs

Abstract Statistical power was estimated for 3 randomization tests used with multiple-baseline designs. In 1 test, participants were randomly assigned to baseline conditions; in the 2nd, intervention points were randomly assigned; and in the 3rd, the authors used both forms of random assignment. Power was studied for several series lengths (N = 10, 20, 30), several effect sizes (d = 0, 0.5, 1.0, 1.5, 2.0), and several levels of autocorrelation among the errors (p 1 = 0, .1, .2, .3, .4, and .5). Power was found to be similar among the 3 tests. Power was low for effect sizes of 0.5 and 1.0 but was often adequate (> .80) for effect sizes of 1.5 and 2.0.

[1]  W. Velicer,et al.  A Comparison of Alternative Approaches to the Analysis of Interrupted Time-Series. , 1985, Multivariate behavioral research.

[2]  Christopher F. Sharpley.  Single Case Experimental Designs Strategies for Studying Behavior Change David H. Barlow a Michel Hersen New York: Pergamon, 1984 (2nd ed), $ pp.419, + pp 419, $38.00 , 1985 .

[3]  D. Barlow,et al.  Single Case Experimental Designs: Strategies for Studying Behavior Change , 1976 .

[4]  Phillip J. Brantley,et al.  Criterion-related validity of self-report measures of female heterosocial functioning , 1988 .

[5]  John M. Ferron,et al.  Analyzing Single-Case Data: The Power of Randomization Tests. , 1995 .

[6]  Eugene S. Edgington,et al.  Overcoming Obstacles to Single-Subject Experimentation , 1980 .

[7]  J Ferron,et al.  Using randomization tests with responsive single-case designs. , 1994, Behaviour research and therapy.

[8]  B. Gorman,et al.  Design and Analysis of Single-Case Research , 1996 .

[9]  Bruce E. Wampold,et al.  Randomization tests for multiple-baseline designs. , 1986 .

[10]  G. Fisch,et al.  Visual Inspection of Data Revisited: Do the Eyes Still Have It? , 1998, The Behavior analyst.

[11]  E. Edgington.  Validity of Randomization Tests for one-Subject Experiments , 1980 .

[12]  E. Edgington,et al.  Randomization Tests (3rd ed.) , 1998 .

[13]  T. Matyas,et al.  Visual analysis of single-case time series: Effects of variability, serial dependence, and magnitude of intervention effects. , 1990, Journal of applied behavior analysis.

[14]  Alan E. Kazdin,et al.  Obstacles in Using Randomization Tests in Single-Case Experimentation , 1980 .

[15]  Patrick Onghena,et al.  The power of randomization tests for single-case phase designs , 1996 .

[16]  Matthew J. Koehler,et al.  Regulated Randomization: A Potentially Sharper Analytical Tool for the Multiple-Baseline Design , 1998 .

[17]  Bradley E. Huitema,et al.  Autocorrelation in applied behavior analysis: A myth. , 1985 .