The Functioning of Single-Case Randomization Tests With and Without Random Assignment

Abstract The authors used Monte Carlo methods to examine the Type I error rates for randomization tests applied to single-case data arising from ABAB designs involving random, systematic, or response-guided assignment of interventions. Six randomization tests were examined (permuting blocks of 1, 2, 3, or 5 observations, and randomly selecting intervention triplets so that each phase has at least 3 or 5 observations). When the design included randomization, the Type I error rate was controlled. When the design was systematic or guided by the absolute value of the slope, the tests permuting blocks tended to be liberal with positive autocorrelation, whereas those based on the random selection of intervention triplets tended to be conservative across levels of autocorrelation.

[1]  Bruce E. Wampold,et al.  Randomization tests for multiple-baseline designs. , 1986 .

[2]  John Todman,et al.  Accessible randomization tests for single-case and small-n experimental designs in AAC research , 1999 .

[3]  Jeffrey D. Kromrey,et al.  Determining the Efficacy of Intervention: The Use of Effect Sizes for Data Analysis in Single-Subject Research , 1996 .

[4]  E S Edgington,et al.  Randomized single-subject experimental designs. , 1996, Behaviour research and therapy.

[5]  B. Gorman,et al.  Design and Analysis of Single-Case Research , 1996 .

[6]  D. Barlow,et al.  Single Case Experimental Designs: Strategies for Studying Behavior Change , 1976 .

[7]  Patrick Onghena,et al.  Randomization Tests for Extensions and Variations of ABAB Single-Case Experimental Designs: A Rejoinder , 1992 .

[8]  John Todman,et al.  Single-case and Small-n Experimental Designs : A Practical Guide To Randomization Tests , 2001 .

[9]  Patrick Onghena,et al.  The power of randomization tests for single-case phase designs , 1996 .

[10]  E. Edgington,et al.  Randomization Tests (3rd ed.) , 1998 .

[11]  Joel R. Levin,et al.  3 – N = Nonparametric Randomization Tests , 1978 .

[12]  David B. Allison,et al.  Reflections on Visual Inspection, Response Guided Experimentation, and Type I Error Rate in Single-Case Designs. , 1992 .

[13]  Phillip J. Brantley,et al.  Criterion-related validity of self-report measures of female heterosocial functioning , 1988 .

[14]  Kenneth M. Greenwood,et al.  Problems with the application of interrupted time series analysis for brief single-subject data , 1990 .

[15]  John M. Ferron,et al.  Analyzing Single-Case Data: The Power of Randomization Tests. , 1995 .

[16]  Alan E. Kazdin,et al.  Obstacles in Using Randomization Tests in Single-Case Experimentation , 1980 .

[17]  E S Edgington,et al.  Randomization tests for restricted alternating treatments designs. , 1994, Behaviour research and therapy.

[18]  E. Edgington.  Validity of Randomization Tests for one-Subject Experiments , 1980 .

[19]  B. E. Huitema.  Autocorrelation: 10 Years of confusion , 1988 .

[20]  John Ferron,et al.  Statistical Power of Randomization Tests Used with Multiple-Baseline Designs , 2002 .

[21]  Matthew J. Koehler,et al.  Regulated Randomization: A Potentially Sharper Analytical Tool for the Multiple-Baseline Design , 1998 .

[22]  Bruce A. Thyer,et al.  Single-case experimental designs: Strategies for studying behavior change (2nd edn): by David H. Barlow and Michel Hersen Pergamon Press, New York, 1984, 419 pp. , 1985 .

[23]  Alan E. Kazdin,et al.  Single-Case Research Designs , 1982 .

[24]  Donald M. Baer,et al.  The Graphic Analysis of Data , 1986 .

[25]  Eugene S. Edgington,et al.  Randomization Tests , 2011, International Encyclopedia of Statistical Science.

[26]  Thomas A. Matyas,et al.  Problems in the estimation of autocorrelation in brief time series and some implications for behavioral data , 1991 .

[27]  J Ferron,et al.  Using randomization tests with responsive single-case designs. , 1994, Behaviour research and therapy.