Invited Article : Improved Randomization Tests for a Class of Single-Case Intervention Designs

Forty years ago, Eugene Edgington developed a single-case AB intervention design-and-analysis procedure based on a random determination of the point at which the B phase would start. In the present simulation studies encompassing a variety of AB-type contexts, it is demonstrated that by also randomizing the order in which the A and B phases are administered, a researcher can markedly increase the procedure's statistical power.

[1]  Rumen Manolov,et al.  A comparison of mean phase difference and generalized least squares for analyzing single-case data. , 2013, Journal of school psychology.

[2]  Matthew J. Koehler,et al.  Regulated Randomization: A Potentially Sharper Analytical Tool for the Multiple-Baseline Design , 1998 .

[3]  J. Levin,et al.  An Empirical Investigation of the Statistical Properties of Generalized Single-Case Randomization Tests. , 2004 .

[4]  Bruce E. Wampold,et al.  Generalized Single-Case Randomization Tests: Flexible Analyses for a Variety of Situations. , 1999 .

[5]  J. T. Stocks,et al.  Evaluation of Single Subject Data Using Statistical Hypothesis Tests versus Visual Inspection of Charts With and Without Celeration Lines , 1995 .

[6]  J. Levin,et al.  Crafting educational intervention research that's both credible and creditable , 1994 .

[7]  T. Kratochwill,et al.  Teleconsultation: The use of technology to improve evidence-based practices in rural communities. , 2016, Journal of school psychology.

[8]  M. Gerrard,et al.  We're All in This Together , 2013 .

[9]  Petra Kaufmann,et al.  Experimental And Quasi Experimental Designs For Research , 2016 .

[10]  D. Bearison,et al.  The Impact of a Computer Network on Pediatric Pain and Anxiety , 2002, Social work in health care.

[11]  Eden Nagler Kyse,et al.  Analyzing data from single-case designs using multilevel models: new applications and some agenda items for future research. , 2013, Psychological methods.

[12]  J Ferron,et al.  Using randomization tests with responsive single-case designs. , 1994, Behaviour research and therapy.

[13]  E S Edgington,et al.  Randomization tests for restricted alternating treatments designs. , 1994, Behaviour research and therapy.

[14]  Hariharan Swaminathan,et al.  A generalized least squares regression approach for computing effect sizes in single-case research: application examples. , 2011, Journal of school psychology.

[15]  E. Edgington.  Randomization Tests for One-Subject Operant Experiments , 1975 .

[16]  James E Pustejovsky,et al.  A d-statistic for single-case designs that is equivalent to the usual between-groups d-statistic , 2014, Neuropsychological rehabilitation.

[17]  John Ferron,et al.  Statistical Power of Randomization Tests Used with Multiple-Baseline Designs , 2002 .

[18]  Michael Perdices,et al.  Single-Case Experimental Designs , 2014 .

[19]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[20]  Melissa K. Ainsworth.  Effectiveness of the ALL Curriculum to Teach Basic Literacy Skills to Groups of Students with Severe Disabilities and Complex Communication Needs , 2014 .

[21]  L. A. Marascuilo,et al.  Appropriate Post Hoc Comparisons for Interaction and Nested Hypotheses in Analysis of Variance Designs: The Elimination of Type IV Errors1 , 1970 .

[22]  James W. Hall,et al.  School applications of the mnemonic keyword method as a study strategy by eighth graders. , 1982 .

[23]  Kimberly J. Vannest,et al.  An improved effect size for single-case research: nonoverlap of all pairs. , 2009, Behavior therapy.

[24]  Joel R. Levin,et al.  3 – N = Nonparametric Randomization Tests , 1978 .

[25]  M. Heyvaert,et al.  Randomization tests for single-case experiments: State of the art, state of the science, and state of the application , 2014 .

[26]  J. Levin,et al.  Enhancing the scientific credibility of single-case intervention research: randomization to the rescue. , 2010, Psychological methods.

[27]  E. Edgington.  Validity of Randomization Tests for one-Subject Experiments , 1980 .

[28]  Thomas R. Kratochwill,et al.  Single Subject Research: Strategies for Evaluating Change , 1978 .

[29]  Thomas R. Kratochwill,et al.  Meta-analysis for single-case consultation outcomes: Applications to research and practice , 1995 .

[30]  J. Connell,et al.  We're all in this together now: group performance feedback to increase classroom team data collection. , 2011, Journal of school psychology.

[31]  Robert H. Horner,et al.  Constructing single-case research designs: Logic and options. , 2014 .

[32]  Dafydd Gibbon,et al.  1 User’s guide , 1998 .

[33]  J. Levin,et al.  Extensions of a versatile randomization test for assessing single-case intervention effects. , 2011, Journal of school psychology.

[34]  Nicole M. Rodriguez,et al.  An evaluation of the generalization and maintenance of functional communication and self-control skills with preschoolers. , 2014, Journal of applied behavior analysis.

[35]  Joel R. Levin.  Overcoming feelings of powerlessness in "aging" researchers: a primer on statistical power in analysis of variance designs. , 1997 .

[36]  Eugene S. Edgington,et al.  Randomization Tests , 2011, International Encyclopedia of Statistical Science.

[37]  Gene S Fisch,et al.  Evaluating data from behavioral analysis: visual inspection or statistical models? , 2001, Behavioural Processes.

[38]  John Ferron,et al.  Tests for the Visual Analysis of Response-Guided Multiple-Baseline Data , 2006 .

[39]  Thomas E. Scruggs,et al.  Promoting Expressive Writing among Students with Emotional and Behavioral: Disturbance via Dialogue Journals , 2005 .

[40]  Robert H. Horner,et al.  Single-Case Intervention Research Design Standards , 2013 .

[41]  Joel R. Levin,et al.  Single-Case Intervention Research: Methodological and Statistical Advances , 2014 .

[42]  J. Levin,et al.  Single-case research design and analysis : new directions for psychology and education , 1992 .

[43]  W. Shadish,et al.  Characteristics of single-case designs used to assess intervention effects in 2008 , 2011, Behavior research methods.

[44]  Robert H. Horner,et al.  Visual analysis of single-case intervention research: Conceptual and methodological issues. , 2014 .

[45]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[46]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[47]  S. Guay,et al.  Posttraumatic Stress Disorder and Social Support in Female Victims of Sexual Assault , 2008, Behavior modification.

[48]  J. Levin.  5 A Transfer-Appropriate-Processing Perspective of Pictures in Prose , 1989 .

[49]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[50]  John M. Ferron,et al.  Analyzing Single-Case Data: The Power of Randomization Tests. , 1995 .

[51]  Rumen Manolov,et al.  Single case experimental designs: Introduction to a special issue of Neuropsychological Rehabilitation , 2014, Neuropsychological rehabilitation.

[52]  Robert H. Horner,et al.  Single-Case Designs Technical Documentation. , 2010 .

[53]  D. Baer,et al.  The application of operant conditioning techniques in a secondary school classroom. , 1969, Journal of applied behavior analysis.

[54]  G. P. Hanley,et al.  Producing meaningful improvements in problem behavior of children with autism via synthesized analyses and treatments. , 2014, Journal of applied behavior analysis.

[55]  Alan E. Kazdin,et al.  Obstacles in Using Randomization Tests in Single-Case Experimentation , 1980 .

[56]  L. Bonnet.  The Effects of Point-of-View Video Modeling on Symbolic Play Actions and Play-Associated Language Utterances in Preschoolers With Autism , 2012 .

[57]  Daniel G. Brooks,et al.  Proceedings of the 20th Symposium on the Interface: Computing Science and Statistics: Computationally Intensive Methods in Statistics , 1990 .

[58]  F. Symons,et al.  Extending Classwide Social Skills Interventions to At-Risk Minority Students: A Preliminary Application of Randomization Tests Combined with Single-Subject Design Methodology , 2008 .

[59]  John M Ferron,et al.  Estimating causal effects from multiple-baseline studies: implications for design and analysis. , 2014, Psychological methods.

[60]  John M Ferron,et al.  From a single-level analysis to a multilevel analysis of single-case experimental designs. , 2014, Journal of school psychology.

[61]  Patrick Onghena,et al.  Randomization Tests for Extensions and Variations of ABAB Single-Case Experimental Designs: A Rejoinder , 1992 .

[62]  John M Ferron,et al.  Nonparametric statistical tests for single-case systematic and randomized ABAB…AB and alternating treatment intervention designs: new developments, new directions. , 2012, Journal of school psychology.

[63]  Anya S. Evmenova,et al.  The single-case data-analysis ExPRT (Excel Package of Randomization Tests). , 2014 .

[64]  John M. Ferron,et al.  Single-case permutation and randomization statistical tests: Present status, promising new developments. , 2014 .