The effect of autocorrelation on the results of visually analyzing data from single-subject designs.

OBJECTIVE Single-subject research designs are used to conduct clinical research and outcome evaluation in occupational therapy. Confusion exists regarding the best method to analyze and interpret single-subject data. METHOD One hundred graphs displaying the results of published single-subject research were examined to determine the influence of autocorrelation on the visual inferences made by the original investigators. The graphs were selected from 20 articles published over 10 years in seven rehabilitation journals. The data were extrapolated and lag 1 autocorrelation coefficients computed for both the baseline and treatment phases. RESULTS Data analysis focused on two issues: (a) whether a relationship existed between the amount of autocorrelation present in a graph and the conclusion on the basis of visual analysis and (b) whether the amount of autocorrelation varied across different phases of the single-subject graphs. When a significant degree of autocorrelation was present, researchers using visual analysis were more likely to conclude that there was no clinically significant change in performance. Autocorrelation values were significantly higher in the treatment phases of the single-subject designs. CONCLUSION Additional research is needed to establish a set of decision rules to assist clinicians in using visual analysis to evaluate the results of single-subject research.

[1]  Robert Gaylord-Ross,et al.  Visual Inspection and Statistical Analysis in Single-Case Designs , 1990 .

[2]  K J Ottenbacher,et al.  Trend line influence on visual analysis of single-subject data in rehabilitation research. , 1991, International disability studies.

[3]  R. R. Jones,et al.  Effects of serial dependency on the agreement between visual and statistical inference. , 1978, Journal of applied behavior analysis.

[4]  D. Gast,et al.  Single Subject Research in Special Education , 1984 .

[5]  K J Ottenbacher.  ANALYSIS OF DATA IN IDIOGRAPHIC RESEARCH: Issues and Methods , 1992, American journal of physical medicine & rehabilitation.

[6]  K. Ottenbacher.  Evaluating Clinical Change: Strategies for Occupational and Physical Therapists , 1986 .

[7]  C. Sharpley,et al.  Fallability in the Visual Assessment of Behavioural Interventions: Time-Series Statistics to Analyse Time-Series Data , 1986, Behaviour Change.

[8]  W W Tryon,et al.  Estimating and testing autocorrelation with small samples: a comparison of the C-statistic to a modified estimator. , 1993, Behaviour research and therapy.

[9]  M Wolery,et al.  Interpreting results of single-subject research designs. , 1982, Physical therapy.

[10]  J. Engel,et al.  Biofeedback-Assisted Relaxation Training for Adult and Pediatric Headache Disorders , 1990 .

[11]  K J Ottenbacher,et al.  Clinically Relevant Designs for Rehabilitation Research: The Idiographic Model , 1990, American journal of physical medicine & rehabilitation.

[12]  Joseph W. McKean,et al.  Autocorrelation estimation and inference with small samples. , 1991 .

[13]  Albert R. Roberts,et al.  Evaluating Practice: Guidelines for the Accountable Professional , 1983 .

[14]  L. Carey,et al.  Sensory loss in stroke patients: effective training of tactile and proprioceptive discrimination. , 1993, Archives of physical medicine and rehabilitation.

[15]  K J Ottenbacher,et al.  Interrater reliability of therapists' judgements of graphed data. , 1991, Physical therapy.

[16]  K J Ottenbacher,et al.  Interrater agreement of visual analysis in single-subject decisions: quantitative review and analysis. , 1993, American journal of mental retardation : AJMR.

[17]  K J Ottenbacher,et al.  Reliability and accuracy of visually analyzing graphed data from single-subject designs. , 1986, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[18]  Bradley E. Huitema,et al.  Autocorrelation in applied behavior analysis: A myth. , 1985 .

[19]  Donald M. Baer,et al.  The Graphic Analysis of Data , 1986 .

[20]  A. Deprospero,et al.  Inconsistent visual analyses of intrasubject data. , 1979, Journal of applied behavior analysis.

[21]  Thomas A. Matyas,et al.  Problems in the estimation of autocorrelation in brief time series and some implications for behavioral data , 1991 .

[22]  W. Velicer,et al.  A Comparison of Alternative Approaches to the Analysis of Interrupted Time-Series. , 1985, Multivariate behavioral research.