Characteristics Influencing the Visual Analysis of Single-Subject Data: An Empirical Analysis

A study explored various graphic characteristics associated with the visual analysis of single-subject data. A sample of 20 rehabilitation therapists used visual analysis to rate 24 graphs of data sets using a traditional baseline/treatment (AB) format. Using the intraclass correlation approach, the authors assessed the interrater reliability and found that it ranged from .52 to .66 for each graph. Data analysis revealed that the graphic characteristics of level and mean shift were associated with consistent judgments across the raters, and that changes in slope across the two phases of a graph were associated with substantial rater disagreement. The authors discuss the implications of using visual and statistical procedures to analyze single-subject data, and argue that quantitative adjuncts to visual analysis may facilitate the reliable interpretation of graphed data for a single subject.

[1]  D. Weiss,et al.  Interrater reliability and agreement of subjective judgments , 1975 .

[2]  D P Hartmann,et al.  Interrupted time-series analysis and its application to behavioral data. , 1980, Journal of applied behavior analysis.

[3]  A. Deprospero,et al.  Inconsistent visual analyses of intrasubject data. , 1979, Journal of applied behavior analysis.

[4]  J Michael,et al.  Statistical inference for individual organism research: mixed blessing or curse? , 1974, Journal of applied behavior analysis.

[5]  J. Rojahn,et al.  The linear regression line as a judgmental aid in visual analysis of serially dependent A-B time-series data , 1985 .

[6]  K J Ottenbacher,et al.  Reliability and accuracy of visually analyzing graphed data from single-subject designs. , 1986, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[7]  Donald M. Baer,et al.  The Graphic Analysis of Data , 1986 .

[8]  Bruce E. Wampold,et al.  Visual Analysis of Single-Subject Studies by School Psychologists. , 1981 .

[9]  R A Berk,et al.  Generalizability of behavioral observations: a clarification of interobserver agreement and interobserver reliability. , 1979, American journal of mental deficiency.

[10]  D. DiNitto.  Time-Series Analysis: An Application to Social Welfare Policy , 1983 .

[11]  R. R. Jones,et al.  Effects of serial dependency on the agreement between visual and statistical inference. , 1978, Journal of applied behavior analysis.

[12]  Janet D. Elashoff,et al.  6 – Choosing a Statistical Method for Analysis of an Intensive Experiment , 1978 .

[13]  D M Baer,et al.  "Perhaps it would be better not to know everything.". , 1977, Journal of applied behavior analysis.

[14]  B. S. Parsonson,et al.  2 – The Analysis and Presentation of Graphic Data , 1978 .

[15]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[16]  D. Barlow,et al.  Single Case Experimental Designs: Strategies for Studying Behavior Change , 1976 .

[17]  J. Bartko,et al.  On Various Intraclass Correlation Reliability Coefficients , 1976 .

[18]  D. Gast,et al.  Single Subject Research in Special Education , 1984 .

[19]  Alan Poling,et al.  Research methods in applied behavior analysis : issues and advances , 1986 .

[20]  Thomas R. Kratochwill,et al.  Single Subject Research: Strategies for Evaluating Change , 1978 .

[21]  G. Brody,et al.  Single Subject Designs , 1978 .

[22]  R. R. Jones,et al.  Time-series analysis in operant research. , 1977, Journal of applied behavior analysis.

[23]  Some Factors Limiting the Applicability of Applied Behavioral Research Descriptive Information in JAB A Articles , 1986 .