The relative accuracy and interpretability of five sequential analysis methods: A simulation study

A variety of sequential analysis methods exist to quantify close temporal associations between events from direct observation data. In the present study, we compared the relative accuracy and interpretability of five sequential-analysis methods using simulated data. The methods included three existing approaches (event lag, concurrent interval, and time window) and two proposed modifications of the event lag approach (event lag with contiguous pauses and event lag with noncontiguous pauses) designed to address limitations of the existing approaches. We evaluated accuracy on the basis of the extent to which the mean contingency estimates produced by each method approximated a known mean (i.e., zero). We evaluated interpretability on the basis of the extent to which the contingency estimates produced by each method were independent from chance estimates of the two-event sequence. The results indicated that the event lag with contiguous pauses method produced the most accurate and interpretable estimates of contingency. This modified method prevents the total number of event types from influencing contingency estimates, thus solving a problem associated with the traditional event lag method.

[1]  Paul J. Yoder,et al.  Reciprocal Sequential Relations in Conversations Between Parents and Children With Developmental Delays , 1994 .

[2]  Jon Tapp,et al.  A multiple option observation system for experimental studies: MOOSES , 1995 .

[3]  D. Cole,et al.  Mother-adolescent interactions and adolescent depressive symptoms: A sequential analysis , 2007 .

[4]  Sequential analysis reveals a unique structure for self-injurious behavior. , 2003, American journal of mental retardation : AJMR.

[5]  Paul J. Yoder,et al.  Empirical Guidance for Time-Window Sequential Analysis of Single Cases , 2004 .

[6]  Sander Greenland,et al.  Modern Epidemiology 3rd edition , 1986 .

[7]  T. Vollmer,et al.  Identifying possible contingencies during descriptive analyses of severe behavior disorders. , 2001, Journal of applied behavior analysis.

[8]  J. Bodfish,et al.  Sequential analysis of the effects of naltrexone on the environmental mediation of self-injurious behavior. , 2001, Experimental and clinical psychopharmacology.

[9]  Brian K. Martens,et al.  Agreement Between Descriptive and Experimental Analyses of Behavior under Naturalistic Test Conditions , 2010 .

[10]  Paul J. Yoder,et al.  Observational Measurement of Behavior , 2010 .

[11]  P. Yoder,et al.  Descriptive analysis of epileptic seizures and problem behavior in adults with developmental disabilities. , 2005, American journal of mental retardation : AJMR.

[12]  R. Bakeman,et al.  Sequential analysis and observational methods for the behavioral sciences , 2011 .

[13]  J. McComas,et al.  Sequential and matching analyses of self-injurious behavior a case of overmatching in the natural environment. , 2003, Journal of applied behavior analysis.

[14]  R. Bakeman,et al.  Log-linear approaches to lag-sequential analysis when consecutive codes may and cannot repeat. , 1995 .

[15]  P. Yoder,et al.  Quantifying contingent relations from direct observation data: transitional probability comparisons versus Yule's Q. , 2013, Journal of applied behavior analysis.

[16]  M. Kendall,et al.  An Introduction to the Theory of Statistics. , 1911 .

[17]  P. Yoder,et al.  Effect of adult continuing wh-questions on conversational participation in children with developmental disabilities. , 1994, Journal of speech and hearing research.

[18]  Karthik H. Shankar,et al.  Measures of association in contingency space analysis , 2014 .

[19]  Describing Antecedent-Behavior-Consequence Relations Using Conditional Probabilities and the General Operant Contingency Space: A Preliminary Investigation , 2005 .

[20]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[21]  C. Oliver,et al.  The nature of social preference and interactions in Smith-Magenis syndrome. , 2013, Research in developmental disabilities.

[22]  Ty W. Vernon Fostering a Social Child with Autism: A Moment-By-Moment Sequential Analysis of an Early Social Engagement Intervention , 2014, Journal of autism and developmental disorders.

[23]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .