Interval sampling methods and measurement error: a computer simulation.

A simulation study was conducted to provide a more thorough account of measurement error associated with interval sampling methods. A computer program simulated the application of momentary time sampling, partial-interval recording, and whole-interval recording methods on target events randomly distributed across an observation period. The simulation yielded measures of error for multiple combinations of observation period, interval duration, event duration, and cumulative event duration. The simulations were conducted up to 100 times to yield measures of error variability. Although the present simulation confirmed some previously reported characteristics of interval sampling methods, it also revealed many new findings that pertain to each method's inherent strengths and weaknesses. The analysis and resulting error tables can help guide the selection of the most appropriate sampling method for observation-based behavioral assessments.

[1]  Hoi K. Suen,et al.  The use of momentary time sampling to assess both frequency and duration of behavior , 1983 .

[2]  H. Suen,et al.  A post hoc correction procedure for systematic errors in time-sampling duration estimates , 1986 .

[3]  A. Martindale,et al.  TAKING A CLOSER LOOK: TIME SAMPLING AND MEASUREMENT ERROR1 , 1977 .

[4]  B. Sulzer-Azaroff,et al.  Behavior analysis for lasting change , 1991 .

[5]  J. Cooper,et al.  Applied behavior analysis in education , 1982 .

[6]  Alicia M. Alvero,et al.  Measuring Safety Performance , 2008 .

[7]  Comparability of methods used in the sampling of primate behavior , 1983, American journal of primatology.

[8]  I. Beale,et al.  The representativeness of observational samples of different durations. , 1990, Journal of applied behavior analysis.

[9]  D. Leger.  An empirical evaluation of instantaneous and one-zero sampling of chimpanzee behavior , 1977, Primates.

[10]  Jason C Bourret,et al.  A comparison of momentary time sampling and partial-interval recording for evaluating functional relations. , 2007, Journal of applied behavior analysis.

[11]  R. Saudargas,et al.  Momentary time sampling as an estimate of percentage time: A field validation. , 1990, Journal of applied behavior analysis.

[12]  Alicia M. Alvero,et al.  Observer Error When Measuring Safety-Related Behavior: Momentary Time Sampling Versus Whole-Interval Recording , 2012 .

[13]  G Murphy,et al.  Measurement error in direct observations: a comparison of common recording methods. , 1980, Behaviour research and therapy.

[14]  Johannes Rojahn,et al.  Toward an empirically based parameter selection for time-sampling observation systems , 1985 .

[15]  P. Krausman,et al.  Planning and Assessment of Activity Budget Studies Employing Instantaneous Sampling , 2008 .

[16]  Jürgen Engel,et al.  Choosing an appropriate sample interval for instantaneous sampling , 1996, Behavioural Processes.

[17]  Alex Harrop,et al.  Observer error in the use of momentary time sampling and partial interval recording , 1994 .

[18]  W. L. Heward.  Focus on behavior analysis in education , 1984 .

[19]  Measuring the Behaviors of Wintering Black-faced Spoonbills (Platalea minor  ): Comparison of Behavioral Sampling Techniques , 2007 .

[20]  P. Gunter,et al.  Efficacy of Using Momentary Time Samples to Determine On-Task Behavior of Students with Emotional/Behavioral Disorders , 2003 .

[21]  J. Powell,et al.  ON THE INABILITY OF INTERVAL TIME SAMPLING TO REFLECT FREQUENCY OF OCCURRENCE DATA1 , 1978 .

[22]  Regina A. Carroll,et al.  DETECTING CHANGES IN SIMULATED EVENTS II: USING VARIATIONS OF MOMENTARY TIME-SAMPLING TO MEASURE CHANGES IN DURATION EVENTS , 2009 .

[23]  J. Rapp,et al.  Detecting False Positives in Multielement Designs , 2011, Behavior modification.

[24]  M. Simpson,et al.  One-zero and scan methods for sampling behaviour , 1977, Animal Behaviour.

[25]  Regina A. Carroll,et al.  Detecting changes in simulated events using partial‐interval recording and momentary time sampling , 2008 .

[26]  A Harrop,et al.  Methods of time sampling: A reappraisal of momentary time sampling and partial interval recording. , 1986, Journal of applied behavior analysis.

[27]  E. McDowell.  Comparison of time-sampling and continuous-recording techniques for observing developmental changes in caretaker and infant behaviors. , 1973, The Journal of genetic psychology.

[28]  O. Mudford,et al.  Continuous recording and interobserver agreement algorithms reported in the Journal of Applied Behavior Analysis (1995-2005). , 2009, Journal of applied behavior analysis.

[29]  Kate Fiske,et al.  Use of Discontinuous Methods of Data Collection in Behavioral Intervention: Guidelines for Practitioners , 2012, Behavior analysis in practice.

[30]  Robin I. M. Dunbar.  Some Aspects of Research Design and Their Implications in the Observational Study of Behaviour , 1976 .

[31]  A. Martindale,et al.  Taking a closer look: time sampling and measurement error. , 1977, Journal of applied behavior analysis.

[32]  Lisa N. Britton,et al.  Interval recording for duration events: a re‐evaluation , 2007 .

[33]  J Mansell,et al.  Time sampling and measurement error: the effect of interval length and sampling pattern. , 1985, Journal of behavior therapy and experimental psychiatry.

[34]  Alicia M. Alvero,et al.  A Further Assessment of Momentary Time-Sampling Across Extended Interval Lengths , 2011 .

[35]  Gabriel Schnerch,et al.  Detecting Changes in Simulated Events Using Partial-Interval Recording and Momentary Time Sampling III: Evaluating Sensitivity as a Function of Session Length , 2011 .

[36]  A. Martindale,et al.  An evaluation of time-sample measures of behavior. , 1975, Journal of applied behavior analysis.

[37]  Alvin D. Wiggins,et al.  Temporal and Procedural Influences on Activity Estimated by Time-Sampling , 1982 .

[38]  D. Ary.  Mathematical explanation of error in duration recording using partial interval, whole interval, and momentary time sampling , 1984 .

[39]  A. Repp,et al.  A comparison of frequency, interval, and time-sampling methods of data collection. , 1976, Journal of applied behavior analysis.

[40]  Alan C. Repp,et al.  An investigation of the accuracy of momentary time sampling procedures with time series data , 1984 .

[41]  M. E. Boyle.  Single Case Experimental Designs: Strategies for Studying Behavior Change , 1983 .

[42]  R W Sanson-Fisher,et al.  An empirical method for determining an appropriate interval length for recording behavior. , 1980, Journal of applied behavior analysis.

[43]  Stephen Tyler,et al.  Time-sampling: A matter of convention , 1979, Animal Behaviour.

[44]  Samuel B. Green,et al.  Accuracy of observational data with whole interval, partial interval, and momentary time-sampling recording techniques , 1982 .

[45]  H K Suen.  Reappraisal of momentary time sampling and partial-interval recording. , 1991, Journal of applied behavior analysis.

[46]  J. Powell.  On the misrepresentation of behavioral realities by a widely practiced direct observation procedure: partial interval (one-zero) sampling , 1984 .

[47]  Richard L. Scheaffer,et al.  Elementary Survey Sampling , 1971 .

[48]  Ron P. Edwards,et al.  Accuracy of Long Momentary Time-Sampling Intervals: Implications for Classroom Data Collection , 1990 .

[49]  Gina Green,et al.  Comparison of direct observational methods for measuring stereotypic behavior in children with autism spectrum disorders. , 2004, Research in developmental disabilities.