Sequential analysis and observational methods for the behavioral sciences

1. Introduction to observational methods 2. Coding schemes and observational measurement 3. Recording observational data 4. Representing observational data 5. Observer agreement and Cohen's kappa 6. Kappas for point-by-point agreement 7. The intraclass correlation coefficient (ICC) for summary measures 8. Summary statistics for individual codes 9. Cell and summary statistics for contingency tables 10. Preparing for sequential and other analyses 11. Time-window and log-linear sequential analysis 12. Recurrence analysis and permutation tests.

[1]  C. Bernard.  Medical Classic. (Book Reviews: An Introduction to the Study of Experimental Medicine) , 1957 .

[2]  M. Parten.  Social participation among pre-school children. , 1932 .

[3]  Ruth E. Arrington.  Psychological Bulletin TIME SAMPLING IN STUDIES OF SOCIAL BEHAVIOR: A CRITICAL REVIEW OF TECHNIQUES AND RESULTS WITH . RESEARCH SUGGESTIONS , 1943 .

[4]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.

[5]  R. Barker,et al.  One boy's day : a specimen record of behavior , 1951 .

[6]  W. G. Cochran.  Some Methods for Strengthening the Common χ 2 Tests , 1954 .

[7]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[8]  S. Altmann,et al.  Sociobiology of rhesus monkeys. II. Stochastics of social communication. , 1965, Journal of theoretical biology.

[9]  Rupert G. Miller.  Simultaneous Statistical Inference , 1966 .

[10]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[11]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[12]  B. Everitt,et al.  Large sample standard errors of kappa and weighted kappa. , 1969 .

[13]  C. Hutt,et al.  Direct observation and measurement of behavior , 1970 .

[14]  S. B. Needleman,et al.  A general method applicable to the search for similarities in the amino acid sequence of two proteins. , 1970, Journal of molecular biology.

[15]  D. Fossey,et al.  Vocalizations of the mountain Gorilla (Gorilla gorilla beringei) , 1972 .

[16]  W. Douglass.  Summary, historical and political, of the first planting, progressive improvements, and present state of the British settlements in North America , 1972 .

[17]  J. S. Wiggins,et al.  Personality and prediction: principles of personality assessment / Jerry S. Wiggins , 1973 .

[18]  Jacob Cohen,et al.  The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability , 1973 .

[19]  J. Altmann,et al.  Observational study of behavior: sampling methods. , 1974, Behaviour.

[20]  J. Fleiss.  Statistical methods for rates and proportions , 1974 .

[21]  Stephen E. Fienberg,et al.  Discrete Multivariate Analysis: Theory and Practice , 1976 .

[22]  A. Martindale,et al.  An evaluation of time-sample measures of behavior. , 1975, Journal of applied behavior analysis.

[23]  Roger Bakeman,et al.  Cohesiveness and performance: Covariation and causality in an undersea environment , 1975 .

[24]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[25]  Michael T. Kane,et al.  AN INDEX OF DEPENDABILITY FOR MASTERY TESTS , 1977 .

[26]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[27]  S. Haberman.  Analysis of qualitative data , 1978 .

[28]  Stephen E. Fienberg,et al.  The analysis of cross-classified categorical data , 1980 .

[29]  Peter K. Smith.  A longitudinal study of social participation in preschool children: Solitary and parallel play reexamined. , 1978 .

[30]  J. Osofsky.  Handbook of infant development , 1979 .

[31]  A Sampled Randomization Test for Examining Single Cells of Behavioural Transition Matrices , 1979 .

[32]  G. R. Stephenson,et al.  Social interaction analysis : methodological issues , 1979 .

[33]  S. K. Mitchell.  Interobserver agreement, reliability, and generalizability of data collected in observational studies. , 1979 .

[34]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[35]  J. Gottman.  Marital Interaction: Experimental Investigations , 1980 .

[36]  R. Cairns,et al.  The Analysis of social interactions : methods, issues, and illustrations , 1979 .

[37]  Stephen Tyler,et al.  Time-sampling: A matter of convention , 1979, Animal Behaviour.

[38]  R A Berk,et al.  Generalizability of behavioral observations: a clarification of interobserver agreement and interobserver reliability. , 1979, American journal of mental deficiency.

[39]  Nicholas J. Mankovich,et al.  Two-act transitions, partitioned contingency tables, and the ‘significant cells’ problem , 1980, Animal Behaviour.

[40]  Roger Bakeman,et al.  The Strategic Use of Parallel Play: A Sequential Analysis. , 1980 .

[41]  K. Kaye,et al.  Estimating False Alarms and Missed Events From Interobserver Agreement: A Rationale , 1980 .

[42]  J. Belsky,et al.  From exploration to play: A cross-sectional study of infant free play behavior. , 1981 .

[43]  Marjorie Shostak,et al.  Nisa: The Life and Words of a !Kung Woman , 1981 .

[44]  J. Maizel,et al.  Enhanced graphic matrix analysis of nucleic acid and protein sequences. , 1981, Proceedings of the National Academy of Sciences of the United States of America.

[45]  John S. Uebersax,et al.  A Generalized Kappa Coefficient , 1982 .

[46]  P. Allison,et al.  Analyzing Sequential Categorical Data on Dyadic Interaction: A Comment on Gottman , 1982 .

[47]  John M. Gottman,et al.  Time Series Analysis: A Comprehensive Introduction for Social Scientists. , 1983 .

[48]  Kenneth H. Rubin,et al.  Peer relationships and social skills in childhood , 1982 .

[49]  Roger Bakeman,et al.  Mothers' communicative acts: changes during infancy , 1984 .

[50]  L. Adamson,et al.  Coordinating attention to people and objects in mother-infant and peer-infant interaction. , 1984, Child development.

[51]  Johannes Rojahn,et al.  Toward an empirically based parameter selection for time-sampling observation systems , 1985 .

[52]  D. Siegmund.  Sequential Analysis: Tests and Confidence Intervals , 1985 .

[53]  Roger Bakeman,et al.  Observing Interaction: An Introduction to Sequential Analysis , 1986 .

[54]  Paul S. Martin,et al.  Measuring Behaviour: An Introductory Guide , 1986 .

[55]  W. Willett,et al.  Misinterpretation and misuse of the kappa statistic. , 1987, American journal of epidemiology.

[56]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[57]  H K Suen,et al.  Agreement, reliability, accuracy, and validity: Toward a clarification. , 1988 .

[58]  D. Lipman,et al.  Improved tools for biological sequence comparison. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[59]  Hoi K. Suen,et al.  Analyzing Quantitative Behavioral Observation Data , 1989 .

[60]  T. Wickens.  Multiway Contingency Tables Analysis for the Social Sciences , 1989 .

[61]  R. Peterson,et al.  Interjudge Agreement and the Maximum Value of Kappa , 1989 .

[62]  R Bakeman,et al.  Kung infancy: the social context of object exploration. , 1990, Child development.

[63]  Jacob Cohen,et al.  THINGS I HAVE LEARNED (SO FAR) , 1990 .

[64]  John M. Gottman,et al.  Sequential Analysis: A Guide for Behavorial Researchers , 1990 .

[65]  J. Mann,et al.  Time sampling: a methodological critique. , 1991, Child development.

[66]  Patsy Haccou,et al.  Statistical Analysis of Behavioural Data: An Approach Based on Time-structured Models , 1992 .

[67]  John J. Kennedy.  Analyzing qualitative data : log-linear analysis for behavioral research , 1992 .

[68]  N. John Castellan,et al.  Shuffling arrays: Appearances may be deceiving , 1992 .

[69]  Roger Bakeman,et al.  SDIS: A sequential data interchange standard , 1992 .

[70]  Jacob Cohen.  The earth is round (p < .05) , 1994 .

[71]  Roger Bakeman,et al.  Understanding Log-linear Analysis With Ilog: An Interactive Approach , 1994 .

[72]  Roger Bakeman,et al.  Analyzing Interaction: Sequential Analysis with SDIS and GSEQ , 1995 .

[73]  T. Taris,et al.  Measuring the Agreement between Sequences , 1995 .

[74]  John M. Gottman,et al.  The Analysis of Change , 1995 .

[75]  R. Bakeman,et al.  Log-linear approaches to lag-sequential analysis when consecutive codes may and cannot repeat. , 1995 .

[76]  Jonathan Helfman,et al.  Dotplot Patterns: A Literal Look at Pattern Languages , 1996, Theory Pract. Object Syst..

[77]  Roger Bakeman,et al.  Testing sequential association: Estimating exact p values using sampled permutations. , 1996 .

[78]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[79]  Chris Oliver,et al.  A graphical method to aid the sequential analysis of observational data , 1997 .

[80]  Roger Bakeman,et al.  Detecting sequential patterns and determining their reliability with fallible observers. , 1997 .

[81]  William R. Shadish,et al.  Using odds ratios as effect sizes for meta-analysis of dichotomous data: A primer on methods and issues. , 1998 .

[82]  R. Bakeman,et al.  Comkappa: A Windows ’95 program for calculating kappa and related statistics , 1998 .

[83]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[84]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[85]  D. Oller.  The emergence of the speech capacity , 2000 .

[86]  Jonathan Foote,et al.  Automatic Music Summarization via Similarity Analysis , 2002, ISMIR.

[87]  David J White,et al.  Voice recognition technology as a tool for behavioral research , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[88]  Deborah F. Deckner,et al.  Rhythm in Mother‐Infant Interactions , 2003 .

[89]  R. Bakeman,et al.  Infant Response to Mother Call Patterns in Otolemur garnettii , 2003, Folia Primatologica.

[90]  Jonathan Foote,et al.  Media segmentation using self-similarity decomposition , 2003, IS&T/SPIE Electronic Imaging.

[91]  N. Marwan.  Encounters with neighbours : current developments of concepts based on recurrence plots and their applications , 2003 .

[92]  A. Bryman,et al.  The Sage Encyclopedia of Social Science Research Methods (three volumes) , 2003 .

[93]  Paul J. Yoder,et al.  Empirical Guidance for Time-Window Sequential Analysis of Single Cases , 2004 .

[94]  Roger Bakeman,et al.  The development of symbol-infused joint engagement. , 2004, Child development.

[95]  D. Teti,et al.  Handbook of Research Methods in Developmental Science , 2004 .

[96]  T. Matsuzawa,et al.  Food transfer between chimpanzee mothers and their infants , 2004, Primates.

[97]  S. Altmann,et al.  Estimating rates of behavior from Hansen frequencies , 1970, Primates.

[98]  R. Bakeman,et al.  Understanding Statistics in the Behavioral Sciences , 2005 .

[99]  J. Sim,et al.  The kappa statistic in reliability studies: use, interpretation, and sample size requirements. , 2005, Physical therapy.

[100]  John Hoeks,et al.  Proceedings of the 26th annual meeting of the Cognitive Science Society , 2005 .

[101]  Daniel C. Richardson,et al.  Looking To Understand: The Coupling Between Speakers' and Listeners' Eye Movements and Its Relationship to Discourse Comprehension , 2005, Cogn. Sci..

[102]  Peter Bell,et al.  Proceedings of Speech Prosody 2006 , 2006 .

[103]  K. Mccartney,et al.  INTRODUCTION TO THE MONOGRAPH , 2006 .

[104]  Michael J. Spivey,et al.  Unraveling the Dyad: Using Recurrence Analysis to Explore Patterns of Syntactic Coordination Between Children and Caregivers in Conversation , 2006 .

[105]  Andrew P. King,et al.  Mothers provide differential feedback to infants' prelinguistic sounds , 2006 .

[106]  Roger Bakeman,et al.  Observer agreement for event sequences: Methods and software for sequence alignment and reliability estimates , 2007, Behavior research methods.

[107]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[108]  Charles L. Webber,et al.  Recurrence Quantification Analysis: Introduction and Historical Context , 2007, Int. J. Bifurc. Chaos.

[109]  Robert C. Pianta,et al.  Opportunities to Learn in America's Elementary Classrooms , 2007, Science.

[110]  M. Bornstein,et al.  Mother-Infant Person- and Object-Directed Interactions in Latino Immigrant Families: A Comparative Approach. , 2008, Infancy : the official journal of the International Society on Infant Studies.

[111]  Vicenç Quera.  RAP: A computer program for exploring similarities in behavior sequences using random projections , 2008, Behavior research methods.

[112]  Roger Bakeman,et al.  ActSds and OdfSds: Programs for converting INTERACT and The Observer data files into SDIS timed-event sequential data files , 2008, Behavior research methods.

[113]  Roger Bakeman,et al.  Observer agreement for timed-event sequential data: A comparison of time-based and event-based algorithms , 2009, Behavior research methods.

[114]  Susan Goldin-Meadow,et al.  When gesture-speech combinations do and do not index linguistic change , 2009, Language and cognitive processes.

[115]  J. Cohn,et al.  Automated Measurement of Facial Expression in Infant-Mother Interaction: A Pilot Study. , 2009, Infancy : the official journal of the International Society on Infant Studies.

[116]  Roger Bakeman,et al.  Time-window sequential analysis: an introduction for pediatric psychologists. , 2010, Journal of pediatric psychology.

[117]  G. Walford,et al.  The SAGE Handbook of Measurement , 2010 .

[118]  Robert Kozma,et al.  Data-driven automated acoustic analysis of human infant vocalizations using neural network tools. , 2010, The Journal of the Acoustical Society of America.

[119]  R. Bakeman,et al.  The link between alcohol use and aggression toward sexual minorities: an event-based analysis. , 2010, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[120]  Paul J. Yoder,et al.  Observational Measurement of Behavior , 2010 .

[121]  J. Cohn,et al.  Spontaneous facial expression in a small group can be automatically measured: An initial demonstration , 2010, Behavior research methods.

[122]  Eugene S. Edgington,et al.  Randomization Tests , 2011, International Encyclopedia of Statistical Science.