Quantifying Joint Activities using Cross-Recurrence Block Representation

Humans, as social beings, are capable of employing various behavioral cues, such as gaze, speech, manual action, and body posture, in everyday communication. However, to extract finegrained interaction patterns in social contexts has been presented with methodological challenges. Cross-Recurrence Plot Quantification Analysis (CRQA) is an analysis method invented in theoretical physics and recently applied to cognitive science to study interpersonal coordination. In this paper, we extend this approach to analyzing joint activities in child-parent interaction. We define a new representation as Cross Recurrence Block based on CRQA. With this representation, we are able to capture interpersonal dynamics from more than two behavioral streams in one Cross Recurrence Plot and derive a suite of measures to quantify detailed characteristics of coordination. Using a dataset collected from a child-parent interaction study, we show that these quantitative measures of joint activities reveal developmental changes in coordinative behavioral patterns between children and parents.

[1]  Linda B. Smith,et al.  Joint Attention without Gaze Following: Human Infants and Their Parents Coordinate Visual Attention to Objects through Eye-Hand Coordination , 2013, PloS one.

[2]  A. Giuliani,et al.  Detecting deterministic signals in exceptionally noisy environments using cross-recurrence quantification , 1998 .

[3]  Chen Yu,et al.  Embodied attention and word learning by toddlers , 2012, Cognition.

[4]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[5]  Riccardo Fusaroli,et al.  Analyzing Social Interactions: The Promises and Challenges of Using Cross Recurrence Quantification Analysis , 2014 .

[6]  Daniel C. Richardson,et al.  Nominal Cross Recurrence as a Generalized Lag Sequential Analysis for Behavioral Streams , 2011, Int. J. Bifurc. Chaos.

[7]  Rick Dale,et al.  Behavior Matching in Multimodal Communication Is Synchronized , 2012, Cogn. Sci..

[8]  Daniel C. Richardson,et al.  Looking To Understand: The Coupling Between Speakers' and Listeners' Eye Movements and Its Relationship to Discourse Comprehension , 2005, Cogn. Sci..

[9]  R. Andrzejak,et al.  Cross recurrence quantification for cover song identification , 2009 .

[10]  Riccardo Fusaroli,et al.  Investigating Conversational Dynamics: Interactive Alignment, Interpersonal Synergy, and Collective Task Performance , 2016, Cogn. Sci..

[11]  M. Kimmel,et al.  Intersubjectivity at Close Quarters: How Dancers of Tango Argentino Use Imagery for Interaction and Improvisation , 2009 .

[12]  Jonathan Foote,et al.  Automatic Music Summarization via Similarity Analysis , 2002, ISMIR.

[13]  Janet Wiles,et al.  Conceptual Recurrence Plots: Revealing Patterns in Human Discourse , 2012, IEEE Transactions on Visualization and Computer Graphics.

[14]  Alan Kingstone,et al.  Recurrence quantification analysis of eye movements , 2013, Behavior Research Methods.

[15]  Kevin Shockley,et al.  Interpersonal Synergies , 2010, Front. Psychology.

[16]  A. Kendon.  Movement coordination in social interaction: some examples described. , 1970, Acta psychologica.

[17]  Rossella Pozzi,et al.  Recurrence quantification analysis for time serie , 2017 .