Automated video analysis of interpersonal entrainment in Indian music performance

Interpersonal entrainment is an important and underexplored feature of musical performance. Better understanding of this phenomenon has important implications for musicology and for the understanding of joint action and coordination from a psychological perspective, and is likely also to be applicable in entertainment, educational, and therapeutic contexts. In order to achieve this, new methods of investigation are needed through which entrainment can be investigated in ecological contexts, keeping time-consuming manual intervention to a minimum. Preliminary research results are presented here on a system for the automated analysis of entrainment, and leadership from video recordings of performances of Indian music. The system is based on the EyesWeb XMI open software platform. The context and aims of the research are discussed along with an analysis of entrainment on the basis of head movements tracked on a video recording.

[1]  G. Luck,et al.  Ensemble Musicians’ Synchronization With Conductors’ Gestures: An Automated Feature-Extraction Analysis , 2006 .

[2]  Byron Dueck,et al.  Experience and Meaning in Music Performance , 2013 .

[3]  W. S. Condon,et al.  SOUND FILM ANALYSIS OF NORMAL AND PATHOLOGICAL BEHAVIOR PATTERNS , 1966, The Journal of nervous and mental disease.

[4]  Michael J. Richardson,et al.  Social Connection Through Joint Action and Interpersonal Coordination , 2009, Top. Cogn. Sci..

[5]  Martin Clayton,et al.  Inter-group entrainment in Afro-Brazilian Congado ritual , 2011 .

[6]  Mark Doffman,et al.  Making It Groove! Entrainment, Participation and Discrepancy in the 'Conversation' of a Jazz Trio , 2009 .

[7]  Antonio Camurri,et al.  Multimodal Analysis of Expressive Gesture in Music and Dance Performances , 2003, Gesture Workshop.

[8]  Udo Will,et al.  Pulse and Entrainment to Non-Isochronous Auditory Stimuli: The Case of North Indian Alap , 2015, PloS one.

[9]  Michael J. Richardson,et al.  Effects of visual and verbal interaction on unintentional interpersonal coordination. , 2005, Journal of experimental psychology. Human perception and performance.

[10]  P. McClintock.  Synchronization:a universal concept in nonlinear science , 2003 .

[11]  M. Clayton,et al.  Observing entrainment in music performance: Video-based observational analysis of Indian musicians' tanpura playing and beat marking , 2007 .

[12]  Marc Leman,et al.  Communicating expressiveness and affect in multimodal interactive systems , 2005, IEEE MultiMedia.

[13]  Rodrigo Quian Quiroga,et al.  Nonlinear multivariate analysis of neurophysiological signals , 2005, Progress in Neurobiology.

[14]  R. Schmidt,et al.  Evaluating the Dynamics of Unintended Interpersonal Coordination , 1997 .

[15]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[16]  P. Keller,et al.  Individual Differences, Auditory Imagery, and the Coordination of Body Movements and Sounds in Musical Ensembles , 2010 .

[17]  Isabel Dziobek,et al.  Moving in and out of synchrony: A concept for a new intervention fostering empathy through interactional movement and dance , 2012 .

[18]  Martin Clayton,et al.  Time in Indian Music: Rhythm, Metre, and Form in North Indian Rag Performance , 2008 .

[19]  Adrian Ian Poole,et al.  Groove in Cuban Dance Music: An Analysis of Son and Salsa , 2013 .

[20]  Charles Keil,et al.  Participatory Discrepancies and the Power of Music , 1987 .

[21]  Marc Leman,et al.  DanSync: A Platform to Study Entrainment and Joint-Action during Spontaneous Dance in the Context of a Social Music Game , 2013, INTETAIN.

[22]  I. Cross,et al.  Long-term musical group interaction has a positive influence on empathy in children , 2013 .

[23]  Udo Will,et al.  The concept of entrainment and its significance for ethnomusicology , 2004 .

[24]  M. Thaut,et al.  Neurobiological foundations of neurologic music therapy: rhythmic entrainment and the motor system , 2015, Front. Psychol..

[25]  Antonio Camurri,et al.  A System for Real-Time Multimodal Analysis of Nonverbal Affective Social Interaction in User-Centric Media , 2010, IEEE Transactions on Multimedia.

[26]  John Rink,et al.  Musical Performance: A Guide to Understanding , 2002 .