Dynamic dance warping: Using dynamic time warping to compare dance movement performed under different conditions

Dynamic time warping (DTW) is proposed as a technique to assess the difference between two dance performances in terms of timing and to provide further insight into dancer cognition. The DTW method is validated for use with dance performance motion tracking data by comparing its results with 'ground truth' results obtained from a comparison between videos of two motion tracked performances. The technique was extended to investigate two hypothesised processes that affect movement timing-scaling (a fixed ratio alteration) and lapsing (caused by insertion or deletion of movement material). As an example of the use of the technique, an ensemble contemporary dance work was performed with the motion of one of three dancers captured in two conditions - with no music (NM) and with music (WM) - with one repeat of the two conditions. The application of the DTW-based algorithm demonstrates that lapses explained much of the timing mismatch (9.6 out of 14 seconds), with a small proportion explained by scaling (a ratio of 0.976) consistent with previous research. However, after again performing the dance under NM and WM conditions the DTW technique demonstrated a non-trivial contribution of scaling in explaining time differences across the various combinations of conditions. In these comparisons, scaling cannot be eliminated as a possible underlying factor of timing error, and it may be that correct scaling (aiming for a ratio of 1) must be learned via practice.

[1]  Trimmed mean or sample median , 1994 .

[2]  C. Stevens,et al.  The relationship between lapsing and scaling: Explaining timing variations in a contemporary dance performance , 2010 .

[3]  Van Nostrand,et al.  Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm , 1967 .

[4]  Antonio Camurri,et al.  Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques , 2003, Int. J. Hum. Comput. Stud..

[5]  Catherine J. Stevens,et al.  Cognition and the temporal arts: Investigating audience response to dance using PDAs that record continuous data during live performance , 2009, Int. J. Hum. Comput. Stud..

[6]  Gerhard Widmer,et al.  MATCH: A Music Alignment Tool Chest , 2005, ISMIR.

[7]  P. Keller,et al.  Searching for Roots of Entrainment and Joint Action in Early Musical Interactions , 2012, Front. Hum. Neurosci..

[8]  Jeff H. Duyn,et al.  Cortical Systems Associated with Covert Music Rehearsal , 2002, NeuroImage.

[9]  Catherine J. Stevens,et al.  Moving with and without music : scaling and lapsing in time in the performance of contemporary dance , 2009 .

[10]  Daniel P. W. Ellis,et al.  Ground-truth transcriptions of real music from force-aligned MIDI syntheses , 2003, ISMIR.

[11]  D. E. Glaser,et al.  Towards a sensorimotor aesthetics of performing art , 2008, Consciousness and Cognition.

[12]  Eamonn J. Keogh,et al.  Scaling and time warping in time series querying , 2005, The VLDB Journal.

[13]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[14]  B H Repp,et al.  Acoustics, perception, and production of legato articulation on a digital piano. , 1995, The Journal of the Acoustical Society of America.