Dance motion generation by recombination of body parts from motion source

In this paper, we propose an approach to synthesize new dance routines by combining body part motions from a human motion database. The proposed approach aims to provide a movement source to allow robots or animation characters to perform improvised dances to music, and also to inspire choreographers with the provided movements. Based on the observation that some body parts perform more appropriately than other body parts during dance performances, a correlation analysis of music and motion is conducted to identify the expressive body parts. We then combine the body part movement sources to create a new motion, which differs from all sources in the database. The generated performances are evaluated by a user questionnaire assessment, and the results are discussed to understand what is important in generating more appealing dance routines.

[1]  Lorenzo Torresani,et al.  Learning Motion Style Synthesis from Perceptual Observations , 2006, NIPS.

[2]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Reid G. Simmons,et al.  Laban head-motions convey robot state: A call for robot body language , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Jonathan Foote,et al.  Visualizing music and audio using self-similarity , 1999, MULTIMEDIA '99.

[5]  Ryohei Nakatsu,et al.  Dance Motion Control of a Humanoid Robot Based on Real-Time Tempo Tracking from Musical Audio Signals , 2009, ICEC.

[6]  G. H. Wakefield,et al.  To catch a chorus: using chroma-based representations for audio thumbnailing , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[7]  Embodied metre: hierarchical eigenmodes in spontaneous movement to music , 2009, Cognitive Processing.

[8]  Ann Hutchinson Guest.  Labanotation: The System of Analyzing and Recording Movement , 1987 .

[9]  Jonathan Foote,et al.  Automatic audio segmentation using a measure of audio novelty , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[10]  Donna Krasnow,et al.  Development of the "performance competence evaluation measure": assessing qualitative aspects of dance performance. , 2009, Journal of dance medicine & science : official publication of the International Association for Dance Medicine & Science.

[11]  Nikos A. Vlassis,et al.  The global k-means clustering algorithm , 2003, Pattern Recognit..

[12]  Youngmoo E. Kim,et al.  Creating an autonomous dancing robot , 2009, ICHIT '09.

[13]  Minho Lee,et al.  Music similarity-based approach to generating dance motion sequence , 2012, Multimedia Tools and Applications.

[14]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.