An Automatic Framework For Generating Labanotation Scores From Continuous Motion Capture Data

Labanotation is a widely used dance notation system. The topic of generating Labanotation scores from captured dance motion data has attracted more research interest in recent years. Current methods usually generate Laban symbols via recognizing motion segments that each contains a single dance movement. However, they rely on the manual segmentation of raw dance motion sequences, which can cost a lot of time and effort. In this paper, we present a fully automatic framework to generate Labanotation scores from continuous motion data. First, we split the captured dance data to motion segments based on the Laban theory of body weight support transferring. Then, based on the segmented data, we utilize a network with both 1D-convolutional and recurrent layers to recognize body movements and generate Laban symbols. As such, the Labanotation score is created. Extensive experiments show that the proposed automatic framework performs favorably against previous solutions.

[1]  Zhenjiang Miao,et al.  A system for automatic generation of labanotation from motion capture data , 2016, 2016 IEEE 13th International Conference on Signal Processing (ICSP).

[2]  Andrea Mapelli,et al.  Validation of a protocol for the estimation of three-dimensional body center of mass kinematics in sport. , 2014, Gait & posture.

[3]  Zhenjiang Miao,et al.  Automatic Labanotation Generation from Motion-Captured Data Based on Hidden Markov Models , 2017, 2017 4th IAPR Asian Conference on Pattern Recognition (ACPR).

[4]  Zhenjiang Miao,et al.  A method of automatically generating Labanotation from human motion capture data , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[5]  Worawat Choensawat,et al.  Applications for Recording and Generating Human Body Motion with Labanotation , 2014, Dance Notations and Robot Motion.

[6]  Zhenjiang Miao,et al.  Automatic Labanotation Generation Based on Human Motion Capture Data , 2014, CCPR.

[7]  Jiaji Wang,et al.  Labanotation Generation Based on Bidirectional Gated Recurrent Units with Joint and Line Features , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[8]  David A. Winter,et al.  Biomechanics and Motor Control of Human Movement , 1990 .

[9]  Jernej Barbic,et al.  Segmenting Motion Capture Data into Distinct Behaviors , 2004, Graphics Interface.

[10]  Qiang Zhang,et al.  Automatic Generation of Labanotation Based On Extreme Learning Machine with Skeleton Topology Feature , 2018, 2018 14th IEEE International Conference on Signal Processing (ICSP).

[11]  Kozaburo Hachimura,et al.  Method of generating coded description of human body motion from motion-captured data , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[12]  Gang Qian,et al.  An Autonomous Dance Scoring System Using Marker-based Motion Capture , 2005, 2005 IEEE 7th Workshop on Multimedia Signal Processing.

[13]  Xiaonan Yang,et al.  An Efficient Method for Automatic Generation of Labanotation Based on Bi-Directional LSTM , 2019 .

[14]  Ann Hutchinson Guest Labanotation: The System of Analyzing and Recording Movement , 1987 .

[15]  J. van der Meulen,et al.  Investigating the use of lower body and trunk kinematic data to calculate a clinically useful measure of centre of mass during gait , 2014 .

[16]  Min Li,et al.  Dance Movement Learning for Labanotation Generation Based on Motion-Captured Data , 2019, IEEE Access.