Analysis of Movement Quality in Full-Body Physical Activities

Full-body human movement is characterized by fine-grain expressive qualities that humans are easily capable of exhibiting and recognizing in others’ movement. In sports (e.g., martial arts) and performing arts (e.g., dance), the same sequence of movements can be performed in a wide range of ways characterized by different qualities, often in terms of subtle (spatial and temporal) perturbations of the movement. Even a non-expert observer can distinguish between a top-level and average performance by a dancer or martial artist. The difference is not in the performed movements--the same in both cases--but in the “quality” of their performance. In this article, we present a computational framework aimed at an automated approximate measure of movement quality in full-body physical activities. Starting from motion capture data, the framework computes low-level (e.g., a limb velocity) and high-level (e.g., synchronization between different limbs) movement features. Then, this vector of features is integrated to compute a value aimed at providing a quantitative assessment of movement quality approximating the evaluation that an external expert observer would give of the same sequence of movements. Next, a system representing a concrete implementation of the framework is proposed. Karate is adopted as a testbed. We selected two different katas (i.e., detailed choreographies of movements in karate) characterized by different overall attitudes and expressions (aggressiveness, meditation), and we asked seven athletes, having various levels of experience and age, to perform them. Motion capture data were collected from the performances and were analyzed with the system. The results of the automated analysis were compared with the scores given by 14 karate experts who rated the same performances. Results show that the movement-quality scores computed by the system and the ratings given by the human observers are highly correlated (Pearson’s correlations r = 0.84, p = 0.001 and r = 0.75, p = 0.005).

[1]  Giovanni De Poli,et al.  Score-Independent Audio Features for Description of Music Expression , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  Ling Guan,et al.  A Machine Intelligence Approach to Virtual Ballet Training , 2015, IEEE MultiMedia.

[3]  Radoslaw Niewiadomski,et al.  The Dancer in the Eye: Towards a Multi-Layered Computational Framework of Qualities in Movement , 2016, MOCO.

[4]  Antonio Camurri,et al.  Multimodal Analysis of Expressive Gesture in Music and Dance Performances , 2003, Gesture Workshop.

[5]  Hartmut Riehle,et al.  MOVEMENT QUALITY OF MARTIAL ART OUTSIDE KICKS , 2008 .

[6]  Martin Hofmann,et al.  ACCELERATION COURSE OF FIST PUSH OF GYAKU-ZUKI , 2008 .

[7]  Marcelo M. Wanderley,et al.  Music and Motion: How Music-Related Ancillary Body Movements Contribute to the Experience of Music , 2009 .

[8]  R Quian Quiroga,et al.  Event synchronization: a simple and fast method to measure synchronicity and time delay patterns. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Andrew Kennedy,et al.  Estimating Gesture Accuracy in Motion-Based Health Games , 2014, J. Virtual Real. Broadcast..

[10]  Martin A. Giese,et al.  Estimation of Skill Levels in Sports Based on Hierarchical Spatio-Temporal Correspondences , 2003, DAGM-Symposium.

[11]  Radoslaw Niewiadomski,et al.  A multimodal dataset for the analysis of movement qualities in karate martial art , 2015, 2015 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN).

[12]  E Stüssi.  [Biomechanics in sports]. , 1989, Schweizerische Rundschau fur Medizin Praxis = Revue suisse de medecine Praxis.

[13]  Iván Gómez-Conde,et al.  Automatic recognition and scoring of olympic rhythmic gymnastic movements. , 2014, Human movement science.

[14]  Radoslaw Niewiadomski,et al.  Movement Fluidity Analysis Based on Performance and Perception , 2016, CHI Extended Abstracts.

[15]  M. Picheny,et al.  Comparison of Parametric Representation for Monosyllabic Word Recognition in Continuously Spoken Sentences , 2017 .

[16]  Noel E. O'Connor,et al.  Evaluating a dancer's performance using kinect-based skeleton tracking , 2011, ACM Multimedia.

[17]  Radoslaw Niewiadomski,et al.  Using the Audio Respiration Signal for Multimodal Discrimination of Expressive Movement Qualities , 2016, HBU.

[18]  Radoslaw Niewiadomski,et al.  A system to support the learning of movement qualities in dance: a case study on dynamic symmetry , 2016, UbiComp Adjunct.

[19]  P. Viviani,et al.  A developmental study of the relationship between geometry and kinematics in drawing movements. , 1991, Journal of experimental psychology. Human perception and performance.

[20]  Francesco Tisato,et al.  Karate moves recognition from skeletal motion , 2013, Electronic Imaging.

[21]  Martin Hofmann,et al.  BIOMECHANICAL ANALYSIS OF FIST PUNCH GYAKU-ZUKI IN KARATE , 2008 .

[22]  Zheng Fang,et al.  Comparison of different implementations of MFCC , 2001 .

[23]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[24]  张国亮,et al.  Comparison of Different Implementations of MFCC , 2001 .

[25]  Kerstin Witte,et al.  VIZUALIZIRANI KRETNI OBRASCI I NJIHOVA ANALIZA ZA KLASIFIKACIJU SLIČNOSTI – PREDSTAVLJENO NA PRIMJERU KARATE UDARCA MAE GERI , 2012 .

[26]  Nikolaos Grammalidis,et al.  Multi-sensor Technology and Fuzzy Logic for Dancer's Motion Analysis and Performance Evaluation within a 3D Virtual Environment , 2014, HCI.

[27]  Wyatt Page,et al.  Fusion motion capture: A prototype system using inertial measurement units and GPS for the biomechanical analysis of ski racing , 2008 .

[28]  Radoslaw Niewiadomski,et al.  Automated Detection of Impulsive Movements in HCI , 2015, CHItaly.

[29]  Kerstin Witte,et al.  VISUALIZED MOVEMENT PATTERNS AND THEIR ANALYSIS TO CLASSIFY SIMILARITIES – DEMONSTRATED BY THE KARATE , 2012 .

[30]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Wojciech J. Cynarski,et al.  Improving the movements of basic karate techniques with the use of motion capture and mathematical modeling. The concept of a research project , 2014 .

[32]  Julien Favre,et al.  A wearable system to assess risk for anterior cruciate ligament injury during jump landing: measurements of temporal events, jump height, and sagittal plane kinematics. , 2011, Journal of biomechanical engineering.

[33]  Anton Nijholt,et al.  Movement-Based Sports Video Games: Investigating Motivation and Gaming Experience , 2009, Entertain. Comput..