A Feature Importance Study in Ballet Pose Recognition with OpenPose

Movements of the human body can finally be recognised and analysed using computer vision technology. Ballet is an activity that involves various movements and specific poses of the body, making it an attractive candidate for computer vision applications. This paper proposes a feature importance study for determining which body parts play the most significant role in ballet pose recognition. The study is based on the use of OpenPose for feature extraction together with Support Vector Machine, Random Forest and Gradient Boosted Tree classifiers. Recognition accuracies above 95% suggest that the methods are not only feasible but exhibit excellent results. The results also indicate that the body parts that were the most significant for the classification of ballet poses were those situated at the extremities of the body such as the wrists and feet. The study addresses challenges within the ballet domain as it relates to both training and choreography. Furthermore, the study confirms that as technology expands into all areas of life, it is worthwhile to explore the possibilities within artistic fields.

[1]  S. Bronner,et al.  Occupational Musculoskeletal Disorders in Dancers , 2003 .

[2]  Hani Hagras,et al.  A fuzzy logic-based system for the automation of human behavior recognition using machine vision in intelligent environments , 2015, Soft Comput..

[3]  Scott Speck,et al.  Ballet For Dummies , 2003 .

[4]  Francesco Cafaro,et al.  E-ballet: designing for remote ballet learning , 2016, UbiComp Adjunct.

[5]  Sriparna Saha,et al.  Topomorphological approach to automatic posture recognition in ballet dance , 2015, IET Image Process..

[6]  Bor-Chen Kuo,et al.  A Kernel-Based Feature Selection Method for SVM With RBF Kernel for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Catherine J. Johnson,et al.  Securing Our Dance Heritage: Issues in the Documentation and Preservation of Dance. , 1999 .

[8]  Amy LaViers,et al.  Automatic Sequencing of Ballet Poses , 2011, IEEE Robotics & Automation Magazine.

[9]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[10]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Christa Lee,et al.  Ballet hero: building a garment for memetic embodiment in dance learning , 2014, ISWC '14 Adjunct.

[12]  Betim Çiço,et al.  Computer vision approaches based on deep learning and neural networks: Deep neural networks for video analysis of human pose estimation , 2017, 2017 6th Mediterranean Conference on Embedded Computing (MECO).

[13]  Dustin van der Haar,et al.  Computer Vision for the Ballet Industry: A Comparative Study of Methods for Pose Recognition , 2020, BIS.

[14]  Vassilios Morellas,et al.  Recognition of ballet micro-movements for use in choreography , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.