Development of a Human Activity Recognition System for Ballet Tasks

Background Accurate and detailed measurement of a dancer’s training volume is a key requirement to understanding the relationship between a dancer’s pain and training volume. Currently, no system capable of quantifying a dancer’s training volume, with respect to specific movement activities, exists. The application of machine learning models to wearable sensor data for human activity recognition in sport has previously been applied to cricket, tennis and rugby. Thus, the purpose of this study was to develop a human activity recognition system using wearable sensor data to accurately identify key ballet movements (jumping and lifting the leg). Our primary objective was to determine if machine learning can accurately identify key ballet movements during dance training. The secondary objective was to determine the influence of the location and number of sensors on accuracy. Results Convolutional neural networks were applied to develop two models for every combination of six sensors (6, 5, 4, 3, etc.) with and without the inclusion of transition movements. At the first level of classification, including data from all sensors, without transitions, the model performed with 97.8% accuracy. The degree of accuracy reduced at the second (83.0%) and third (75.1%) levels of classification. The degree of accuracy reduced with inclusion of transitions, reduction in the number of sensors and various sensor combinations. Conclusion The models developed were robust enough to identify jumping and leg lifting tasks in real-world exposures in dancers. The system provides a novel method for measuring dancer training volume through quantification of specific movement tasks. Such a system can be used to further understand the relationship between dancers’ pain and training volume and for athlete monitoring systems. Further, this provides a proof of concept which can be easily translated to other lower limb dominant sporting activities

[1]  A. S. Ferreira,et al.  Characteristics and prevalence of musculoskeletal injury in professional and non-professional ballet dancers , 2016, Brazilian journal of physical therapy.

[2]  Shona L. Halson,et al.  Monitoring Training Load to Understand Fatigue in Athletes , 2014, Sports Medicine.

[3]  J. L. Whittaker,et al.  Risk factors for musculoskeletal injury in preprofessional dancers: a systematic review , 2015, British Journal of Sports Medicine.

[4]  Tim J Gabbett,et al.  The Use of Wearable Microsensors to Quantify Sport-Specific Movements , 2015, Sports Medicine.

[5]  Hsing-Hsan Lee,et al.  Changes in biomechanics and muscle activation in injured ballet dancers during a jump-land task with turnout (Sissonne Fermée) , 2012, Journal of sports sciences.

[6]  M. Wyon,et al.  The Demands of a Working Day among Female Professional Ballet Dancers , 2010, Journal of dance medicine & science : official publication of the International Association for Dance Medicine & Science.

[7]  David Whiteside,et al.  Monitoring Hitting Load in Tennis Using Inertial Sensors and Machine Learning. , 2017, International journal of sports physiology and performance.

[8]  Wayne Spratford,et al.  A simple method for quantifying jump loads in volleyball athletes. , 2017, Journal of science and medicine in sport.

[9]  Salima Benbernou,et al.  A survey on service quality description , 2013, CSUR.

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  J. Cassidy,et al.  Clinical Examination and Ultrasound of Self-Reported Snapping Hip Syndrome in Elite Ballet Dancers , 2007, The American journal of sports medicine.

[13]  B. Jones,et al.  Validity of Daily and Weekly Self-Reported Training Load Measures in Adolescent Athletes , 2017, Journal of strength and conditioning research.

[14]  J Brown,et al.  Overuse Injuries in Classical Ballet , 1995, Sports medicine.

[15]  Evangelos Pappas,et al.  Comparison of Landing Biomechanics Between Male and Female Professional Dancers , 2009, The American journal of sports medicine.

[16]  Julius Hannink,et al.  Activity recognition in beach volleyball using a Deep Convolutional Neural Network , 2017, Data Mining and Knowledge Discovery.

[17]  Tim J Gabbett,et al.  The validity of microsensors to automatically detect bowling events and counts in cricket fast bowlers. , 2015, International journal of sports physiology and performance.

[18]  Shaw Bronner,et al.  Differences in Segmental Coordination and Postural Control in a Multi-joint Dance Movement Développé Arabesque , 2012, Journal of dance medicine & science : official publication of the International Association for Dance Medicine & Science.

[19]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.

[20]  Tim J Gabbett,et al.  The training—injury prevention paradox: should athletes be training smarter and harder? , 2016, British Journal of Sports Medicine.

[21]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[22]  Karl F Orishimo,et al.  Comparison of Landing Biomechanics Between Male and Female Dancers and Athletes, Part 1 , 2014, The American journal of sports medicine.

[23]  Joyce R. Maring,et al.  Injury patterns in elite preprofessional ballet dancers and the utility of screening programs to identify risk characteristics. , 2008, The Journal of orthopaedic and sports physical therapy.

[24]  Weng-Keen Wong,et al.  Machine learning for activity recognition: hip versus wrist data , 2014, Physiological measurement.

[25]  S. Byhring,et al.  Musculoskeletal injuries in the Norwegian National Ballet: a prospective cohort study , 2002, Scandinavian journal of medicine & science in sports.

[26]  Roald Bahr,et al.  Validation of an inertial measurement unit for the measurement of jump count and height. , 2017, Physical therapy in sport : official journal of the Association of Chartered Physiotherapists in Sports Medicine.

[27]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[28]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[29]  N. O'dwyer,et al.  An Exploration of the Perception of Dance and Its Relation to Biomechanical Motion , 2016, Journal of dance medicine & science : official publication of the International Association for Dance Medicine & Science.

[30]  K. Kulig,et al.  Dancers with patellar tendinopathy exhibit higher vertical and braking ground reaction forces during landing , 2012, Journal of sports sciences.

[31]  Gunnar Hartvigsen,et al.  Using Fitness Trackers and Smartwatches to Measure Physical Activity in Research: Analysis of Consumer Wrist-Worn Wearables , 2018, Journal of medical Internet research.

[32]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[33]  Sam Robertson,et al.  Machine and deep learning for sport-specific movement recognition: a systematic review of model development and performance , 2018, Journal of sports sciences.

[34]  Ritu Gupta,et al.  Classification of team sport activities using a single wearable tracking device. , 2015, Journal of biomechanics.

[35]  Tim J Gabbett,et al.  Wearable microtechnology can accurately identify collision events during professional rugby league match-play. , 2017, Journal of science and medicine in sport.

[36]  Michael Spittle,et al.  Tackle and impact detection in elite Australian football using wearable microsensor technology , 2014, Journal of sports sciences.

[37]  Shaw Bronner,et al.  Pelvis and Hip Three-Dimensional Kinematics in Grand Battement Movements , 2011, Journal of dance medicine & science : official publication of the International Association for Dance Medicine & Science.