Wearables, Biomechanical Feedback, and Human Motor-Skills’ Learning & Optimization

Biomechanical feedback is a relevant key to improving sports and arts performance. Yet, the bibliometric keyword analysis on Web of Science publications reveals that, when comparing to other biofeedback applications, the real-time biomechanical feedback application lags far behind in sports and arts practice. While real-time physiological and biochemical biofeedback have seen routine applications, the use of real-time biomechanical feedback in motor learning and training is still rare. On that account, the paper aims to extract the specific research areas, such as three-dimensional (3D) motion capture, anthropometry, biomechanical modeling, sensing technology, and artificial intelligent (AI)/deep learning, which could contribute to the development of the real-time biomechanical feedback system. The review summarizes the past and current state of biomechanical feedback studies in sports and arts performance; and, by integrating the results of the studies with the contemporary wearable technology, proposes a two-chain body model monitoring using six IMUs (inertial measurement unit) with deep learning technology. The framework can serve as a basis for a breakthrough in the development. The review indicates that the vital step in the development is to establish a massive data, which could be obtained by using the synchronized measurement of 3D motion capture and IMUs, and that should cover diverse sports and arts skills. As such, wearables powered by deep learning models trained by the massive and diverse datasets can supply a feasible, reliable, and practical biomechanical feedback for athletic and artistic training.

[1]  Brian Caulfield,et al.  A Wearable Sensor-Based Exercise Biofeedback System: Mixed Methods Evaluation of Formulift , 2018, JMIR mHealth and uHealth.

[2]  Xiang Zhang,et al.  From 2D leg kinematics to 3D full-body biomechanics-the past, present and future of scientific analysis of maximal instep kick in soccer , 2011, Sports medicine, arthroscopy, rehabilitation, therapy & technology : SMARTT.

[3]  David R Mullineaux,et al.  Real-time biomechanical biofeedback effects on top-level rifle shooters. , 2012, Applied ergonomics.

[4]  Xiang Zhang,et al.  Biomechanics of coaching maximal instep soccer kick for practitioners , 2018, Interdisciplinary Science Reviews.

[5]  Gongbing Shan,et al.  Anthropometrical data and coefficients of regression related to gender and race. , 2003, Applied ergonomics.

[6]  Ang Chen,et al.  Goals, Interests, and Learning in Physical Education , 2004 .

[7]  Constanze Loschner,et al.  Biomechanics feedback for rowing , 2002, Journal of sports sciences.

[8]  David V. Thiel,et al.  An integrated swimming monitoring system for the biomechanical analysis of swimming strokes , 2011 .

[9]  Silvana Markovska-Simoska,et al.  Simultaneous EEG and EMG biofeedback for peak performance in musicians. , 2008, Prilozi.

[10]  Gongbing Shan,et al.  A method to determine the interdependent relationships between biomechanical variables in artificial neural network models: the case of lower extremity muscle activity and body sway , 2004, Neurocomputing.

[11]  Ross Anderson,et al.  Accelerometry-based feedback--can it improve movement consistency and performance in rowing? , 2005, Sports biomechanics.

[12]  D. Vernon Can Neurofeedback Training Enhance Performance? An Evaluation of the Evidence with Implications for Future Research , 2005, Applied psychophysiology and biofeedback.

[13]  Jason Heikenfeld,et al.  Bioanalytical devices: Technological leap for sweat sensing , 2016, Nature.

[14]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[15]  Davide Cattaneo,et al.  Concepts of Motor Learning Applied to a Rehabilitation Protocol Using Biofeedback to Improve Gait in a Chronic Stroke Patient: An A-B System Study With Multiple Gait Analyses , 2007, Neurorehabilitation and neural repair.

[16]  George K. Karagiannidis,et al.  Efficient Machine Learning for Big Data: A Review , 2015, Big Data Res..

[17]  Gregory J. Pottie,et al.  Integrated Inertial Sensors and Mobile Computing for Real-Time Cycling Performance Guidance via Pedaling Profile Classification , 2015, IEEE Journal of Biomedical and Health Informatics.

[18]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[19]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[20]  Steven J. Petruzzello,et al.  Biofeedback and sport/exercise performance: Applications and limitations , 1991 .

[21]  Angelo M. Sabatini,et al.  A Novel Kalman Filter for Human Motion Tracking With an Inertial-Based Dynamic Inclinometer , 2015, IEEE Transactions on Biomedical Engineering.

[22]  E. Radin Role of muscles in protecting athletes from injury. , 2009, Acta medica Scandinavica. Supplementum.

[23]  J. Gruzelier,et al.  Biofeedback and Dance Performance: A Preliminary Investigation , 2005, Applied psychophysiology and biofeedback.

[24]  Timothy D. Lee,et al.  Motor Learning and Performance: From Principles to Application , 2013 .

[25]  Jared Evans,et al.  An innovative approach for real time determination of power and reaction time in a martial arts quasi- training environment using 3D motion capture and EMG measurements , 2011 .

[26]  Gongbing Shan,et al.  Informing music teaching and learning using movement analysis technology , 2008 .

[27]  Christina Bohn,et al.  WIE KANN DIE DYNAMISCHE FESTKÖRPER-MODELLIERUNG BEIM MOTORISCHEN LERNEN BEHILFLICH SEIN?- LEISTUNGSDIAGNOSE MIT HILFE DER DYNAMISCHEN MODELLLIERUNG , 2004 .

[28]  Hua Li,et al.  A wireless sensor system for a biofeedback training of hammer throwers , 2016, SpringerPlus.

[29]  Kunlin Wei,et al.  Behavioral tracking gets real , 2018, Nature Neuroscience.

[30]  Gongbing Shan,et al.  A Pilot Study on the Efficacy of Line-of-Sight Gestural Compensation While Conducting Music , 2010, Perceptual and motor skills.

[31]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[32]  Heike Brock,et al.  Assessing Motion Style Errors in Ski Jumping Using Inertial Sensor Devices , 2017, IEEE Sensors Journal.

[33]  Gongbing Shan,et al.  Impact of Exercise on Seniors' Motor Control Response to External Dynamics , 2008, Research in sports medicine.

[34]  Tim J Gabbett,et al.  The Use of Wearable Microsensors to Quantify Sport-Specific Movements , 2015, Sports Medicine.

[35]  Yoshua Bengio,et al.  On the Expressive Power of Deep Architectures , 2011, ALT.

[36]  Hans-Gerd Ridder The theory contribution of case study research designs , 2017 .

[37]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[38]  Gongbing Shan,et al.  Artificial neural networks and center-of-pressure modeling: a practical method for sensorimotor-degradation assessment. , 2004, Journal of aging and physical activity.

[39]  Oonagh M. Giggins,et al.  Biofeedback in rehabilitation , 2013, Journal of NeuroEngineering and Rehabilitation.

[40]  Kate Button,et al.  Inertial Measurement Units for Clinical Movement Analysis: Reliability and Concurrent Validity , 2018, Sensors.

[41]  Amay J Bandodkar,et al.  Non-invasive wearable electrochemical sensors: a review. , 2014, Trends in biotechnology.

[42]  X Zhang,et al.  Where do golf driver swings go wrong? Factors influencing driver swing consistency , 2014, Scandinavian journal of medicine & science in sports.

[43]  Carlos D. Castillo,et al.  Deep Learning for Understanding Faces: Machines May Be Just as Good, or Better, than Humans , 2018, IEEE Signal Processing Magazine.

[44]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.

[45]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[46]  Gongbing Shan,et al.  The Influence of X-Factor (Trunk Rotation) and Experience on the Quality of the Badminton Forehand Smash , 2016, Journal of human kinetics.

[47]  Kamiar Aminian,et al.  Capturing human motion using body‐fixed sensors: outdoor measurement and clinical applications , 2004, Comput. Animat. Virtual Worlds.

[48]  Wiebren Zijlstra,et al.  Biofeedback for training balance and mobility tasks in older populations: a systematic review , 2010, Journal of NeuroEngineering and Rehabilitation.

[49]  Steven J. Petruzzello,et al.  Effects of learning on electroencephalographic and electrocardiographic patterns in novice archers. , 1994 .

[50]  Gongbing Shan,et al.  HOW CAN DYNAMIC RIGID-BODY MODELING BE HELPFUL IN MOTOR LEARNING ? – LEARNING PERFORMANCE THROUGH DYNAMIC MODELING , 2005 .

[51]  Gongbing Shan,et al.  Unraveling mysteries of personal performance style; biomechanics of left-hand position changes (shifting) in violin performance , 2015, PeerJ.

[52]  Lichi Sun Real-time sonification of muscle tension for piano players , 2017 .

[53]  Hua Li,et al.  Obtaining Vital Distances Using Wearable Inertial Measurement Unit for Real-Time, Biomechanical Feedback Training in Hammer-Throw , 2018, Applied Sciences.

[54]  John V. Basmajian Biofeedback: Principles and practice for clinicians, 3rd ed. , 1989 .

[55]  H. Kwakernaak,et al.  Feedback Systems , 2009, Encyclopedia of Database Systems.

[56]  E. Isakov Gait rehabilitation: a new biofeedback device for monitoring and enhancing weight-bearing over the affected lower limb. , 2007, Europa medicophysica.

[57]  Daniel Vélez Día,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[58]  S. Olney,et al.  Feedback of ankle joint angle and soleus electromyography in the rehabilitation of hemiplegic gait. , 1993, Archives of physical medicine and rehabilitation.

[59]  S. White,et al.  Altering asymmetric limb loading after hip arthroplasty using real-time dynamic feedback when walking. , 2005, Archives of physical medicine and rehabilitation.

[60]  Bingjun Wan,et al.  Biomechanical modeling as a practical tool for predicting injury risk related to repetitive muscle lengthening during learning and training of human complex motor skills , 2016, SpringerPlus.

[61]  Timothy D. Lee,et al.  Motor Control and Learning: A Behavioral Emphasis , 1982 .

[62]  Gongbing Shan,et al.  Biomechanical evaluation of bike power saver. , 2008, Applied ergonomics.

[63]  Gongbing Shan,et al.  Biomechanical characteristics of the Axe Kick in Tae Kwon-Do , 2012 .

[64]  Clare E. Milner,et al.  Real-Time Kinematic, Temporospatial, and Kinetic Biofeedback During Gait Retraining in Patients: A Systematic Review , 2010, Physical Therapy.

[65]  Gongbing Shan,et al.  A Biomechanical Study for Developing Wearable-Sensor System to Prevent Hip Fractures among Seniors , 2017 .

[66]  Stefan Wermter,et al.  Emotion-modulated attention improves expression recognition: A deep learning model , 2017, Neurocomputing.

[67]  Heike Brock Deep learning—Accelerating Next Generation Performance Analysis Systems? , 2018 .

[68]  Gongbing Shan,et al.  Bicycle kick in soccer: is the virtuosity systematically entrainable? , 2015 .

[69]  Bingjun Wan,et al.  The relevance of body positioning and its training effect on badminton smash , 2017, Journal of sports sciences.

[70]  Gongbing Shan,et al.  Full-body kinematic characteristics of the maximal instep soccer kick by male soccer players and parameters related to kick quality. , 2005, Sports biomechanics.

[71]  Kamiar Aminian,et al.  Front-Crawl Instantaneous Velocity Estimation Using a Wearable Inertial Measurement Unit , 2012, Sensors.

[72]  H Martin Schepers,et al.  Validation of wearable visual feedback for retraining foot progression angle using inertial sensors and an augmented reality headset , 2018, Journal of NeuroEngineering and Rehabilitation.

[73]  Jake K. Aggarwal,et al.  Human activity recognition from 3D data: A review , 2014, Pattern Recognit. Lett..

[74]  E. Ceceli,et al.  Comparison of joint-position biofeedback and conventional therapy methods in Genu recurvatum after stroke - 6 months' follow-up , 1996 .

[75]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[76]  David Hawkins,et al.  A real-time biomechanical feedback system for training rowers , 2003 .

[77]  Xiang Zhang,et al.  Quantification of Golfer-club Interaction and Club-type’s Affect on Dynamic Balance during a Golf Swing , 2011 .

[78]  J Heikenfeld,et al.  The microfluidics of the eccrine sweat gland, including biomarker partitioning, transport, and biosensing implications. , 2015, Biomicrofluidics.

[79]  Gongbing Shan,et al.  Comparison of Repetitive Movements Between Ballet Dancers and Martial Artists: Risk Assessment of Muscle Overuse Injuries and Prevention Strategies , 2005, Research in sports medicine.

[80]  Ruzena Bajcsy,et al.  Berkeley MHAD: A comprehensive Multimodal Human Action Database , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[81]  Dhruv R. Seshadri,et al.  Wearable Devices for Sports: New Integrated Technologies Allow Coaches, Physicians, and Trainers to Better Understand the Physical Demands of Athletes in Real time , 2017, IEEE Pulse.

[82]  Dhruv R. Seshadri,et al.  A review of wearable technology: Moving beyond the hype: From need through sensor implementation , 2016, 2016 8th Cairo International Biomedical Engineering Conference (CIBEC).

[83]  Arnold Baca,et al.  Rapid Feedback Systems for Elite Sports Training , 2006, IEEE Pervasive Computing.

[84]  Gongbing Shan,et al.  A Frequency-Based Characterization of Spiccato Bowing in Violin Performance , 2007, Perceptual and motor skills.

[85]  Chen Feng,et al.  Upper limb motion tracking with the integration of IMU and Kinect , 2015, Neurocomputing.

[86]  Jing Shan,et al.  A NOVEL MEASUREMENT SYSTEM FOR QUANTITATIVE ASSESSMENT OF AGE-RELATED SENSORI-MOTOR DEGRADATION , 2009 .

[87]  James Shippen,et al.  Biomechanical metrics of aesthetic perception in dance , 2015, Experimental Brain Research.

[88]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[89]  Michael Schwenk,et al.  Interactive balance training integrating sensor-based visual feedback of movement performance: a pilot study in older adults , 2014, Journal of NeuroEngineering and Rehabilitation.

[90]  Gongbing Shan,et al.  Influence of gender and experience on the maximal instep soccer kick , 2009 .

[91]  T. Egner,et al.  Ecological validity of neurofeedback: modulation of slow wave EEG enhances musical performance , 2003, Neuroreport.