Rehabilitation Exercise Recognition and Evaluation Based on Smart Sensors With Deep Learning Framework

Exercise therapy is seen as one of the major treatments for the rehabilitation for patients, particularly using modern technologies, such as virtual reality or augmented reality. Computer-assisted physical rehabilitation training involves measuring performance by analyzing the movement data collected with a sensory system during prescribed rehabilitation exercises. Human activity recognition is a challenging topic for machine learning in the present area of research. Since the sensor-based activity recognition seeks deep knowledge from various low-level sensor readings concerning human activities. In this paper, the Smart Sensor-based Rehabilitation Exercise Recognition (SSRER) system has been proposed using a deep learning framework. For the recognition of rehabilitation exercise with sensor information, a convolutional neural network (CNN) has been used on dynamic platform(D-CNN) where it has sensory data for physical rehabilitation exercise body movement by Gaussian mixture models (GMM). The input signals and GMMs are in various segments contains shapes for many CNN routes. To retrieve the state transition likelihood of hidden states, the Sensor (S-CNN) utilizes the algorithm of improved lossless information compression as discriminant features of various movements. Therefore, the hybridized CNN of the Sensor (S-CNN) and D-CNN are combined with a deep learning classifier to assess every rehabilitation class exercise at different levels. The categorized deep learning methods show improved performance with best-learned features for any rehabilitation exercise. The difference between the best attribute and the test score analyzed mathematically with our collected data and a variety of activity recognition datasets has been illustrated in this article with test results.

[1]  Cecilio Angulo,et al.  Online motion recognition using an accelerometer in a mobile device , 2012, Expert Syst. Appl..

[2]  Min Xian,et al.  A Deep Learning Framework for Assessing Physical Rehabilitation Exercises , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Po Yang,et al.  Examining sensor-based physical activity recognition and monitoring for healthcare using Internet of Things: A systematic review , 2018, Journal of Biomedical Informatics.

[4]  Ying Wah Teh,et al.  Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges , 2018, Expert Syst. Appl..

[5]  Marcin Grzegorzek,et al.  Automatic recognition of movement patterns in the vojta-therapy using RGB-D data , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[6]  Luca Romeo,et al.  A Hidden Semi-Markov Model based approach for rehabilitation exercise assessment , 2018, J. Biomed. Informatics.

[7]  Patrick Henry,et al.  Shoulder physiotherapy exercise recognition: machine learning the inertial signals from a smartwatch , 2018, Physiological measurement.

[8]  M. Tahar Kechadi,et al.  Rehabilitation Exercise Segmentation for Autonomous Biofeedback Systems with ConvFSM , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  M. Corbetta,et al.  Neurological Principles and Rehabilitation of Action Disorders: Rehabilitation Interventions , 2022 .

[10]  Wenbing Zhao,et al.  A Survey of Applications and Human Motion Recognition with Microsoft Kinect , 2015, Int. J. Pattern Recognit. Artif. Intell..

[11]  Victor Sholukha,et al.  3D Analysis of Upper Limbs Motion during Rehabilitation Exercises Using the KinectTM Sensor: Development, Laboratory Validation and Clinical Application , 2018, Sensors.

[12]  Ahmad Almogren,et al.  A robust human activity recognition system using smartphone sensors and deep learning , 2018, Future Gener. Comput. Syst..

[13]  Russell Baker,et al.  A Data Set of Human Body Movements for Physical Rehabilitation Exercises , 2018, Data.

[14]  Aleksandar Vakanski,et al.  Metrics for Performance Evaluation of Patient Exercises during Physical Therapy. , 2017, International journal of physical medicine & rehabilitation.

[15]  William Johnston,et al.  Wearable Inertial Sensor Systems for Lower Limb Exercise Detection and Evaluation: A Systematic Review , 2018, Sports Medicine.

[16]  Dana Kulic,et al.  Exercise motion classification from large-scale wearable sensor data using convolutional neural networks , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Peter J Beek,et al.  Functional gait rehabilitation in elderly people following a fall-related hip fracture using a treadmill with visual context: design of a randomized controlled trial , 2013, BMC Geriatrics.

[18]  Kevin Bouchard,et al.  A More Efficient Transportable and Scalable System for Real-Time Activities and Exercises Recognition , 2018, Sensors.

[19]  Miguel Cazorla,et al.  EVA: EVAluating at-home rehabilitation exercises using augmented reality and low-cost sensors , 2019, Virtual Reality.

[20]  Shahrokh Valaee,et al.  Locomotion Activity Recognition Using Stacked Denoising Autoencoders , 2018, IEEE Internet of Things Journal.

[21]  Chen-Kuo Chiang,et al.  Deep Learning for Sensor-Based Rehabilitation Exercise Recognition and Evaluation† , 2019, Sensors.

[22]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[23]  Luckshman Bavan,et al.  Adherence monitoring of rehabilitation exercise with inertial sensors: A clinical validation study. , 2019, Gait & posture.

[24]  Csaba Kertész Physiotherapy Exercises Recognition Based on RGB-D Human Skeleton Models , 2013, 2013 European Modelling Symposium.

[25]  Anton Umek,et al.  Wearable Sensor Devices for Prevention and Rehabilitation in Healthcare: Swimming Exercise With Real-Time Therapist Feedback , 2019, IEEE Internet of Things Journal.