Distinct Feature Extraction for Video-Based Gait Phase Classification

Recent advances in image acquisition and analysis have resulted in disruptive innovation in physical rehabilitation systems facilitating cost-effective, portable, video-based gait assessment. While these inexpensive motion capture systems, suitable for home rehabilitation, do not generally provide accurate kinematics measurements on their own, image processing algorithms ensure gait analysis that is accurate enough for rehabilitation programs. This paper proposes high-accuracy classification of gait phases and muscle actions, using readings from low-cost motion capture systems. First, 12 gait parameters, drawn from the medical literature, are defined to characterize gait patterns. These proposed parameters are then used as input to our proposed multi-channel time-series classification and gait phase reconstruction methods. Proposed methods fully utilize temporal information of gait parameters, thus improving the final classification accuracy. The validation, conducted using 126 experiments, with 6 healthy volunteers and 9 stroke survivors with manually-labelled gait phases, achieves state-of-art classification accuracy of gait phase with lower computational complexity compared to previous solutions.1

[1]  CHENG YANG,et al.  Human Upper Limb Motion Analysis for Post-Stroke Impairment Assessment Using Video Analytics , 2016, IEEE Access.

[2]  Cheng Yang,et al.  A Depth Camera Motion Analysis Framework for Tele-rehabilitation: Motion Capture and Person-Centric Kinematics Analysis , 2016, IEEE Journal of Selected Topics in Signal Processing.

[3]  Qingquan Li,et al.  Robust Gait Recognition by Integrating Inertial and RGBD Sensors , 2016, IEEE Transactions on Cybernetics.

[4]  Jun-Young Jung,et al.  A Neural Network-Based Gait Phase Classification Method Using Sensors Equipped on Lower Limb Exoskeleton Robots , 2015, Sensors.

[5]  Denise M. Peters,et al.  Assessing the Reliability and Validity of a Shorter Walk Test Compared With the 10-Meter Walk Test for Measurements of Gait Speed in Healthy, Older Adults , 2013, Journal of geriatric physical therapy.

[6]  Priyanka Sharma,et al.  Efficient Density-Based Clustering Using Automatic Parameter Detection , 2016 .

[7]  Alan M. Wood,et al.  Motion analysis , 1986 .

[8]  Cheng Yang,et al.  Automation enhancement and accuracy investigation of a portable single‐camera gait analysis system , 2019, IET Science, Measurement & Technology.

[9]  Gene Cheung,et al.  Estimating Heart Rate and Rhythm via 3D Motion Tracking in Depth Video , 2017, IEEE Transactions on Multimedia.

[10]  Eduardo Palermo,et al.  A Novel HMM Distributed Classifier for the Detection of Gait Phases by Means of a Wearable Inertial Sensor Network , 2014, Sensors.

[11]  Jeffrey M. Hausdorff,et al.  Validation of a Method for Real Time Foot Position and Orientation Tracking With Microsoft Kinect Technology for Use in Virtual Reality and Treadmill Based Gait Training Programs , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Vladimir Stankovic,et al.  Sleep Apnea Detection via Depth Video and Audio Feature Learning , 2017, IEEE Transactions on Multimedia.

[13]  Marco Grangetto,et al.  Kinect-based gait analysis for automatic frailty syndrome assessment , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[14]  Hung T. Nguyen,et al.  Detection of Gait Initiation Failure in Parkinson's disease patients using EEG signals , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  Zhong Liu,et al.  A New Model-Based Method for Multi-View Human Body Tracking and Its Application to View Transfer in Image-Based Rendering , 2018, IEEE Transactions on Multimedia.

[16]  Robert S. Allison,et al.  Gait assessment using the Kinect RGB-D sensor , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Marco La Cascia,et al.  3D skeleton-based human action classification: A survey , 2016, Pattern Recognit..

[18]  Fangmin Sun,et al.  Elderly Gait Analysis and Assessment Based on Body Area Network , 2013, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing.

[19]  Danijela Ristic-Durrant,et al.  A robust markerless vision-based human gait analysis system , 2011, 2011 6th IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI).

[20]  Ruzena Bajcsy,et al.  Unsupervised Temporal Segmentation of Repetitive Human Actions Based on Kinematic Modeling and Frequency Analysis , 2015, 2015 International Conference on 3D Vision.

[21]  Diane Podsiadlo,et al.  The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly Persons , 1991, Journal of the American Geriatrics Society.

[22]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[23]  Yang Yang,et al.  Reliability and Validity of Kinect RGB-D Sensor for Assessing Standing Balance , 2014, IEEE Sensors Journal.

[24]  Shuang Wang,et al.  A Review on Human Activity Recognition Using Vision-Based Method , 2017, Journal of healthcare engineering.

[25]  Sebastian I. Wolf,et al.  Body-Sensor-Network-Based Spasticity Detection , 2014, IEEE Journal of Biomedical and Health Informatics.

[26]  J. Delisa,et al.  Delisa's Physical medicine & rehabilitation : principles and practice , 2010 .

[27]  S. Bharathidason,et al.  Improving Classification Accuracy based on Random Forest Model with Uncorrelated High Performing Trees , 2014 .

[28]  Sudeep Sarkar,et al.  Improved gait recognition by gait dynamics normalization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Rama Chellappa,et al.  Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Cheng Zhang,et al.  Classification of EEG signals using multiple gait features based on Small-world Neural Network , 2016, 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[31]  A. Darzi,et al.  Motion analysis , 1986 .

[32]  Wassim M. Haddad,et al.  A Microsoft Kinect-Based Point-of-Care Gait Assessment Framework for Multiple Sclerosis Patients , 2017, IEEE Journal of Biomedical and Health Informatics.

[33]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[34]  Cheng Yang,et al.  Autonomous Gait Event Detection with Portable Single-Camera Gait Kinematics Analysis System , 2016, J. Sensors.

[35]  Edward D. Lemaire,et al.  Gait phase detection from thigh kinematics using machine learning techniques , 2017, 2017 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[36]  Jeen-Shing Wang,et al.  Walking Pattern Classification and Walking Distance Estimation Algorithms Using Gait Phase Information , 2012, IEEE Transactions on Biomedical Engineering.

[37]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[38]  Shaou-Gang Miaou,et al.  A gait analysis system using two cameras with orthogonal view , 2011, 2011 International Conference on Multimedia Technology.

[39]  Rama Chellappa,et al.  Rolling Rotations for Recognizing Human Actions from 3D Skeletal Data , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Felipe,et al.  Comparison between Classical and Intelligent Identification Systems for Classification of Gait Events , 2015 .

[41]  Qingguo Li,et al.  Concurrent validation of Xsens MVN measurement of lower limb joint angular kinematics , 2013, Physiological measurement.

[42]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[43]  Cheng Yang,et al.  Gait phase classification for in-home gait assessment , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[44]  Andrew Blake,et al.  Efficient Human Pose Estimation from Single Depth Images , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Robert Carson,et al.  Motion Capture , 2009, Encyclopedia of Biometrics.

[46]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[47]  JoAnne K. Gronley,et al.  Use of cluster analysis for gait pattern classification of patients in the early and late recovery phases following stroke. , 2003, Gait & posture.

[48]  Mohammad Derawi,et al.  Fusion of gait and ECG for biometric user authentication , 2014, 2014 International Conference of the Biometrics Special Interest Group (BIOSIG).