Motion tracking and gait feature estimation for recognising Parkinson’s disease using MS Kinect

BackgroundAnalysis of gait features provides important information during the treatment of neurological disorders, including Parkinson’s disease. It is also used to observe the effects of medication and rehabilitation. The methodology presented in this paper enables the detection of selected gait attributes by Microsoft (MS) Kinect image and depth sensors to track movements in three-dimensional space.Methods The experimental part of the paper is devoted to the study of three sets of individuals: 18 patients with Parkinson’s disease, 18 healthy aged-matched individuals, and 15 students. The methodological part of the paper includes the use of digital signal-processing methods for rejecting gross data-acquisition errors, segmenting video frames, and extracting gait features. The proposed algorithm describes methods for estimating the leg length, normalised average stride length (SL), and gait velocity (GV) of the individuals in the given sets using MS Kinect data.ResultsThe main objective of this work involves the recognition of selected gait disorders in both the clinical and everyday settings. The results obtained include an evaluation of leg lengths, with a mean difference of 0.004 m in the complete set of 51 individuals studied, and of the gait features of patients with Parkinson’s disease (SL: 0.38 m, GV: 0.61 m/s) and an age-matched reference set (SL: 0.54 m, GV: 0.81 m/s). Combining both features allowed for the use of neural networks to classify and evaluate the selectivity, specificity, and accuracy. The achieved accuracy was 97.2 %, which suggests the potential use of MS Kinect image and depth sensors for these applications.ConclusionsDiscussion points include the possibility of using the MS Kinect sensors as inexpensive replacements for complex multi-camera systems and treadmill walking in gait-feature detection for the recognition of selected gait disorders.

[1]  V. Joseph Raj,et al.  DATA CLASSIFICATION WITH NEURAL CLASSIFIER USING RADIAL BASIS FUNCTION WITH DATA REDUCTION USING HIERARCHICAL CLUSTERING , 2012, SOCO 2012.

[2]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[3]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[4]  Jianwen Luo,et al.  Savitzky-Golay smoothing and differentiation filter for even number data , 2005, Signal Process..

[5]  Kelly J. Bower,et al.  Concurrent validity of the Microsoft Kinect for assessment of spatiotemporal gait variables. , 2013, Journal of biomechanics.

[6]  Suzanne Kieffer,et al.  Feature extraction and selection for objective gait analysis and fall risk assessment by accelerometry , 2011, Biomedical engineering online.

[7]  Roozbeh Jafari,et al.  Enabling Effective Programming and Flexible Management of Efficient Body Sensor Network Applications , 2013, IEEE Transactions on Human-Machine Systems.

[8]  Ryszard Klempous.  Surface Area Under the Motion Curve as a New Tool for Gait Recognition , 2013, EUROCAST.

[9]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[10]  Guang-Zhong Yang,et al.  Gait Parameter Estimation From a Miniaturized Ear-Worn Sensor Using Singular Spectrum Analysis and Longest Common Subsequence , 2014, IEEE Transactions on Biomedical Engineering.

[11]  Milad Alemzadeh,et al.  Human-Computer Interaction: Overview on State of the Art , 2008 .

[12]  Begonya Garcia-Zapirain,et al.  Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical Applications , 2014, Sensors.

[13]  Ales Procházka,et al.  Discrimination of axonal neuropathy using sensitivity and specificity statistical measures , 2014, Neural Computing and Applications.

[14]  K. Riedel.  Numerical Bayesian Methods Applied to Signal Processing , 1996 .

[15]  K OrJ.  Numerical Bayesian methods applied to signal processing , 1996 .

[16]  Takayuki Kanda,et al.  Person Tracking in Large Public Spaces Using 3-D Range Sensors , 2013, IEEE Transactions on Human-Machine Systems.

[17]  Derek Abbott,et al.  Arm movement speed assessment via a Kinect camera: A preliminary study in healthy subjects , 2014, Biomedical engineering online.

[18]  S. Moore,et al.  Validation of 24-hour ambulatory gait assessment in Parkinson's disease with simultaneous video observation , 2011, Biomedical engineering online.

[19]  Friedhelm Schwenker,et al.  Three learning phases for radial-basis-function networks , 2001, Neural Networks.

[20]  Hubert P. H. Shum,et al.  Real-Time Posture Reconstruction for Microsoft Kinect , 2013, IEEE Transactions on Cybernetics.

[21]  Chin-Hsing Chen,et al.  A vision-based regression model to evaluate Parkinsonian gait from monocular image sequences , 2012, Expert Syst. Appl..

[22]  Yan Gao,et al.  2.5D Multi-View Gait Recognition Based on Point Cloud Registration , 2014, Sensors.

[23]  Ralf Klinkenberg,et al.  Data Classification: Algorithms and Applications , 2014 .

[24]  Bogdan Kwolek,et al.  DTW-Based Gait Recognition from Recovered 3-D Joint Angles and Inter-ankle Distance , 2014, ICCVG.

[25]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[26]  Eduardo F. Morales,et al.  A dynamic Bayesian network for estimating the risk of falls from real gait data , 2013, Medical & Biological Engineering & Computing.

[27]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[28]  Philippe De Wilde,et al.  Robust Gait Recognition by Learning and Exploiting Sub-gait Characteristics , 2010, International Journal of Computer Vision.

[29]  Xu Xu,et al.  Accuracy of the Microsoft Kinect for measuring gait parameters during treadmill walking. , 2015, Gait & posture.

[30]  Luis Salgado,et al.  Depth-Color Fusion Strategy for 3-D Scene Modeling With Kinect , 2013, IEEE Transactions on Cybernetics.

[31]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.

[32]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[33]  R. Schafer,et al.  What Is a Savitzky-Golay Filter? , 2022 .

[34]  Ronald W. Schafer,et al.  What Is a Savitzky-Golay Filter? [Lecture Notes] , 2011, IEEE Signal Processing Magazine.

[35]  Jeffrey M. Hausdorff,et al.  Dual tasking, gait rhythmicity, and Parkinson's disease: Which aspects of gait are attention demanding? , 2005, The European journal of neuroscience.

[36]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[37]  Marko Rak,et al.  Deformable part models for object detection in medical images , 2014, Biomedical engineering online.

[38]  P. Olivier,et al.  Retraining function in people with Parkinson’s disease using the Microsoft kinect: game design and pilot testing , 2014, Journal of NeuroEngineering and Rehabilitation.

[39]  Yiping Yang,et al.  Real-time Hand Gesture Recognition from Depth Images Using Convex Shape Decomposition Method , 2014, J. Signal Process. Syst..

[40]  A. Geurts,et al.  Definition dependent properties of the cortical silent period in upper-extremity muscles, a methodological study , 2014, Journal of NeuroEngineering and Rehabilitation.

[41]  Ruigang Yang,et al.  Accuracy and repeatability of joint angles measured using a single camera markerless motion capture system. , 2014, Journal of biomechanics.

[42]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[43]  Dana Kulic,et al.  A Stochastic Framework for Movement Strategy Identification and Analysis , 2013, IEEE Transactions on Human-Machine Systems.

[44]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .