Using Kinect to classify Parkinson’s disease stages related to severity of gait impairment

BackgroundParkinson’s Disease (PD) is a chronic neurodegenerative disease associated with motor problems such as gait impairment. Different systems based on 3D cameras, accelerometers or gyroscopes have been used in related works in order to study gait disturbances in PD. Kinect Ⓡ has also been used to build these kinds of systems, but contradictory results have been reported: some works conclude that Kinect does not provide an accurate method of measuring gait kinematics variables, but others, on the contrary, report good accuracy results.MethodsIn this work, we have built a Kinect-based system that can distinguish between different PD stages, and have performed a clinical study with 30 patients suffering from PD belonging to three groups: early PD patients without axial impairment, more evolved PD patients with higher gait impairment but without Freezing of Gait (FoG), and patients with advanced PD and FoG. Those patients were recorded by two Kinect devices when they were walking in a hospital corridor. The datasets obtained from the Kinect were preprocessed, 115 features identified, some methods were applied to select the relevant features (correlation based feature selection, information gain, and consistency subset evaluation), and different classification methods (decision trees, Bayesian networks, neural networks and K-nearest neighbours classifiers) were evaluated with the goal of finding the most accurate method for PD stage classification.ResultsThe classifier that provided the best results is a particular case of a Bayesian Network classifier (similar to a Naïve Bayesian classifier) built from a set of 7 relevant features selected by the correlation-based on feature selection method. The accuracy obtained for that classifier using 10-fold cross validation is 93.40%. The relevant features are related to left shin angles, left humerus angles, frontal and lateral bents, left forearm angles and the number of steps during spin.ConclusionsIn this paper, it is shown that using Kinect is adequate to build a inexpensive and comfortable system that classifies PD into three different stages related to FoG. Compared to the results of previous works, the obtained accuracy (93.40%) can be considered high. The relevant features for the classifier are: a) movement and position of the left arm, b) trunk position for slightly displaced walking sequences, and c) left shin angle, for straight walking sequences. However, we have obtained a better accuracy (96.23%) for a classifier that only uses features extracted from slightly displaced walking steps and spin walking steps. Finally, the obtained set of relevant features may lead to new rehabilitation therapies for PD patients with gait problems.

[1]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[2]  M. Hallett,et al.  Freezing of gait: moving forward on a mysterious clinical phenomenon , 2011, The Lancet Neurology.

[3]  Beatriz Muñoz,et al.  A reliability assessment software using Kinect to complement the clinical evaluation of Parkinson's disease , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  Remco R. Bouckaert,et al.  Bayesian Network Classifiers in Weka for Version 3-5-7 , 2007 .

[5]  S Fahn,et al.  Freezing of gait in PD , 2001, Neurology.

[6]  Shyam Visweswaran,et al.  Improving Classification Performance with Discretization on Biomedical Datasets , 2008, AMIA.

[7]  Moataz Eltoukhy,et al.  Prediction of ground reaction forces for Parkinson's disease patients using a kinect-driven musculoskeletal gait analysis model. , 2017, Medical engineering & physics.

[8]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[9]  Kaylena A Ehgoetz Martens,et al.  The contribution of optic flow to freezing of gait in left- and right-PD: different mechanisms for a common phenomenon? , 2013, Parkinsonism & related disorders.

[10]  M H Cole,et al.  Predictors of future falls in Parkinson disease , 2010, Neurology.

[11]  J. Shine,et al.  Exploring the cortical and subcortical functional magnetic resonance imaging changes associated with freezing in Parkinson's disease. , 2013, Brain : a journal of neurology.

[12]  Paul McCrory,et al.  Validity and reliability of the Nintendo Wii Balance Board for assessment of standing balance. , 2010, Gait & posture.

[13]  Nir Giladi,et al.  Construction of freezing of gait questionnaire for patients with Parkinsonism. , 2000, Parkinsonism & related disorders.

[14]  A. Illarramendi,et al.  Exercise Recognition for Kinect-based Telerehabilitation , 2014, Methods of Information in Medicine.

[15]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[16]  Nir Giladi,et al.  Gait disturbances in advanced stages of Parkinson's disease. , 2001, Advances in neurology.

[17]  Albert A. Rizzo,et al.  Development and evaluation of low cost game-based balance rehabilitation tool using the microsoft kinect sensor , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  K. Leenders,et al.  Brain imaging in patients with freezing of gait , 2008, Movement disorders : official journal of the Movement Disorder Society.

[19]  Ahmed Al-Jawad,et al.  A systematic review of the characteristics and validity of monitoring technologies to assess Parkinson’s disease , 2016, Journal of NeuroEngineering and Rehabilitation.

[20]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[21]  Brett W Fling,et al.  Asymmetric pedunculopontine network connectivity in parkinsonian patients with freezing of gait. , 2013, Brain : a journal of neurology.

[22]  Fay B. Horak,et al.  Quantifying freezing of gait in Parkinson's disease during the instrumented timed up and go test , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Iván García-Magariño,et al.  A Kinect-Based System for Lower Limb Rehabilitation in Parkinson’s Disease Patients: a Pilot Study , 2015, Journal of Medical Systems.

[24]  Martin Schätz,et al.  Motion tracking and gait feature estimation for recognising Parkinson’s disease using MS Kinect , 2015, BioMedical Engineering OnLine.

[25]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[26]  D Mestre,et al.  [Automatic motion analysis of gait in patients with Parkinson disease: effects of levodopa and visual stimulations]. , 1996, Revue neurologique.

[27]  João Paulo da Silva Cunha,et al.  Kinect v2 based system for Parkinson's disease assessment , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[29]  P. Olivier,et al.  Retraining function in people with Parkinson’s disease using the Microsoft kinect: game design and pilot testing , 2014, Journal of NeuroEngineering and Rehabilitation.

[30]  S. Lehéricy,et al.  Cholinergic mesencephalic neurons are involved in gait and postural disorders in Parkinson disease. , 2010, The Journal of clinical investigation.

[31]  Mark Latt,et al.  Reliability of the GAITRite walkway system for the quantification of temporo-spatial parameters of gait in young and older people. , 2004, Gait & posture.

[32]  Tomoko Oeda,et al.  Clinical Factors Associated with Abnormal Postures in Parkinson's Disease , 2013, PloS one.

[33]  M. R. Kharazi,et al.  Validity of microsoft kinectTM for measuring gait parameters , 2015, 2015 22nd Iranian Conference on Biomedical Engineering (ICBME).

[34]  Shmuel Springer,et al.  Validity of the Kinect for Gait Assessment: A Focused Review , 2016, Sensors.

[35]  S. Swinnen,et al.  Dynamics of hemispheric specialization and integration in the context of motor control , 2006, Nature Reviews Neuroscience.

[36]  Ran Gilad-Bachrach,et al.  Full body gait analysis with Kinect , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  Francisco Javier Díaz Pernas,et al.  A Kinect-based system for cognitive rehabilitation exercises monitoring , 2014, Comput. Methods Programs Biomed..

[38]  W. Gibb,et al.  The relevance of the Lewy body to the pathogenesis of idiopathic Parkinson's disease. , 1988, Journal of neurology, neurosurgery, and psychiatry.

[39]  日向 俊二 Kinect for Windowsアプリを作ろう , 2012 .

[40]  Moataz Eltoukhy,et al.  Microsoft Kinect can distinguish differences in over-ground gait between older persons with and without Parkinson's disease. , 2017, Medical engineering & physics.

[41]  Jorge Bernad,et al.  A Fuzzy Ontology-Based System for Gait Recognition Using Kinect Sensor , 2017, SUM.

[42]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[43]  J. Hughes,et al.  Accuracy of clinical diagnosis of idiopathic Parkinson's disease: a clinico-pathological study of 100 cases. , 1992, Journal of neurology, neurosurgery, and psychiatry.

[44]  Camila Torriani-Pasin,et al.  Effect of Kinect games on postural control of patients with Parkinson's disease , 2015, REHAB.

[45]  Lynn Rochester,et al.  Progression of gait dysfunction in incident Parkinson's disease: Impact of medication and phenotype , 2015, Movement disorders : official journal of the Movement Disorder Society.

[46]  P. Hobson,et al.  Risk and incidence of dementia in a cohort of older subjects with Parkinson's disease in the United Kingdom , 2004, Movement disorders : official journal of the Movement Disorder Society.

[47]  Nir Giladi,et al.  Motor blocks in Parkinson's disease , 1992, Neurology.

[48]  L. Defebvre,et al.  [Gait disorders in Parkinson disease. Clinical description, analysis of posture, initiation of stabilized gait]. , 2001, Presse medicale.

[49]  M. Hoehn,et al.  Parkinsonism , 1967, Neurology.

[50]  M. Hunt,et al.  Validity of the Microsoft Kinect for providing lateral trunk lean feedback during gait retraining. , 2013, Gait & posture.

[51]  E. Tolosa,et al.  Clinical diagnostic criteria for dementia associated with Parkinson's disease , 2007, Movement disorders : official journal of the Movement Disorder Society.

[52]  J. Shine,et al.  Differential Neural Activation Patterns in Patients with Parkinson's Disease and Freezing of Gait in Response to Concurrent Cognitive and Motor Load , 2013, PloS one.