A 3D Deep Learning Approach for Classification of Gait Abnormalities Using Microsoft Kinect V2 Sensor

In this paper, a deep learning approach is proposed based on a 3D Convolutional Neural Network for the classification of gait abnormalities. Six gait classes are considered, including Trendelenburg, Steppage, Stiff-legged, Lurching, and Antalgic gait abnormalities as well as normal gait. The proposed scheme is applied to a recently-published dataset from the literature. This dataset consists of the gait data recorded by multiple Microsoft Kinect v2 sensor from 25 joints of a person during walking on a specified walkway. In this dataset, for each of the 6 gait classes, ten people have attended the data collection procedure; and for each participant, 120 walking instances have been recorded. Each instance includes the spatial and temporal information of the walking, and it is converted to two 3D images, which respectively display the changes of the Coronal (X-Z) and Sagittal (Y-Z) views of the originally captured data over time. These two 3D images are used as the input of the proposed 3D convolutional neural network. There are a total of 14400 3D images in this dataset. In order to demonstrate the accuracy of the proposed approach, it is compared with four well-known neural classifiers from the literature.

[1]  M. Perc,et al.  Complete dynamical analysis of a neocortical network model , 2020, Nonlinear Dynamics.

[2]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[3]  Marina Ismail,et al.  A Review of Kinect Computing Research in Education and Rehabilitation , 2018, International Journal of Engineering & Technology.

[4]  S. S. Sreeja Mole,et al.  An efficient Gait Dynamics classification method for Neurodegenerative Diseases using Brain signals , 2019, Journal of Medical Systems.

[5]  Kooksung Jun,et al.  Pathological Gait Classification Using Kinect v2 and Gated Recurrent Neural Networks , 2020, IEEE Access.

[6]  J. Ryu,et al.  Biomechanical influences of gait patterns on knee joint: Kinematic & EMG analysis , 2020, PloS one.

[7]  Sylvain Brochard,et al.  A new deep learning-based method for the detection of gait events in children with gait disorders: Proof-of-concept and concurrent validity. , 2019, Journal of biomechanics.

[8]  Yong Wang,et al.  Extraction and selection of gait recognition features using skeleton point detection and improved fuzzy decision. , 2020, Medical engineering & physics.

[9]  Kingshuk Chakravarty,et al.  Analysis of muscle activation in lower extremity for static balance , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[10]  Annisa Darmawahyuni,et al.  Robust detection of atrial fibrillation from short-term electrocardiogram using convolutional neural networks , 2020, Future Gener. Comput. Syst..

[11]  David T. Jones,et al.  DISOPRED3: precise disordered region predictions with annotated protein-binding activity , 2014, Bioinform..

[12]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Miguel Hernando,et al.  Non-Invasive Multi-Camera Gait Analysis System and its Application to Gender Classification , 2020, IEEE Access.

[14]  Jing Li,et al.  Gait recognition based on 3D skeleton joints captured by kinect , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[15]  Kok Wai Wong,et al.  A proposed framework for an Interactive Visuotactile 3D Virtual Environment system for visuomotor rehabilitation of stroke patients , 2012, 2012 International Conference on Computer & Information Science (ICCIS).

[16]  Gentiane Venture,et al.  Pathological Gait Detection Based on Multiple Regression Models Using Unobtrusive Sensing Technology , 2021, J. Signal Process. Syst..

[17]  P. Pástor,et al.  Validity and sensitivity of instrumented postural and gait assessment using low-cost devices in Parkinson’s disease , 2020, Journal of neuroengineering and rehabilitation.

[18]  Arnold Baca,et al.  Automatic Classification of Functional Gait Disorders , 2017, IEEE Journal of Biomedical and Health Informatics.

[19]  Simone Calderara,et al.  Gait-Based Diplegia Classification Using LSMT Networks , 2019, Journal of healthcare engineering.

[20]  R. T. Moura,et al.  Kinect v2 based system for gait assessment of children with cerebral palsy in rehabilitation settings , 2020, Journal of medical engineering & technology.

[21]  Sang-Il Choi,et al.  Classification of Gait Type Based on Deep Learning Using Various Sensors with Smart Insole , 2019, Sensors.

[22]  Sheng Quan Xie,et al.  A review of gait disorders in the elderly and neurological patients for robot-assisted training , 2020, Disability and rehabilitation. Assistive technology.

[23]  Sajad Jafari,et al.  Study of functional connectivity of central motor system in Parkinson's disease using copula theory , 2021, Biomed. Signal Process. Control..