An Activity Recognition Framework for Continuous Monitoring of Non-Steady-State Locomotion of Individuals with Parkinson's Disease

Fundamental knowledge in activity recognition of individuals with motor disorders such as Parkinson’s disease (PD) has been primarily limited to detection of steady-state/static tasks (e.g., sitting, standing, walking). To date, identification of nonsteady-state locomotion on uneven terrains (stairs, ramps) has not received much attention. Furthermore, previous research has mainly relied on data from a large number of body locations which could adversely affect user convenience and system performance. Here, individuals with mild stages of PD and healthy subjects performed non-steady-state circuit trials comprising stairs, ramp, and changes of direction. An offline analysis using a linear discriminant analysis (LDA) classifier and a Long-Short Term Memory (LSTM) neural network was performed for task recognition. The performance of accelerographic and gyroscopic information from varied lower/upper-body segments were tested across a set of user-independent and user-dependent training paradigms. Comparing the F1 score of a given signal across classifiers showed improved performance using LSTM compared to LDA. Using LSTM, even a subset of information (e.g., feet data) in subject-independent training appeared to provide F1 score > 0.8. However, employing LDA was shown to be at the expense of being limited to using a subject-dependent training and/or biomechanical data from multiple body locations. The findings could inform a number of applications in the field of healthcare monitoring and developing advanced lower-limb assistive devices by providing insights into classification schemes capable of handling non-steady-state and unstructured locomotion in individuals with mild Parkinson’s disease.

[1]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[2]  Jeffrey M. Hausdorff,et al.  Falls and freezing of gait in Parkinson's disease: A review of two interconnected, episodic phenomena , 2004, Movement disorders : official journal of the Movement Disorder Society.

[3]  M. Gioulis,et al.  Gait analysis and clinical correlations in early Parkinson's disease. , 2017, Functional neurology.

[4]  T. Robbins,et al.  Contrasting mechanisms of impaired attentional set-shifting in patients with frontal lobe damage or Parkinson's disease. , 1993, Brain : a journal of neurology.

[5]  Yee Sien Ng,et al.  A Validated Smartphone-Based Assessment of Gait and Gait Variability in Parkinson’s Disease , 2015, PloS one.

[6]  Xiaoli Meng,et al.  Self-Contained Pedestrian Tracking During Normal Walking Using an Inertial/Magnetic Sensor Module , 2014, IEEE Transactions on Biomedical Engineering.

[7]  Martha E. Pollack,et al.  Autominder: an intelligent cognitive orthotic system for people with memory impairment , 2003, Robotics Auton. Syst..

[8]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[9]  Nicholas P. Fey,et al.  Intent Recognition in a Powered Lower Limb Prosthesis Using Time History Information , 2013, Annals of Biomedical Engineering.

[10]  A. Zwinderman,et al.  Prospective assessment of falls in Parkinson's disease , 2001, Journal of Neurology.

[11]  Zahra Taghikhaki,et al.  Sensor Fusion-based Activity Recognition for Parkinson Patients , 2011 .

[12]  Nasser Kehtarnavaz,et al.  Inertial Measurement Unit-Based Wearable Computers for Assisted Living Applications: A signal processing perspective , 2016, IEEE Signal Processing Magazine.

[13]  Alex Mihailidis,et al.  A Survey on Ambient-Assisted Living Tools for Older Adults , 2013, IEEE Journal of Biomedical and Health Informatics.

[14]  R. Fitzpatrick,et al.  Self-reported functioning and well-being in patients with Parkinson's disease: comparison of the short-form health survey (SF-36) and the Parkinson's Disease Questionnaire (PDQ-39) , 1995, Age and ageing.

[15]  Basel Kikhia,et al.  Optimal Placement of Accelerometers for the Detection of Everyday Activities , 2013, Sensors.

[16]  T. Robbins,et al.  Mechanisms of cognitive set flexibility in Parkinson's disease. , 2001, Brain : a journal of neurology.

[17]  Jeffrey M. Hausdorff Gait dynamics in Parkinson's disease: common and distinct behavior among stride length, gait variability, and fractal-like scaling. , 2009, Chaos.

[18]  Marios Politis,et al.  Parkinson's disease symptoms: The patient's perspective , 2010, Movement disorders : official journal of the Movement Disorder Society.

[19]  F. Horak,et al.  Assessing mobility at home in people with early Parkinson's disease using an instrumented Timed Up and Go test. , 2011, Parkinsonism & related disorders.

[20]  Philippe Fraisse,et al.  Automatic Fall Detection and Activity Monitoring for Elderly , 2007 .

[21]  Tingfang Yan,et al.  Review of assistive strategies in powered lower-limb orthoses and exoskeletons , 2015, Robotics Auton. Syst..

[22]  What is Functional Mobility Applied to Parkinson’s Disease? , 2018, Journal of Parkinson's disease.

[23]  Heikki Ailisto,et al.  Identifying users of portable devices from gait pattern with accelerometers , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[24]  Diogo R. Ferreira,et al.  Preprocessing techniques for context recognition from accelerometer data , 2010, Personal and Ubiquitous Computing.

[25]  M. Morris Movement disorders in people with Parkinson disease: a model for physical therapy. , 2000, Physical therapy.

[26]  Meg E Morris,et al.  Locomotor Training in People With Parkinson Disease , 2006, Physical Therapy.

[27]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[28]  Kamiar Aminian,et al.  Ambulatory Monitoring of Physical Activities in Patients With Parkinson's Disease , 2007, IEEE Transactions on Biomedical Engineering.

[29]  Patrick Boissy,et al.  Auto detection and segmentation of daily living activities during a Timed Up and Go task in people with Parkinson’s disease using multiple inertial sensors , 2017, Journal of NeuroEngineering and Rehabilitation.

[30]  Michael Goldfarb,et al.  Multiclass Real-Time Intent Recognition of a Powered Lower Limb Prosthesis , 2010, IEEE Transactions on Biomedical Engineering.

[31]  Héctor Pomares,et al.  Window Size Impact in Human Activity Recognition , 2014, Sensors.

[32]  Nicholas P Fey,et al.  Anticipatory kinematics and muscle activity preceding transitions from level-ground walking to stair ascent and descent. , 2016, Journal of biomechanics.

[33]  Peter H. Veltink,et al.  Ambulatory Monitoring of Activities and Motor Symptoms in Parkinson's Disease , 2010, IEEE Transactions on Biomedical Engineering.

[34]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[35]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.