Behavior Analysis through Multimodal Sensing for Care of Parkinson’s and Alzheimer’s Patients

The analysis of multimodal data collected by innovative imaging sensors, Internet of Things devices, and user interactions can provide smart and automatic distant monitoring of Parkinsons and Alzheimers patients and reveal valuable insights for early detection and/or prevention of events related to their health. This article describes a novel system that involves data capturing and multimodal fusion to extract relevant features, analyze data, and provide useful recommendations. The system gathers signals from diverse sources in health monitoring environments, understands the user behavior and context, and triggers proper actions for improving the patients quality of life. The system offers a multimodal, multi-patient, versatile approach not present in current developments. It also offers comparable or improved results for detection of abnormal behavior in daily motion. The system was implemented and tested during 10 weeks in real environments involving 18 patients.

[1]  Hermie Hermens,et al.  A framework for the comparison of mobile patient monitoring systems , 2012, J. Biomed. Informatics.

[2]  Xi Chen,et al.  Activity Analysis, Summarization, and Visualization for Indoor Human Activity Monitoring , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[4]  A. Rodríguez-Molinero,et al.  Validation of a Portable Device for Mapping Motor and Gait Disturbances in Parkinson’s Disease , 2015, JMIR mHealth and uHealth.

[5]  Aggelos K. Katsaggelos,et al.  A Dynamic Hierarchical Clustering Method for Trajectory-Based Unusual Video Event Detection , 2009, IEEE Transactions on Image Processing.

[6]  Eric Psota,et al.  Smart watch RSSI localization and refinement for behavioral classification using laser-SLAM for mapping and fingerprinting , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Jeffrey M. Hausdorff,et al.  Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom , 2010, IEEE Transactions on Information Technology in Biomedicine.

[8]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Tobias Nef,et al.  Evaluation of Three State-of-the-Art Classifiers for Recognition of Activities of Daily Living from Smart Home Ambient Data , 2012, Sensors.

[10]  Lei Yang,et al.  3D depth image analysis for indoor fall detection of elderly people , 2016, Digit. Commun. Networks.

[11]  P. Daras,et al.  Using Tobit Kalman filtering in order to improve the motion recorded by Microsoft Kinect , 2017 .

[12]  W. Poewe,et al.  Movement Disorder Society Task Force report on the Hoehn and Yahr staging scale: Status and recommendations The Movement Disorder Society Task Force on rating scales for Parkinson's disease , 2004, Movement disorders : official journal of the Movement Disorder Society.

[13]  Dimitrios I. Fotiadis,et al.  Automatic detection of freezing of gait events in patients with Parkinson's disease , 2013, Comput. Methods Programs Biomed..

[14]  Gwenn Englebienne,et al.  UvA-DARE ( Digital Academic Repository ) Activity recognition using semi-Markov models on real world smart home datasets , 2010 .

[15]  Enamul Hoque,et al.  Holmes: A Comprehensive Anomaly Detection System for Daily In-home Activities , 2015, 2015 International Conference on Distributed Computing in Sensor Systems.

[16]  Federico Álvarez,et al.  Adaptive Fingerprinting in Multi-Sensor Fusion for Accurate Indoor Tracking , 2017, IEEE Sensors Journal.

[17]  Zahir Tari,et al.  A context-aware approach for long-term behavioural change detection and abnormality prediction in ambient assisted living , 2015, Pattern Recognit..

[18]  Claudio Bettini,et al.  Fine-grained recognition of abnormal behaviors for early detection of mild cognitive impairment , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[19]  Sinziana Mazilu,et al.  Prediction of Freezing of Gait in Parkinson's From Physiological Wearables: An Exploratory Study , 2015, IEEE Journal of Biomedical and Health Informatics.