Detecting falls with X-Factor Hidden Markov Models

Graphical abstractDisplay Omitted HighlightsProposed new X-Factor Hidden Markov Models to identify falls in the absence of their training data.Proposed a novel cross-validation method to optimize parameters in the absence of fall data.Experimentally showed that performance of supervised classifiers deteriorate with very limited training fall data. Identification of falls while performing normal activities of daily living (ADL) is important to ensure personal safety and well-being. However, falling is a short term activity that occurs rarely and infrequently. This poses a challenge for traditional supervised classification algorithms, because there may be very little training data for falls (or none at all) to build generalizable models for falls. This paper proposes an approach for the identification of falls using a wearable device in the absence of training data for falls but with plentiful data for normal ADL. We propose three X-Factor Hidden Markov Model (XHMMs) approaches. The XHMMs have inflated output covariances (observation models). To estimate the inflated covariances, we propose a novel cross validation method to remove outliers from the normal ADL that serves as proxies for the unseen falls and allow learning the XHMMs using only normal activities. We tested the proposed XHMM approaches on two activity recognition datasets and show high detection rates for falls in the absence of fall-specific training data. We show that the traditional method of choosing threshold based on maximum of negative of log-likelihood to identify unseen falls is ill-posed for this problem. We also show that supervised classification methods perform poorly when very limited fall data is available during the training phase.

[1]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[2]  Xuemei Guo,et al.  Design and implementation of a distributed fall detection system based on wireless sensor networks , 2012, EURASIP Journal on Wireless Communications and Networking.

[3]  Bart Vanrumste,et al.  Camera-Based Fall Detection on Real World Data , 2011, Theoretical Foundations of Computer Vision.

[4]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[5]  Haiyong Luo,et al.  A fall detection algorithm based on pattern recognition and human posture analysis , 2011 .

[6]  Bodo Rosenhahn,et al.  Outdoor and Large-Scale Real-World Scene Analysis , 2012, Lecture Notes in Computer Science.

[7]  Guang-Zhong Yang,et al.  Sensor Placement for Activity Detection Using Wearable Accelerometers , 2010, 2010 International Conference on Body Sensor Networks.

[8]  Shehroz S. Khan,et al.  Towards the detection of unusual temporal events during activities using HMMs , 2012, UbiComp '12.

[9]  Fredrik Rusek,et al.  Iterative receivers with channel estimation for multi-user MIMO-OFDM: complexity and performance , 2012, EURASIP Journal on Wireless Communications and Networking.

[10]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[11]  Torsten Bumgarner,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[12]  Basel Kikhia,et al.  Optimal Placement of Accelerometers for the Detection of Everyday Activities , 2013, Sensors.

[13]  A. Singh Challenges " # , 2006 .

[14]  Paul E. Utgoff,et al.  Incremental Learning , 2017, Encyclopedia of Machine Learning and Data Mining.

[15]  Tong Zhang,et al.  Fall Detection by Wearable Sensor and One-Class SVM Algorithm , 2006 .

[16]  Tao Yuan,et al.  A wearable pre-impact fall detector using feature selection and Support Vector Machine , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[17]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[18]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[19]  Michelle Karg,et al.  Clinical Gait Analysis: Comparing Explicit State Duration HMMs Using a Reference-Based Index , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Alessio Vecchio,et al.  A smartphone-based fall detection system , 2012, Pervasive Mob. Comput..

[21]  Antonio Artés-Rodríguez,et al.  Human activity recognition using inertial sensors with invariance to sensor orientation , 2012, 2012 3rd International Workshop on Cognitive Information Processing (CIP).

[22]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Vera Nadales,et al.  Recognition of Human Motion Related Activities from Sensors , 2010 .

[24]  A. M. Khan,et al.  Accelerometer signal-based human activity recognition using augmented autoregressive model coefficients and artificial neural nets , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Svetha Venkatesh,et al.  Explicit State Duration HMM for Abnormality Detection in Sequences of Human Activity , 2004, PRICAI.

[26]  Chia-Tai Chan,et al.  Abnormality Detection for Improving Elder's Daily Life Independent , 2010, ICOST.

[27]  A. Mihailidis,et al.  Assistive technology for cognitive rehabilitation: State of the art , 2004 .

[28]  Yoshiteru Ishida,et al.  An adaptive sensor network for home intrusion detection by human activity profiling , 2011, Artificial Life and Robotics.

[29]  Athanasios V. Vasilakos,et al.  A Survey on Ambient Intelligence in Healthcare , 2013, Proceedings of the IEEE.

[30]  John A. Quinn,et al.  Factorial Switching Linear Dynamical Systems Applied to Physiological Condition Monitoring , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[32]  Manolis Tsiknakis,et al.  The MobiFall dataset: An initial evaluation of fall detection algorithms using smartphones , 2013, 13th IEEE International Conference on BioInformatics and BioEngineering.

[33]  Gérard Bailly,et al.  Proceedings of the 2005 joint conference on Smart objects and ambient intelligence - innovative context-aware services: usages and technologies, sOc-EUSAI '05, Grenoble, France, October 12-14, 2005 , 2005, sOc-EUSAI.

[34]  KwolekBogdan,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014 .

[35]  C. Medrano,et al.  Detecting Falls as Novelties in Acceleration Patterns Acquired with Smartphones , 2014, PloS one.

[36]  Stan Matwin,et al.  Addressing the Curse of Imbalanced Training Sets: One-Sided Selection , 1997, ICML.

[37]  Zhongying Zhao,et al.  Boolean genetic network model for the control of C. elegans early embryonic cell cycles , 2013, BioMedical Engineering OnLine.

[38]  Xiang Chen,et al.  A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals , 2013, IEEE Journal of Biomedical and Health Informatics.

[39]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Luc Cluitmans,et al.  Advancing from offline to online activity recognition with wearable sensors , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  Shehroz S. Khan,et al.  X-Factor HMMs for Detecting Falls in the Absence of Fall-Specific Training Data , 2014, IWAAL.

[42]  Zhenyu He,et al.  Activity recognition from acceleration data based on discrete consine transform and SVM , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[43]  Marjorie Skubic,et al.  Fall Detection in Homes of Older Adults Using the Microsoft Kinect , 2015, IEEE Journal of Biomedical and Health Informatics.

[44]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[45]  Qiang Yang,et al.  Sensor-Based Abnormal Human-Activity Detection , 2008, IEEE Transactions on Knowledge and Data Engineering.

[46]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[47]  Mi Zhang,et al.  A feature selection-based framework for human activity recognition using wearable multimodal sensors , 2011, BODYNETS.

[48]  Nicolas Thome,et al.  A HHMM-Based Approach for Robust Fall Detection , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[49]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[50]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[51]  Miao Yu,et al.  Fall detection in a smart room by using a fuzzy one class support vector machine and imperfect training data , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[52]  L Nyberg,et al.  Comparison of real-life accidental falls in older people with experimental falls in middle-aged test subjects. , 2012, Gait & posture.

[53]  Yunjian Ge,et al.  HMM-Based Human Fall Detection and Prediction Method Using Tri-Axial Accelerometer , 2013, IEEE Sensors Journal.

[54]  Sansanee Auephanwiriyakul,et al.  Fall detection algorithm using linear prediction model , 2013, 2013 IEEE International Symposium on Industrial Electronics.

[55]  M. Popescu,et al.  Acoustic fall detection using one-class classifiers , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[56]  Suraj Raghuraman,et al.  Exploring unconstrained mobile sensor based human activity recognition , 2013 .

[57]  Shogo Nishida,et al.  Activity Recognition for Risk Management with Installed Sensor in Smart and Cell Phone , 2011, HCI.

[58]  Shehroz S. Khan,et al.  One-class classification: taxonomy of study and review of techniques , 2013, The Knowledge Engineering Review.

[59]  Dana Kulic,et al.  Incremental Learning, Clustering and Hierarchy Formation of Whole Body Motion Patterns using Adaptive Hidden Markov Chains , 2008, Int. J. Robotics Res..

[60]  Padhraic Smyth,et al.  Markov monitoring with unknown states , 1994, IEEE J. Sel. Areas Commun..

[61]  Tim Dallas,et al.  Feature Selection and Activity Recognition System Using a Single Triaxial Accelerometer , 2014, IEEE Transactions on Biomedical Engineering.

[62]  Laura A Talbot,et al.  Falls in young, middle-aged and older community dwelling adults: perceived cause, environmental factors and injury , 2005, BMC public health.

[63]  Paulo Menezes,et al.  Features selection for human activity recognition with iPhone inertial sensors , 2013 .