Online Fall Detection Using Recurrent Neural Networks on Smart Wearable Devices

Unintentional falls can cause severe injuries and even death, especially if no immediate assistance is given. The aim of Fall Detection Systems (FDSs) is to detect an occurring fall. This information can be used to trigger the necessary assistance in case of injury. This can be done by using either ambient-based sensors, e.g. cameras, or wearable devices. The aim of this work is to study the technical aspects of FDSs based on wearable devices and artificial intelligence techniques, in particular Deep Learning (DL), to implement an effective algorithm for on-line fall detection. The proposed classifier is based on a Recurrent Neural Network (RNN) model with underlying Long Short-Term Memory (LSTM) blocks. The method is tested on the publicly available SisFall dataset, with extended annotation, and compared with the results obtained by the SisFall authors.

[1]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[2]  Bart Vanrumste,et al.  Improving the accuracy of existing camera based fall detection algorithms through late fusion , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[3]  Babak A. Farshchian,et al.  A Combined Smartphone and Smartwatch Fall Detection System , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[4]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[5]  C. Medrano,et al.  Detecting Falls as Novelties in Acceleration Patterns Acquired with Smartphones , 2014, PloS one.

[6]  Patrick Robertson,et al.  Bayesian recognition of motion related activities with inertial sensors , 2010, UbiComp '10 Adjunct.

[7]  Gang Zhou,et al.  Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[8]  Eduardo Casilari-Pérez,et al.  UMAFall: A Multisensor Dataset for the Research on Automatic Fall Detection , 2017, FNC/MobiSPC.

[9]  Abbes Amira,et al.  Multiple comparator classifier framework for accelerometer-based fall detection and diagnostic , 2016, Appl. Soft Comput..

[10]  Manolis Tsiknakis,et al.  The MobiFall Dataset: Fall Detection and Classification with a Smartphone , 2014, Int. J. Monit. Surveillance Technol. Res..

[11]  Athanassios Skodras,et al.  A smartphone-based fall detection system for the elderly , 2017, Proceedings of the 10th International Symposium on Image and Signal Processing and Analysis.

[12]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[13]  Bogdan Kwolek,et al.  Fall detection using ceiling-mounted 3D depth camera , 2015, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[14]  C. Brayne,et al.  Inability to get up after falling, subsequent time on floor, and summoning help: prospective cohort study in people over 90 , 2008, BMJ : British Medical Journal.

[15]  Stefan Madansingh,et al.  Smartphone based fall detection system , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[16]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[17]  Elfed Lewis,et al.  FPGA based Real time 'secure' body temperature monitoring suitable for WBSN 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing , 2015 .

[18]  Youssef Iraqi,et al.  Fall Detection Systems for Elderly Care: A Survey , 2014, 2014 6th International Conference on New Technologies, Mobility and Security (NTMS).

[19]  Miao Yu,et al.  Deep learning for posture analysis in fall detection , 2014, 2014 19th International Conference on Digital Signal Processing.

[20]  Jesús Francisco Vargas-Bonilla,et al.  SisFall: A Fall and Movement Dataset , 2017, Sensors.

[21]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.