Fall detection for elderly person care using convolutional neural networks

Falls are one of the major leading causes of mortality for elderly people living alone at home, which can lead to severe injuries. Fall detection is the most important health care issue for the elderly. In computer vision domain, significant breakthrough technologies such as deep learning have been obtained for over five years. Deep learning belongs to computational methods that allow an algorithm to program itself by learning from training data. Convolutional neural networks (CNNs), a specific type of deep learning, have set the state-of-the-art image classification performance in the ImageNet Large Scale Visual Recognition Challenge (ILSVRC) in recent years. In this paper, we present the use of convolutional neural networks for fall detection in video surveillance environment. CNN is directly applied to each frame image in the video to learn human shape deformation features that describe different postures of the human and determine if a fall occurs. Experimental results show that our proposed approach runs in real-time and achieves average accuracy of 99.98% for 10-fold cross-validation for fall detection. It is shown that the implemented CNN-based fall detection approach can be a promising solution for detecting falls.

[1]  Jean Meunier,et al.  Video Surveillance for Fall Detection , 2011 .

[2]  Emmanuel Andrès,et al.  From Fall Detection to Fall Prevention: A Generic Classification of Fall-Related Systems , 2017, IEEE Sensors Journal.

[3]  Rui Liu,et al.  Fall detection for elderly person care in a vision-based home surveillance environment using a monocular camera , 2014, Signal Image Video Process..

[4]  Jean Meunier,et al.  Fall Detection from Human Shape and Motion History Using Video Surveillance , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[5]  ShaoLing,et al.  A survey on fall detection , 2013 .

[6]  Israel Gannot,et al.  A Method for Automatic Fall Detection of Elderly People Using Floor Vibrations and Sound—Proof of Concept on Human Mimicking Doll Falls , 2009, IEEE Transactions on Biomedical Engineering.

[7]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Miao Yu,et al.  Deep learning for posture analysis in fall detection , 2014, 2014 19th International Conference on Digital Signal Processing.

[11]  Bart Vanrumste,et al.  How to detect human fall in video? An overview , 2009 .

[12]  Shuwan Xue,et al.  Portable Preimpact Fall Detector With Inertial Sensors , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Yoong Choon Chang,et al.  A simple vision-based fall detection technique for indoor video surveillance , 2015, Signal Image Video Process..

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Hussein Zedan,et al.  The implementation of an intelligent and video-based fall detection system using a neural network , 2014, Appl. Soft Comput..

[16]  A. Enis Çetin,et al.  Ambient assisted smart home design using vibration and PIR sensors , 2013, 2013 21st Signal Processing and Communications Applications Conference (SIU).

[17]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[18]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[19]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  A. Bourke,et al.  Fall detection - Principles and Methods , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  M. Skubic,et al.  Older adults' attitudes towards and perceptions of ‘smart home’ technologies: a pilot study , 2004, Medical informatics and the Internet in medicine.

[22]  Branka Jokanovic,et al.  Effect of data representations on deep learning in fall detection , 2016, 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM).

[23]  Thuy-Trang Nguyen,et al.  Automatic fall detection using wearable biomedical signal measurement terminal , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[25]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[26]  Frédérique C. Pivot,et al.  Fall Detection and Prevention for the Elderly: A Review of Trends and Challenges , 2013 .

[27]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[28]  Eva Negri,et al.  Risk Factors for Falls in Community-dwelling Older People: A Systematic Review and Meta-analysis , 2010, Epidemiology.

[29]  Branka Jokanovic,et al.  Radar fall motion detection using deep learning , 2016, 2016 IEEE Radar Conference (RadarConf).

[30]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[31]  K. Aminian,et al.  Fall detection with body-worn sensors , 2013, Zeitschrift für Gerontologie und Geriatrie.

[32]  Shehroz S. Khan,et al.  Review of Fall Detection Techniques: A Data Availability Perspective , 2016, Medical engineering & physics.