Human fall detection using normalized shape aspect ratio

In video surveillance, automatic human fall detection is important to protect vulnerable groups such as the elderly. When the camera layout varies, the shape aspect ratio (SAR) of a human body may change substantially. In order to rectify these changes, in this paper, we propose an automatic human fall detection method using the normalized shape aspect ratio (NSAR). A calibration process and bicubic interpolation are implemented to generate the NSAR table for each camera. Compared with some representative fall detection methods using the SAR, the proposed method integrates the NSAR with the moving speed and direction information to robustly detect human fall, as well as being able to detect falls toward eight different directions for multiple humans. Moreover, while most of the existing fall detection methods were designed only for indoor environment, experimental results demonstrate that this newly proposed method can effectively detect human fall in both indoor and outdoor environments.

[1]  Jean Meunier,et al.  Fall Detection from Human Shape and Motion History Using Video Surveillance , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[2]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[3]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Qiang Li,et al.  Gaussian mixture model for background based automatic fall detection , 2013 .

[5]  Miao Yu,et al.  Posture Recognition Based Fall Detection System , 2013 .

[6]  Ignacio Arganda-Carreras,et al.  Vision-Based Fall Detection with Convolutional Neural Networks , 2017, Wirel. Commun. Mob. Comput..

[7]  Rui Liu,et al.  Fall detection for elderly person care in a vision-based home surveillance environment using a monocular camera , 2014, Signal Image Video Process..

[8]  Yap-Peng Tan,et al.  Fall Incidents Detection for Intelligent Video Surveillance , 2005, 2005 5th International Conference on Information Communications & Signal Processing.

[9]  Hamid Aghajan,et al.  Smart home care network using sensor fusion and distributed vision-based reasoning , 2006, VSSN '06.

[10]  Nader Karimi,et al.  Automatic Monocular System for Human Fall Detection Based on Variations in Silhouette Area , 2013, IEEE Transactions on Biomedical Engineering.

[11]  Tuan V. Pham,et al.  Human fall detection based on adaptive background mixture model and HMM , 2013, 2013 International Conference on Advanced Technologies for Communications (ATC 2013).

[12]  Mark Hasegawa-Johnson,et al.  Acoustic fall detection using Gaussian mixture models and GMM supervectors , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Inmaculada Plaza,et al.  The Effect of Personalization on Smartphone-Based Fall Detectors , 2016, Sensors.

[14]  Hong Liu,et al.  An Improved Algorithm of Automatic Fall Detection , 2012 .

[15]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[16]  Matti Linnavuo,et al.  Detection of falls among the elderly by a floor sensor using the electric near field , 2010, IEEE Transactions on Information Technology in Biomedicine.

[17]  Guang-Zhong Yang,et al.  An On-Node Processing Approach for Anomaly Detection in Gait , 2015, IEEE Sensors Journal.

[18]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.

[19]  Kate Saenko,et al.  R-C3D: Region Convolutional 3D Network for Temporal Activity Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[21]  Gang Chen,et al.  Swarm intelligence in mechanical engineering , 2016 .

[22]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Peter H. N. de With,et al.  Video-Based Fall Detection in the Home Using Principal Component Analysis , 2008, ACIVS.

[24]  Hussein Zedan,et al.  The implementation of an intelligent and video-based fall detection system using a neural network , 2014, Appl. Soft Comput..

[25]  Miao Yu,et al.  Deep learning for posture analysis in fall detection , 2014, 2014 19th International Conference on Digital Signal Processing.

[26]  Ming-Chih Chen,et al.  An Indoor Video Surveillance System with Intelligent Fall Detection Capability , 2013 .

[27]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[28]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[29]  Yoong Choon Chang,et al.  A simple vision-based fall detection technique for indoor video surveillance , 2015, Signal Image Video Process..

[30]  Jun Chu,et al.  Object Detection Based on Multi-Layer Convolution Feature Fusion and Online Hard Example Mining , 2018, IEEE Access.

[31]  Shijian Lu,et al.  TORNADO: A Spatio-Temporal Convolutional Regression Network for Video Action Proposal , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[32]  Piotr Augustyniak,et al.  Seamless Tracing of Human Behavior Using Complementary Wearable and House-Embedded Sensors , 2014, Sensors.

[33]  Miao Yu,et al.  One class boundary method classifiers for application in a video-based fall detection system , 2012 .

[34]  Stefanos D. Kollias,et al.  Computer vision based fall detection by a convolutional neural network , 2017, ICMI.

[35]  M. Alwan,et al.  A Smart and Passive Floor-Vibration Based Fall Detector for Elderly , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[36]  Ming-Chih Chen,et al.  A video surveillance system designed to detect multiple falls , 2016 .

[37]  Jean Meunier,et al.  3D head tracking for fall detection using a single calibrated camera , 2013, Image Vis. Comput..

[38]  Min Chen,et al.  A Collaborative Computing Framework of Cloud Network and WBSN Applied to Fall Detection and 3-D Motion Reconstruction , 2014, IEEE Journal of Biomedical and Health Informatics.