A novel real-time fall detection method based on head segmentation and convolutional neural network

As the computer vision develops, real-time fall detection based on computer vision has become increasingly popular in recent years. In this paper, a novel real-time indoor fall detection method based on computer vision by using geometric features and convolutional neural network (CNN) is proposed. Gaussian mixture model (GMM) is applied to detect the human target and find out the minimum external elliptical contour. Differently from the traditional fall detection method based on geometric features, we consider the importance of the head in fall detection and propose to use two different ellipses to represent the head and the torso, respectively. Three features including the long and short axis ratio, the orientation angle and the vertical velocity are extracted from the two different ellipses in each frame, respectively, and fused into a motion feature based on time series. In addition, a shallow CNN is applied to find out the correlation between the two elliptic contour features for detecting indoor falls and distinguishing some similar activities. Our novel method can effectively distinguish some similar activities in real time, which cannot be distinguished by some traditional methods based on geometric features, and has a better detection rate.

[1]  Qiang Li,et al.  Gaussian mixture model for background based automatic fall detection , 2013 .

[2]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[3]  Kai Zheng,et al.  Searching activity trajectory with keywords , 2018, World Wide Web.

[4]  Thuy-Trang Nguyen,et al.  Automatic fall detection using wearable biomedical signal measurement terminal , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Feiping Nie,et al.  Detecting Coherent Groups in Crowd Scenes by Multiview Clustering , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Xuelong Li,et al.  Weakly Supervised Adversarial Domain Adaptation for Semantic Segmentation in Urban Scenes , 2019, IEEE Transactions on Image Processing.

[7]  Yu Zheng,et al.  Deep CNN-Assisted Personalized Recommendation over Big Data for Mobile Wireless Networks , 2019, Wirel. Commun. Mob. Comput..

[8]  Jiguo Yu,et al.  Data-Sparsity Tolerant Web Service Recommendation Approach Based on Improved Collaborative Filtering , 2017, IEICE Trans. Inf. Syst..

[9]  Huimin Lu,et al.  Multi-scale deep context convolutional neural networks for semantic segmentation , 2017, World Wide Web.

[10]  Gongjian Wen,et al.  A deep neural network for real-time detection of falling humans in naturally occurring scenes , 2017, Neurocomputing.

[11]  Ming-Chih Chen,et al.  A video surveillance system designed to detect multiple falls , 2016 .

[12]  Gang Chen,et al.  Swarm intelligence in mechanical engineering , 2016 .

[13]  Yu Wang,et al.  An open-source project for real-time image semantic segmentation , 2019, Science China Information Sciences.

[14]  Miao Yu,et al.  An Online One Class Support Vector Machine-Based Person-Specific Fall Detection System for Monitoring an Elderly Individual in a Room Environment , 2013, IEEE Journal of Biomedical and Health Informatics.

[15]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Xuyun Zhang,et al.  A Distributed Locality-Sensitive Hashing-Based Approach for Cloud Service Recommendation From Multi-Source Data , 2017, IEEE Journal on Selected Areas in Communications.

[17]  Jinjun Chen,et al.  A two-stage locality-sensitive hashing based approach for privacy-preserving mobile service recommendation in cross-platform edge environment , 2018, Future Gener. Comput. Syst..

[18]  Lianyong Qi,et al.  Privacy-Aware Multidimensional Mobile Service Quality Prediction and Recommendation in Distributed Fog Environment , 2018, Wirel. Commun. Mob. Comput..

[19]  Yoong Choon Chang,et al.  A simple vision-based fall detection technique for indoor video surveillance , 2015, Signal Image Video Process..

[20]  William K. Pratt,et al.  Digital Image Processing, 4th Edition , 2007, J. Electronic Imaging.

[21]  Jinjun Chen,et al.  Weighted principal component analysis-based service selection method for multimedia services in cloud , 2014, Computing.

[22]  Weidong Min,et al.  A New Approach to Fall Detection Based on the Human Torso Motion Model , 2017 .

[23]  Huang Jiang-lin An improved algorithm of automatic fall detection , 2012 .

[24]  Ignacio Arganda-Carreras,et al.  Vision-Based Fall Detection with Convolutional Neural Networks , 2017, Wirel. Commun. Mob. Comput..

[25]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[26]  Jiguo Yu,et al.  “Time–Location–Frequency”–aware Internet of things service selection based on historical records , 2017, Int. J. Distributed Sens. Networks.

[27]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[28]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Jiguo Yu,et al.  Time-Aware IoE Service Recommendation on Sparse Data , 2016, Mob. Inf. Syst..

[30]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[31]  Qiang He,et al.  Time-aware distributed service recommendation with privacy-preservation , 2019, Inf. Sci..

[32]  Ping Wang,et al.  Fall detection via human posture representation and support vector machine , 2017, Int. J. Distributed Sens. Networks.

[33]  Xuyun Zhang,et al.  A QoS-aware virtual machine scheduling method for energy conservation in cloud-based cyber-physical systems , 2019, World Wide Web.

[34]  Jean Meunier,et al.  Fall Detection from Human Shape and Motion History Using Video Surveillance , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[35]  Nabil Zerrouki,et al.  Combined curvelets and hidden Markov models for human fall detection , 2018, Multimedia Tools and Applications.

[36]  Weidong Min,et al.  Human Fall Detection Based on Motion Tracking and Shape Aspect Ratio , 2016, MUE 2016.

[37]  Jiguo Yu,et al.  An Invocation Cost Optimization Method for Web Services in Cloud Environment , 2017, Sci. Program..

[38]  Hulya,et al.  Bmc Public Health the Relationship between Risk Factors for Falling and the Quality of Life in Older Adults , 2022 .

[39]  Weidong Min,et al.  Detection of Human Falls on Furniture Using Scene Analysis Based on Deep Learning and Activity Characteristics , 2018, IEEE Access.

[40]  P. A. van den Brandt,et al.  BMC Public Health BioMed Central Study protocol , 2004 .

[41]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[42]  Lu Leng,et al.  StoolNet for Color Classification of Stool Medical Images , 2019, Electronics.

[43]  Wen-Hsien Fang,et al.  A hybrid human fall detection scheme , 2010, 2010 IEEE International Conference on Image Processing.

[44]  Rui Liu,et al.  Fall detection for elderly person care in a vision-based home surveillance environment using a monocular camera , 2014, Signal Image Video Process..

[45]  Haipeng Li,et al.  Routing Protocol in VANETs Equipped with Directional Antennas: Topology-Based Neighbor Discovery and Routing Analysis , 2018, Wirel. Commun. Mob. Comput..

[46]  Allen R. Hanson,et al.  Aging in place: fall detection and localization in a distributed smart camera network , 2007, ACM Multimedia.

[47]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[48]  Xiaohu You,et al.  Power Control via Stackelberg Game for Small-Cell Networks , 2018, Wirel. Commun. Mob. Comput..

[49]  Yun Zhou,et al.  Elders' fall detection based on biomechanical features using depth camera , 2018, Int. J. Wavelets Multiresolution Inf. Process..

[50]  Wang,et al.  Real-Time Pre-Identification and Cascaded Detection for Tiny Faces , 2019, Applied Sciences.