Privacy-preserving video fall detection using visual shielding information

In recent years, fall detection, especially for the elderly living alone at home, is a challenge in the field of computer vision and pattern recognition. However, there is a concern of loss of privacy in intelligent visual surveillance. In order to solve the contradiction between security surveillance and privacy protection in vision-based fall detection methods, we propose a concept named visual shielding, which can be applied to eliminate visual information but not reduce monitoring function. In the preprocessing, the multilayer compressed sensing is used to compress video frames to achieve visual shielding effect. Then, object region is separated from shielded videos by the low-rank and sparse decomposition theory, based on which to extract motion trajectory features of the object via the dense trajectory algorithm. Finally, the fall detection issue is transformed into the sparse recognition problem of the signal. Experimental results on three public fall databases show that the specificity and sensitivity of the proposed method can be maintained at an ideal level, which has the dual advantages of high privacy protection and high recognition accuracy.

[1]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[2]  Bart Vanrumste,et al.  Camera-Based Fall Detection on Real World Data , 2011, Theoretical Foundations of Computer Vision.

[3]  Werapon Chiracharit,et al.  Fall detection using Gaussian mixture model and principle component analysis , 2017, 2017 9th International Conference on Information Technology and Electrical Engineering (ICITEE).

[4]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[5]  Chang Liu,et al.  Low-rank and sparse matrix decomposition via the truncated nuclear norm and a sparse regularizer , 2018, The Visual Computer.

[6]  Long Chen,et al.  Human fall detection in surveillance video based on PCANet , 2016, Multimedia Tools and Applications.

[7]  Nader Karimi,et al.  Automatic Monocular System for Human Fall Detection Based on Variations in Silhouette Area , 2013, IEEE Transactions on Biomedical Engineering.

[8]  Cordelia Schmid,et al.  Dense Trajectories and Motion Boundary Descriptors for Action Recognition , 2013, International Journal of Computer Vision.

[9]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[10]  Baharak Shakeri Aski,et al.  Intelligent video surveillance for monitoring fall detection of elderly in home environments , 2008, 2008 11th International Conference on Computer and Information Technology.

[11]  Cina Motamed,et al.  Percentage of human-occupied areas for fall detection from two views , 2017, The Visual Computer.

[12]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[13]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[14]  Alex Mihailidis,et al.  An intelligent emergency response system: preliminary development and testing of automated fall detection , 2005, Journal of telemedicine and telecare.

[15]  Dacheng Tao,et al.  GoDec: Randomized Lowrank & Sparse Matrix Decomposition in Noisy Case , 2011, ICML.

[16]  G. ÓLaighin,et al.  A proposal for the classification and evaluation of fall detectors Une proposition pour la classification et l'évaluation des détecteurs de chutes , 2008 .

[17]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[18]  Yap-Peng Tan,et al.  Fall Incidents Detection for Intelligent Video Surveillance , 2005, 2005 5th International Conference on Information Communications & Signal Processing.

[19]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[20]  Nabil Zerrouki,et al.  Combined curvelets and hidden Markov models for human fall detection , 2018, Multimedia Tools and Applications.

[21]  Lan Tang,et al.  Compressed sensing image reconstruction via adaptive sparse nonlocal regularization , 2016, The Visual Computer.

[22]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Rémi Ronfard,et al.  A survey of vision-based methods for action representation, segmentation and recognition , 2011, Comput. Vis. Image Underst..

[24]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Caroline Rougier,et al.  Demo : Fall Detection Using 3 D Head Trajectory Extracted From a Single Camera Video Sequence , 2006 .

[26]  Quan-Sen Sun,et al.  Chaotic cellular automaton for generating measurement matrix used in CS coding , 2017, IET Signal Process..

[27]  Zihan Zhou,et al.  Demo: Robust face recognition via sparse representation , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[28]  Zhiquan Wang,et al.  Home environment fall detection system based on a cascaded multi-SVM classifier , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[29]  Zhihai He,et al.  Recognizing Falls from Silhouettes , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Vassilis Athitsos,et al.  A survey on vision-based fall detection , 2015, PETRA.

[31]  Bogdan Kwolek,et al.  Improving fall detection by the use of depth sensor and accelerometer , 2015, Neurocomputing.

[32]  Rached Tourki,et al.  Definition and Performance Evaluation of a Robust SVM Based Fall Detection Solution , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[33]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[34]  Franck Multon,et al.  Fall Detection With Multiple Cameras: An Occlusion-Resistant Method Based on 3-D Silhouette Vertical Distribution , 2011, IEEE Transactions on Information Technology in Biomedicine.

[35]  Rama Chellappa,et al.  Dictionary-Based Face Recognition Under Variable Lighting and Pose , 2012, IEEE Transactions on Information Forensics and Security.

[36]  Quan-Sen Sun,et al.  Sparse recognition via intra-class dictionary learning using visual saliency information , 2016, Neurocomputing.

[37]  Yun Li,et al.  A Microphone Array System for Automatic Fall Detection , 2012, IEEE Transactions on Biomedical Engineering.

[38]  Victor Vianu,et al.  Invited articles section foreword , 2010, JACM.

[39]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Jeffrey M. Hausdorff,et al.  Risk factors for falls among older adults: a review of the literature. , 2013, Maturitas.

[41]  Lu Gan Block Compressed Sensing of Natural Images , 2007, 2007 15th International Conference on Digital Signal Processing.

[42]  Yoong Choon Chang,et al.  A simple vision-based fall detection technique for indoor video surveillance , 2015, Signal Image Video Process..

[43]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[44]  Muhammad Shoaib,et al.  View-invariant Fall Detection for Elderly in Real Home Environment , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[45]  Emmanuel J. Cand The Restricted Isometry Property and Its Implications for Compressed Sensing , 2008 .

[46]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .