Saliency-directed prioritization of visual data in wireless surveillance networks

Abstract In wireless visual sensor networks (WVSNs), streaming all imaging data is impractical due to resource constraints. Moreover, the sheer volume of surveillance videos inhibits the ability of analysts to extract actionable intelligence. In this work, an energy-efficient image prioritization framework is presented to cope with the fragility of traditional WVSNs. The proposed framework selects semantically relevant information before it is transmitted to a sink node. This is based on salient motion detection, which works on the principle of human cognitive processes. Each camera node estimates the background by a bootstrapping procedure, thus increasing the efficiency of salient motion detection. Based on the salient motion, each sensor node is classified as being high or low priority. This classification is dynamic, such that camera nodes toggle between high-priority and low-priority status depending on the coverage of the region of interest. High-priority camera nodes are allowed to access reliable radio channels to ensure the timely and reliable transmission of data. We compare the performance of this framework with other state-of-the-art methods for both single and multi-camera monitoring. The results demonstrate the usefulness of the proposed method in terms of salient event coverage and reduced computational and transmission costs, as well as in helping analysts find semantically relevant visual information.

[1]  Dongbing Gu,et al.  Abrupt motion tracking using a visual saliency embedded particle filter , 2014, Pattern Recognit..

[2]  Sebnem Baydere,et al.  Low-cost prioritization of image blocks in wireless sensor networks for border surveillance , 2014, J. Netw. Comput. Appl..

[3]  Kemal Akkaya,et al.  Distributed collaborative camera actuation for redundant data elimination in wireless multimedia sensor networks , 2011, Ad Hoc Networks.

[4]  Sankar K. Pal,et al.  Handbook on Soft Computing for Video Surveillance , 2012 .

[5]  Jin-Jang Leou,et al.  Spatiotemporal saliency detection and salient region determination for H.264 videos , 2013, J. Vis. Commun. Image Represent..

[6]  J. Todd,et al.  The effects of viewing angle, camera angle, and sign of surface curvature on the perception of three-dimensional shape from texture. , 2007, Journal of vision.

[7]  Song Han,et al.  Cognitive radio network security: A survey , 2012, J. Netw. Comput. Appl..

[8]  Amotz Bar-Noy,et al.  Pan and scan: Configuring cameras for coverage , 2011, 2011 Proceedings IEEE INFOCOM.

[9]  C.-C. Jay Kuo,et al.  Cooperative Communications in Resource-Constrained Wireless Networks , 2007, IEEE Signal Processing Magazine.

[10]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[11]  Hamid Sharif,et al.  A Survey of Energy-Efficient Compression and Communication Techniques for Multimedia in Resource Constrained Systems , 2013, IEEE Communications Surveys & Tutorials.

[12]  Senem Velipasalar,et al.  Design of a Wireless Vision Sensor for object tracking in Wireless Vision Sensor Networks , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[13]  Ian F. Akyildiz,et al.  Cooperative spectrum sensing in cognitive radio networks: A survey , 2011, Phys. Commun..

[14]  Ian F. Akyildiz,et al.  BorderSense: Border patrol through advanced wireless sensor networks , 2011, Ad Hoc Networks.

[15]  Asrar U. H. Sheikh,et al.  A comparative study of spectrum awareness techniques for cognitive radio oriented wireless networks , 2013, Phys. Commun..

[16]  Wenye Wang,et al.  Self-orienting wireless multimedia sensor networks for occlusion-free viewpoints , 2008, Comput. Networks.

[17]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  James W. Davis,et al.  An adaptive focus-of-attention model for video surveillance and monitoring , 2007, Machine Vision and Applications.

[19]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[20]  Dimitrios Makris,et al.  An object-based comparative methodology for motion detection based on the F-Measure , 2008, Comput. Vis. Image Underst..

[21]  Hyeran Byun,et al.  Temporal gradient pattern for the near-duplicate video clustering , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[22]  Ian F. Akyildiz,et al.  Wireless multimedia sensor networks: A survey , 2007, IEEE Wireless Communications.

[23]  N. Lazarevic-McManus,et al.  Performance evaluation in visual surveillance using the F-measure , 2006, VSSN '06.

[24]  Abdelhamid Mellouk,et al.  An Evidence-Based Sensor Coverage Model , 2012, IEEE Communications Letters.

[25]  Jianfang Dou,et al.  Modeling the background and detecting moving objects based on Sift flow , 2014 .

[26]  Xiaohua Jia,et al.  Exploiting Data Fusion to Improve the Coverage of Wireless Sensor Networks , 2012, IEEE/ACM Transactions on Networking.

[27]  Deepak Puthal,et al.  Energy Efficient Protocols for Wireless Sensor Networks: A Survey and Approach , 2012 .

[28]  Jianjun Lei,et al.  Multilevel region of interest guided bit allocation for multiview video coding , 2014 .

[29]  Özgür B. Akan,et al.  Delay-sensitive and multimedia communication in cognitive radio sensor networks , 2012, Ad Hoc Networks.

[30]  Maja Stula,et al.  Observer network and forest fire detection , 2011, Inf. Fusion.

[31]  Aggelos K. Katsaggelos,et al.  Wireless Video Surveillance: A Survey , 2013, IEEE Access.

[32]  Shih-Chia Huang,et al.  Motion detection with pyramid structure of background model for intelligent surveillance systems , 2012, Eng. Appl. Artif. Intell..

[33]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[34]  Yi Wang,et al.  Barrier coverage in camera sensor networks , 2011, MobiHoc '11.

[35]  Dorothy Ndedi Monekosso,et al.  Detection of Salient Regions in Crowded Scenes , 2014, ArXiv.

[36]  H. Pashler,et al.  The Psychology of Attention , 2000 .

[37]  Norashidah Md Din,et al.  An Improved and Secure Motion Detection Surveillance System in UNIX , 2013 .

[38]  Chu-Song Chen,et al.  Fast Human Detection Using a Novel Boosted Cascading Structure With Meta Stages , 2008, IEEE Transactions on Image Processing.

[39]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[40]  Ying-li Tian,et al.  Robust Salient Motion Detection with Complex Background for Real-Time Video Surveillance , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[41]  R. Kakigi,et al.  Magnetic response of human extrastriate cortex in the detection of coherent and incoherent motion , 2000, Neuroscience.

[42]  Aleksandra Karimaa Efficient Video Surveillance: Performance Evaluation in Distributed Video Surveillance Systems , 2011 .

[43]  R. Abrams,et al.  Motion Onset Captures Attention , 2003, Psychological science.

[44]  Toufik Ahmed,et al.  On Energy Efficiency in Collaborative Target Tracking in Wireless Sensor Network: A Review , 2013, IEEE Communications Surveys & Tutorials.

[45]  Tsung-Han Tsai,et al.  Exploring Contextual Redundancy in Improving Object-Based Video Coding for Video Sensor Networks Surveillance , 2012, IEEE Transactions on Multimedia.

[46]  Bernhard Rinner,et al.  Resource-Aware Coverage and Task Assignment in Visual Sensor Networks , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[47]  Jong Hyuk Park,et al.  Intelligent video surveillance system: 3-tier context-aware surveillance system with metadata , 2010, Multimedia Tools and Applications.

[48]  Yi Wang,et al.  On full-view coverage in camera sensor networks , 2011, 2011 Proceedings IEEE INFOCOM.

[49]  Franklin C. Crow,et al.  Summed-area tables for texture mapping , 1984, SIGGRAPH.

[50]  K. B. Letaief,et al.  Optimization of cooperative spectrum sensing with energy detection in cognitive radio networks , 2009, IEEE Transactions on Wireless Communications.

[51]  Naixue Xiong,et al.  Scheduling security-critical multimedia applications in heterogeneous networks , 2011, Comput. Commun..

[52]  B. S. Adiga,et al.  Reliable data transmission in sensor networks using compressive sensing and real expander codes , 2012, 2012 National Conference on Communications (NCC).

[53]  Yixin Gao,et al.  ROI-based error resilient coding of H.264 for conversational video communication , 2011, 2011 7th International Wireless Communications and Mobile Computing Conference.

[54]  Lijuan Duan,et al.  Visual Conspicuity Index: Spatial Dissimilarity, Distance, and Central Bias , 2011, IEEE Signal Processing Letters.

[55]  Ralph Weischedel,et al.  PERFORMANCE MEASURES FOR INFORMATION EXTRACTION , 2007 .

[56]  O. Marques,et al.  An Eye on Visual Sensor Networks , 2012, IEEE Potentials.

[57]  Hsiao-Hwa Chen,et al.  Energy-Efficient Coverage Based on Probabilistic Sensing Model in Wireless Sensor Networks , 2010, IEEE Communications Letters.