Accurate and Timely Situation Awareness Retrieval from a Bandwidth Constrained Camera Network

Wireless cameras can be used to gather situation awareness information (e.g., humans in distress) in disaster recovery scenarios. However, blindly sending raw video streams from such cameras, to an operations center or controller can be prohibitive in terms of bandwidth. Further, these raw streams could contain either redundant or irrelevant information. Thus, we ask "how do we extract accurate situation awareness information from such camera nodes and send it in a timely manner, back to the operations center?" Towards this, we design ACTION, a framework that (a) detects objects of interest (e.g., humans) from the video streams, (b) combines these streams intelligently to eliminate redundancies and (c) transmits only parts of the feeds that are sufficient in achieving a desired detection accuracy to the controller. ACTION uses small amounts of metadata to determine if the objects from different camera feeds are the same. A resource-aware greedy algorithm is used to select a subset of video feeds that are associated with the same object, so as to provide a desired accuracy, for being sent to the operations center. Our evaluations show that ACTION helps reduce the network usage up to threefold, and yet achieves a high detection accuracy of ≈ 90%.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[3]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[4]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  Hans Kellerer,et al.  Knapsack problems , 2004 .

[6]  Qi Wang,et al.  Improved Cluster Heads Selection Method in Wireless Sensor Networks , 2010, 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing.

[7]  Thomas Mauthner,et al.  Occlusion Geodesics for Online Multi-object Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Surendra Ranganath,et al.  Multi-camera people tracking using Bayesian networks , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[9]  Luc Van Gool,et al.  Color-Based Object Tracking in Multi-camera Environments , 2003, DAGM-Symposium.

[10]  Srinivasan Seshan,et al.  CARE: content aware redundancy elimination for challenged networks , 2012, HotNets-XI.

[11]  Aakanksha Chowdhery,et al.  The Design and Implementation of a Wireless Video Surveillance System , 2015, MobiCom.

[12]  Amit K. Roy-Chowdhury,et al.  Managing Redundant Content in Bandwidth Constrained Wireless Networks , 2014, CoNEXT.

[13]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[14]  Feiping Nie,et al.  Learning a Mahalanobis distance metric for data clustering and classification , 2008, Pattern Recognit..

[15]  Pietro Perona,et al.  The Fastest Pedestrian Detector in the West , 2010, BMVC.

[16]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Shahram Payandeh,et al.  Geometry-Based Object Association and Consistent Labeling in Multi-Camera Surveillance , 2013, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Tieniu Tan,et al.  Practical Camera Calibration From Moving Objects for Traffic Scene Surveillance , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Avinash C. Kak,et al.  A novel evidence accumulation framework for robust multi-camera person detection , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[21]  Horst Bischof,et al.  Relaxed Pairwise Learned Metric for Person Re-identification , 2012, ECCV.

[22]  Vijay V. Vazirani,et al.  Approximation Algorithms , 2001, Springer Berlin Heidelberg.

[23]  Thomas Mauthner,et al.  Robust Real-Time Tracking of Multiple Objects by Volumetric Mass Densities , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.