Sparsity-driven bandwidth-efficient decentralized tracking in visual sensor networks

A decentralized approach for multi-view multi-person tracking in VSNs.Design overcomplete dictionaries matched to the structure of likelihoods functions.Obtain sparse representation of likelihoods to reduce communication in the network.Comparison on well-known L1-solvers to choose a fast and reliable method.Qualitatively and quantitatively, our framework outperforms previous approaches. Recent developments in low-cost CMOS cameras have created the opportunity of bringing imaging capabilities to sensor networks and a new field called visual sensor networks (VSNs) has emerged. VSNs consist of image sensors, embedded processors, and wireless transceivers which are powered by batteries. Since energy and bandwidth resources are limited, setting up a tracking system in VSNs is a challenging problem. In this paper, we present a framework for human tracking in VSN environments. The traditional approach of sending compressed images to a central node has certain disadvantages such as decreasing the performance of further processing (i.e., tracking) because of low quality images. Instead, in our decentralized tracking framework, each camera node performs feature extraction and obtains likelihood functions. We propose a sparsity-driven method that can obtain bandwidth-efficient representation of likelihoods extracted by the camera nodes. Our approach involves the design of special overcomplete dictionaries that match the structure of the likelihoods and the transmission of likelihood information in the network through sparse representation in such dictionaries. We have applied our method for indoor and outdoor people tracking scenarios and have shown that it can provide major savings in communication bandwidth without significant degradation in tracking performance. We have compared the tracking results and communication loads with a block-based likelihood compression scheme, a decentralized tracking method and a distributed tracking method. Experimental results show that our sparse representation framework is an effective approach that can be used together with any probabilistic tracker in VSNs.

[1]  Surveillance Proceedings : 2nd joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS), October 15-16, 2005, Beijing, China , 2005 .

[2]  Ian F. Akyildiz,et al.  Wireless multimedia sensor networks: A survey , 2007, IEEE Wireless Communications.

[3]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[4]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[5]  Leonidas J. Guibas,et al.  Counting people in crowds with a real-time network of simple image sensors , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[7]  Jian Yao,et al.  Fast human detection from videos using covariance features , 2008, ECCV 2008.

[8]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[9]  Pascal Fua,et al.  Multicamera People Tracking with a Probabilistic Occupancy Map , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[11]  Henry Medeiros,et al.  Cluster-Based Distributed Face Tracking in Camera Networks , 2010, IEEE Transactions on Image Processing.

[12]  Mark Coates,et al.  Distributed particle filters for sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[13]  Allen Y. Yang,et al.  Fast ℓ1-minimization algorithms and an application in robust face recognition: A review , 2010, 2010 IEEE International Conference on Image Processing.

[14]  Rémi Gribonval,et al.  Sparse Representations in Audio and Music: From Coding to Source Separation , 2010, Proceedings of the IEEE.

[15]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[16]  Volkan Cevher,et al.  Compressive Sensing for Background Subtraction , 2008, ECCV.

[17]  Reza Olfati-Saber,et al.  Distributed Kalman filtering for sensor networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[18]  Justin K. Romberg,et al.  Fast and Accurate Algorithms for Re-Weighted $\ell _{1}$-Norm Minimization , 2012, IEEE Transactions on Signal Processing.

[19]  Guillermo Sapiro,et al.  Discriminative learned dictionaries for local image analysis , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  BicakciKemal,et al.  A survey of visual sensor network platforms , 2012 .

[21]  Sufen Fong,et al.  MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[22]  Bernhard Rinner,et al.  Resource-Aware Coverage and Task Assignment in Visual Sensor Networks , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  António de Sousa Smart Cameras in Embedded Systems , 2020 .

[24]  Henry Medeiros,et al.  Distributed Object Tracking Using a Cluster-Based Kalman Filter in Wireless Camera Networks , 2008, IEEE Journal of Selected Topics in Signal Processing.

[25]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[26]  Amit K. Roy-Chowdhury,et al.  Information Consensus for Distributed Multi-target Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Amit K. Roy-Chowdhury,et al.  Tracking and Activity Recognition Through Consensus in Distributed Camera Networks , 2010, IEEE Transactions on Image Processing.

[28]  B. S. Manjunath,et al.  Distributed particle filter tracking with online multiple instance learning in a camera sensor network , 2010, 2010 IEEE International Conference on Image Processing.

[29]  Andrew Gilbert,et al.  Tracking Objects Across Cameras by Incrementally Learning Inter-camera Colour Calibration and Patterns of Activity , 2006, ECCV.

[30]  Mubarak Shah,et al.  Tracking Multiple Occluding People by Localizing on Multiple Scene Planes , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Jian Yao,et al.  Multi-Camera Multi-Person 3D Space Tracking with MCMC in Surveillance Scenarios , 2008, ECCV 2008.

[32]  Eduardo Monari,et al.  Task-Oriented Object Tracking in Large Distributed Camera Networks , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[33]  Aggelos K. Katsaggelos,et al.  Optimal sensor selection for video-based target tracking in a wireless sensor network , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[34]  Yu Liu,et al.  Distributed Compressed Video Sensing in Camera Sensor Networks , 2012, Int. J. Distributed Sens. Networks.

[35]  Senem Velipasalar,et al.  Cooperative Object Tracking and Composite Event Detection With Wireless Embedded Smart Cameras , 2010, IEEE Transactions on Image Processing.

[36]  Amit K. Roy-Chowdhury,et al.  Robust Tracking in A Camera Network: A Multi-Objective Optimization Framework , 2008, IEEE Journal of Selected Topics in Signal Processing.

[37]  Michael Hofmann,et al.  Multi-view 3D human pose estimation combining single-frame recovery, temporal integration and model adaptation , 2009, CVPR.

[38]  Hamid K. Aghajan,et al.  Color-Based Multiple Agent Tracking for Wireless Image Sensor Networks , 2006, ACIVS.

[39]  Leonidas J. Guibas,et al.  Sensor Tasking for Occupancy Reasoning in a Network of Cameras , 2004 .

[40]  Binlong Li,et al.  Dynamic subspace-based coordinated multicamera tracking , 2011, 2011 International Conference on Computer Vision.

[41]  Allen R. Hanson,et al.  Automatic resource allocation in a distributed camera network , 2010, Machine Vision and Applications.

[42]  Justin K. Romberg,et al.  Fast and Accurate Algorithms for Re-Weighted L1-Norm Minimization , 2012, ArXiv.

[43]  Allen Y. Yang,et al.  Distributed Sensor Perception via Sparse Representation , 2010, Proceedings of the IEEE.

[44]  Ramakant Nevatia,et al.  Inter-camera Association of Multi-target Tracks by On-Line Learned Appearance Affinity Models , 2010, ECCV.

[45]  Chao Yu,et al.  Camera Scheduling and Energy Allocation for Lifetime Maximization in User-Centric Visual Sensor Networks , 2010, IEEE Transactions on Image Processing.

[46]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[47]  Andrea Cavallaro,et al.  Distributed and Decentralized Multicamera Tracking , 2011, IEEE Signal Processing Magazine.

[48]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[49]  Emre Ertin,et al.  Sparsity and Compressed Sensing in Radar Imaging , 2010, Proceedings of the IEEE.

[50]  Dariu Gavrila,et al.  Multi-view 3D human pose estimation combining single-frame recovery, temporal integration and model adaptation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Larry S. Davis,et al.  Constraint Integration for Efficient Multiview Pose Estimation with Self-Occlusions , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Wolfgang Straßer,et al.  Adaptive Probabilistic Tracking Embedded in Smart Cameras for Distributed Surveillance in a 3D Model , 2007, EURASIP J. Embed. Syst..

[53]  Müjdat Çetin,et al.  Feature compression: A framework for multi-view multi-person tracking in visual sensor networks , 2014, J. Vis. Commun. Image Represent..

[54]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .