Game theoretic approach for cooperative feature extraction in camera networks

Abstract. Visual sensor networks (VSNs) consist of several camera nodes with wireless communication capabilities that can perform visual analysis tasks such as object identification, recognition, and tracking. Often, VSN deployments result in many camera nodes with overlapping fields of view. In the past, such redundancy has been exploited in two different ways: (1) to improve the accuracy/quality of the visual analysis task by exploiting multiview information or (2) to reduce the energy consumed for performing the visual task, by applying temporal scheduling techniques among the cameras. We propose a game theoretic framework based on the Nash bargaining solution to bridge the gap between the two aforementioned approaches. The key tenet of the proposed framework is for cameras to reduce the consumed energy in the analysis process by exploiting the redundancy in the reciprocal fields of view. Experimental results in both simulated and real-life scenarios confirm that the proposed scheme is able to increase the network lifetime, with a negligible loss in terms of visual analysis accuracy.

[1]  Yi Wang,et al.  Barrier coverage in camera sensor networks , 2011, MobiHoc '11.

[2]  Yi Wang,et al.  On full-view coverage in camera sensor networks , 2011, 2011 Proceedings IEEE INFOCOM.

[3]  Thierry Bouwmans,et al.  Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey , 2008 .

[4]  Bernd Girod,et al.  Interframe Coding of Feature Descriptors for Mobile Augmented Reality , 2014, IEEE Transactions on Image Processing.

[5]  Lisimachos P. Kondi,et al.  Kalai-Smorodinsky bargaining solution for optimal resource allocation over wireless DS-CDMA visual sensor networks , 2012, Other Conferences.

[6]  Alhussein A. Abouzeid,et al.  Coverage by directional sensors in randomly deployed wireless sensor networks , 2006, J. Comb. Optim..

[7]  Yiming Li,et al.  Utility-Based Camera Assignment in a Video Network: A Game Theoretic Framework , 2011, IEEE Sensors Journal.

[8]  Xin Yao,et al.  Resource-aware configuration in smart camera networks , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Marios M. Polycarpou,et al.  Distributed adaptive task allocation for energy conservation in camera sensor networks , 2015, ICDSC.

[10]  Marco Tagliasacchi,et al.  Energy Consumption of Visual Sensor Networks: Impact of Spatio-Temporal Coverage , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Marco Tagliasacchi,et al.  A visual sensor network for parking lot occupancy detection in Smart Cities , 2015, 2015 IEEE 2nd World Forum on Internet of Things (WF-IoT).

[12]  Arnold W. M. Smeulders,et al.  The Amsterdam Library of Object Images , 2004, International Journal of Computer Vision.

[13]  Katia Obraczka,et al.  Wireless Smart Camera Networks for the Surveillance of Public Spaces , 2014, Computer.

[14]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[15]  Marco Tagliasacchi,et al.  EZ-VSN: An Open-Source and Flexible Framework for Visual Sensor Networks , 2016, IEEE Internet of Things Journal.

[16]  Lisimachos P. Kondi,et al.  Geometric Bargaining Approach for Optimizing Resource Allocation in Wireless Visual Sensor Networks , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Francesca Cuomo,et al.  Leveraging Multiview Video Coding in clustered Multimedia Sensor networks , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[18]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[19]  Lisimachos P. Kondi,et al.  Fairness issues in resource allocation schemes for wireless visual sensor networks , 2013, Electronic Imaging.

[20]  Eitan Altman,et al.  Generalized Nash Bargaining Solution for bandwidth allocation , 2006, Comput. Networks.

[21]  Mihaela van der Schaar,et al.  Multi-User Multimedia Resource Management using Nash Bargaining Solution , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[22]  Amit K. Roy-Chowdhury,et al.  Decentralized camera network control using game theory , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[23]  Abdelhak M. Zoubir,et al.  Collaborative multi-camera face recognition and tracking , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[24]  Andrea Cavallaro,et al.  Self-Reconfigurable Smart Camera Networks , 2014, Computer.

[25]  João Ascenso,et al.  Evaluation of low-complexity visual feature detectors and descriptors , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[26]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[27]  João Ascenso,et al.  GreenEyes: Networked energy-aware visual analysis , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[28]  Marco Tagliasacchi,et al.  Compress-then-analyze vs. analyze-then-compress: Two paradigms for image analysis in visual sensor networks , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[29]  Bernhard Rinner,et al.  Distributed resource-aware task assignment for complex monitoring scenarios in Visual Sensor Networks , 2012, 2012 Sixth International Conference on Distributed Smart Cameras (ICDSC).

[30]  José M. Barceló-Ordinas,et al.  Node Clustering Based on Overlapping FoVs for Wireless Multimedia Sensor Networks , 2010, 2010 IEEE Wireless Communication and Networking Conference.

[31]  Allen Y. Yang,et al.  Towards an efficient distributed object recognition system in wireless smart camera networks , 2010, 2010 13th International Conference on Information Fusion.

[32]  Elizabeth S. Bentley,et al.  Game-theoretic solutions through intelligent optimization for efficient resource management in wireless visual sensor networks , 2014, Signal Process. Image Commun..

[33]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[34]  Bir Bhanu,et al.  Face recognition in multi-camera surveillance videos , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).