Algorithms for distributed feature extraction in multi-camera visual sensor networks

Real-time visual analysis tasks, like tracking and recognition, require swift execution of computationally intensive algorithms. Enabling visual sensor networks to perform such tasks can be achieved by augmenting the sensor network with processing nodes and distributing the computational burden among several nodes, in a way that the cameras contend for the processing nodes while trying to minimize their completion times. In this paper, we formulate the problem of minimizing the completion time of all camera sensors as an optimization problem. We propose algorithms for fully distributed optimization, analyze the existence of equilibrium allocations, and evaluate their performance. Simulation results show that distributed optimization can provide good performance despite limited information availability at low computational complexity, but the predictable and stable performance is often not provided by the algorithm that provides lowest average completion time.

[1]  H. Peyton Young,et al.  Learning efficient Nash equilibria in distributed systems , 2012, Games Econ. Behav..

[2]  Hu Chen,et al.  On the design of a novel JPEG quantization table for improved feature detection performance , 2013, 2013 IEEE International Conference on Image Processing.

[3]  György Dán,et al.  Real-Time Distributed Visual Feature Extraction from Video in Sensor Networks , 2014, 2014 IEEE International Conference on Distributed Computing in Sensor Systems.

[4]  Wen Gao,et al.  Optimizing JPEG quantization table for low bit rate mobile visual search , 2012, 2012 Visual Communications and Image Processing.

[5]  Stefano Tubaro,et al.  Coding video sequences of visual features , 2013, 2013 IEEE International Conference on Image Processing.

[6]  Viktoria Fodor,et al.  Characterization of SURF and BRISK Interest Point Distribution for Distributed Feature Extraction in Visual Sensor Networks , 2015, IEEE Transactions on Multimedia.

[7]  Ulrich Berger,et al.  Brown's original fictitious play , 2007, J. Econ. Theory.

[8]  Debasish Ghose,et al.  Optimal Sequencing and Arrangement in Distributed Single-Level Tree Networks with Communication Delays , 1994, IEEE Trans. Parallel Distributed Syst..

[9]  J. Lacan,et al.  Evaluation of Error Control Mechanisms for 802.11b Multicast Transmissions , 2006, 2006 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks.

[10]  Józef Wozniak,et al.  Performance Analysis of Multicast Video Streaming in IEEE 802.11 b/g/n Testbed Environment , 2009, WMNC/PWC.

[11]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[12]  João Ascenso,et al.  Rate-accuracy optimization of binary descriptors , 2013, 2013 IEEE International Conference on Image Processing.

[13]  Debasish Ghose,et al.  Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems , 2004, Cluster Computing.

[14]  Boi Faltings,et al.  Reaching correlated equilibria through multi-agent learning , 2011, AAMAS.

[15]  Younghwan Yoo,et al.  Airtime Fairness for IEEE 802.11 Multirate Networks , 2008, IEEE Transactions on Mobile Computing.

[16]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  L. Shapley,et al.  Potential Games , 1994 .

[18]  A.O. Fapojuwo,et al.  Modeling and characterization of frame loss process in IEEE 802.11 wireless local area networks , 2004, IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004.

[19]  L. Shapley,et al.  Fictitious Play Property for Games with Identical Interests , 1996 .

[20]  Valentino Pacifici,et al.  Convergence in Player-Specific Graphical Resource Allocation Games , 2012, IEEE Journal on Selected Areas in Communications.

[21]  David G. Lowe,et al.  Using stereo for object recognition , 2010, 2010 IEEE International Conference on Robotics and Automation.

[22]  Dariu Gavrila,et al.  Multi-person Localization and Track Assignment in Overlapping Camera Views , 2011, DAGM-Symposium.

[23]  Mubarak Shah,et al.  Tracking Multiple Occluding People by Localizing on Multiple Scene Planes , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  João Ascenso,et al.  Enabling visual analysis in wireless sensor networks , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[25]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[26]  Markus Flierl,et al.  Statistical methods for inter-viewdepth enhancement , 2014, 2014 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[27]  Natasha Gelfand,et al.  SURFTrac: Efficient tracking and continuous object recognition using local feature descriptors , 2009, CVPR.

[28]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[29]  Bharadwaj Veeravalli,et al.  On the Influence of Start-Up Costs in Scheduling Divisible Loads on Bus Networks , 2000, IEEE Trans. Parallel Distributed Syst..

[30]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[31]  Dean Phillips Foster,et al.  Regret Testing: Learning to Play Nash Equilibrium Without Knowing You Have an Opponent , 2006 .

[32]  Philip K. McKinley,et al.  Modeling multicast packet losses in wireless LANs , 2003, MSWIM '03.

[33]  Janne Riihijärvi,et al.  Performance study of IEEE 802.15.4 using measurements and simulations , 2006, IEEE Wireless Communications and Networking Conference, 2006. WCNC 2006..

[34]  Saswati Sarkar,et al.  Characterizing Temporal SNR Variation in 802.11 Networks , 2008, IEEE Transactions on Vehicular Technology.

[35]  Cordelia Schmid,et al.  Product Quantization for Nearest Neighbor Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Bernd Girod,et al.  Low latency image retrieval with progressive transmission of CHoG descriptors , 2010, MCMC '10.

[37]  Marco Tagliasacchi,et al.  A visual sensor network for object recognition: Testbed realization , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[38]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[40]  Huiyu Zhou,et al.  Object tracking using SIFT features and mean shift , 2009, Comput. Vis. Image Underst..

[41]  György Dán,et al.  Characterization of SURF interest point distribution for visual processing in sensor networks , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[42]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[43]  Binlong Li,et al.  Dynamic subspace-based coordinated multicamera tracking , 2011, 2011 International Conference on Computer Vision.