Efficient distribution of visual processing tasks in multi-camera visual sensor networks

Multi-camera visual sensor networks (VSNs) require large computational resources in order to perform visual analysis in real-time. One way to match the computational needs is to augment the VSN with dedicated processing nodes that do in-network processing, but this requires careful allocation of loads from the sensor nodes in order to ensure low processing times. In this paper we formulate the problem of load allocation and completion time minimization in a VSN as an optimization problem. We propose a distributed algorithm for load allocation, and evaluate its performance in terms of completion time and convergence compared to a Greedy algorithm. Simulations show that the proposed algorithm converges faster, but at the cost of increased completion times. Nonetheless, combined with appropriate coordination, the proposed algorithm achieves low completion times at low complexity.

[1]  Philip K. McKinley,et al.  Modeling multicast packet losses in wireless LANs , 2003, MSWIM '03.

[2]  Janne Riihijärvi,et al.  Performance study of IEEE 802.15.4 using measurements and simulations , 2006, IEEE Wireless Communications and Networking Conference, 2006. WCNC 2006..

[3]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[4]  Saswati Sarkar,et al.  Characterizing Temporal SNR Variation in 802.11 Networks , 2008, IEEE Transactions on Vehicular Technology.

[5]  Huiyu Zhou,et al.  Object tracking using SIFT features and mean shift , 2009, Comput. Vis. Image Underst..

[6]  György Dán,et al.  Characterization of SURF interest point distribution for visual processing in sensor networks , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[7]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[8]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[9]  J. Lacan,et al.  Evaluation of Error Control Mechanisms for 802.11b Multicast Transmissions , 2006, 2006 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks.

[10]  Józef Wozniak,et al.  Performance Analysis of Multicast Video Streaming in IEEE 802.11 b/g/n Testbed Environment , 2009, WMNC/PWC.

[11]  Viktoria Fodor,et al.  Characterization of SURF and BRISK Interest Point Distribution for Distributed Feature Extraction in Visual Sensor Networks , 2015, IEEE Transactions on Multimedia.

[12]  György Dán,et al.  Algorithms for distributed feature extraction in multi-camera visual sensor networks , 2015, 2015 IFIP Networking Conference (IFIP Networking).

[13]  A.O. Fapojuwo,et al.  Modeling and characterization of frame loss process in IEEE 802.11 wireless local area networks , 2004, IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004.

[14]  Younghwan Yoo,et al.  Airtime Fairness for IEEE 802.11 Multirate Networks , 2008, IEEE Transactions on Mobile Computing.

[15]  Debasish Ghose,et al.  Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems , 2004, Cluster Computing.

[16]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  György Dán,et al.  Real-Time Distributed Visual Feature Extraction from Video in Sensor Networks , 2014, 2014 IEEE International Conference on Distributed Computing in Sensor Systems.

[18]  Marco Tagliasacchi,et al.  A visual sensor network for object recognition: Testbed realization , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).