Predictive Distributed Visual Analysis for Video in Wireless Sensor Networks

We consider the problem of performing distributed visual analysis for a video sequence in a visual sensor network that contains sensor nodes dedicated to processing. Visual analysis requires the detection and extraction of visual features from the images, and thus the time to complete the analysis depends on the number and on the spatial distribution of the features, both of which are unknown before performing the detection. In this paper, we formulate the minimization of the time needed to complete the distributed visual analysis for a video sequence subject to a mean average precision requirement as a stochastic optimization problem. We propose a solution based on two composite predictors that reconstruct randomly missing data, on quantile-based linear approximation of feature distribution and on time series analysis methods. The composite predictors allow us to compute an approximate optimal solution through linear programming. We use two surveillance video traces to evaluate the proposed algorithms, and show that prediction is essential for minimizing the completion time, even if the wireless channel conditions vary and introduce significant randomness. The results show that the last value predictor together with regular quantile-based distribution approximation provide a low complexity solution with very good performance.

[1]  Wen Gao,et al.  Optimizing JPEG quantization table for low bit rate mobile visual search , 2012, 2012 Visual Communications and Image Processing.

[2]  György Dán,et al.  Real-Time Distributed Visual Feature Extraction from Video in Sensor Networks , 2014, 2014 IEEE International Conference on Distributed Computing in Sensor Systems.

[3]  Marco Tagliasacchi,et al.  Performance evaluation of object recognition tasks in visual sensor networks , 2014, 2014 26th International Teletraffic Congress (ITC).

[4]  Marco Tagliasacchi,et al.  Rate-accuracy optimization in visual wireless sensor networks , 2012, 2012 19th IEEE International Conference on Image Processing.

[5]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[6]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[7]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[8]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Debasish Ghose,et al.  Optimal Sequencing and Arrangement in Distributed Single-Level Tree Networks with Communication Delays , 1994, IEEE Trans. Parallel Distributed Syst..

[10]  João Ascenso,et al.  Rate-accuracy optimization of binary descriptors , 2013, 2013 IEEE International Conference on Image Processing.

[11]  J. Lacan,et al.  Evaluation of Error Control Mechanisms for 802.11b Multicast Transmissions , 2006, 2006 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks.

[12]  João Ascenso,et al.  Local feature selection for efficient binary descriptor coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[13]  Saswati Sarkar,et al.  Characterizing Temporal SNR Variation in 802.11 Networks , 2008, IEEE Transactions on Vehicular Technology.

[14]  Cordelia Schmid,et al.  Product Quantization for Nearest Neighbor Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Bernd Girod,et al.  Low latency image retrieval with progressive transmission of CHoG descriptors , 2010, MCMC '10.

[16]  João Ascenso,et al.  Clustering based binary descriptor coding for efficient transmission in visual sensor networks , 2013, 2013 Picture Coding Symposium (PCS).

[17]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Marco Tagliasacchi,et al.  A visual sensor network for object recognition: Testbed realization , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[19]  Saswati Sarkar,et al.  Characterizing Temporal SNR Variation in 802.11 Networks , 2008, IEEE Trans. Veh. Technol..

[20]  A.O. Fapojuwo,et al.  Modeling and characterization of frame loss process in IEEE 802.11 wireless local area networks , 2004, IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004.

[21]  Natasha Gelfand,et al.  SURFTrac: Efficient tracking and continuous object recognition using local feature descriptors , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Fouad Ben Abdelaziz,et al.  Solution approaches for the multiobjective stochastic programming , 2012, Eur. J. Oper. Res..

[23]  György Dán,et al.  Prediction-based load control and balancing for feature extraction in visual sensor networks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  György Dán,et al.  Characterization of SURF interest point distribution for visual processing in sensor networks , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[25]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[26]  Bharadwaj Veeravalli,et al.  On the Influence of Start-Up Costs in Scheduling Divisible Loads on Bus Networks , 2000, IEEE Trans. Parallel Distributed Syst..

[27]  Philip K. McKinley,et al.  Modeling multicast packet losses in wireless LANs , 2003, MSWIM '03.

[28]  Janne Riihijärvi,et al.  Performance study of IEEE 802.15.4 using measurements and simulations , 2006, IEEE Wireless Communications and Networking Conference, 2006. WCNC 2006..

[29]  Hu Chen,et al.  On the design of a novel JPEG quantization table for improved feature detection performance , 2013, 2013 IEEE International Conference on Image Processing.

[30]  Stefano Tubaro,et al.  Coding video sequences of visual features , 2013, 2013 IEEE International Conference on Image Processing.

[31]  Viktoria Fodor,et al.  Characterization of SURF and BRISK Interest Point Distribution for Distributed Feature Extraction in Visual Sensor Networks , 2015, IEEE Transactions on Multimedia.

[32]  Debasish Ghose,et al.  Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems , 2004, Cluster Computing.