A prediction-based approach for features aggregation in Visual Sensor Networks

Abstract Visual Sensor Networks (VSNs) constitute a key technology for the implementation of several visual analysis tasks. Recent studies have demonstrated that such tasks can be efficiently performed following an operative paradigm where cameras transmit to a central controller local image features, rather than pixel-domain images. Furthermore, features from multiple camera views may be efficiently aggregated exploiting the spatial redundancy between overlapping views. In this paper we propose a routing protocol designed for supporting aggregation of image features in a VSN. First, we identify a predictor able to estimate the efficiency of local features aggregation between different cameras in a VSN. The proposed predictor is chosen so as to minimize the prediction error while keeping the network overhead cost low. Then, we harmonically integrate the proposed predictor in the Routing Protocol for Low-Power and Lossy Networks (RPL) in order to support the task of in-network feature aggregation. We propose a RPL objective function that takes into account the predicted aggregation efficiency and build the routes from the camera nodes to a central controller so that either energy consumption or used network bandwidth is minimized. Extensive experimental results confirm that the proposed approach can be used to increase the efficiency of VSNs.

[1]  Guangjun Zhang,et al.  SIFT Hardware Implementation for Real-Time Image Feature Extraction , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Konrad Schindler,et al.  Monitoring of riparian vegetation response to flood disturbances using terrestrial photography , 2014 .

[3]  Yung-Chang Chen,et al.  High-Performance SIFT Hardware Accelerator for Real-Time Image Feature Extraction , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Nicolas D. Georganas,et al.  Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques , 2011, IEEE Transactions on Instrumentation and Measurement.

[5]  Ian F. Akyildiz,et al.  Correlation-Aware QoS Routing With Differential Coding for Wireless Video Sensor Networks , 2012, IEEE Transactions on Multimedia.

[6]  Ian F. Akyildiz,et al.  Correlation-Aware QoS Routing for Wireless Video Sensor Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[7]  Francesca Cuomo,et al.  An Empirical Model of Multiview Video Coding Efficiency for Wireless Multimedia Sensor Networks , 2013, IEEE Transactions on Multimedia.

[8]  Yi Li,et al.  An ultra-fast and low-power design of analog circuit network for DoG pyramid construction of SIFT algorithm , 2016, 2016 17th International Symposium on Quality Electronic Design (ISQED).

[9]  Alberto Del Bimbo,et al.  Ieee Transactions on Information Forensics and Security 1 a Sift-based Forensic Method for Copy-move Attack Detection and Transformation Recovery , 2022 .

[10]  Marco Tagliasacchi,et al.  EZ-VSN: An Open-Source and Flexible Framework for Visual Sensor Networks , 2016, IEEE Internet of Things Journal.

[11]  Huiyu Luo,et al.  Designing Routes for Source Coding With Explicit Side Information in Sensor Networks , 2007, IEEE/ACM Transactions on Networking.

[12]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[13]  Marco Tagliasacchi,et al.  Briskola: BRISK optimized for low-power ARM architectures , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[14]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[15]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  Ling-Yu Duan,et al.  Compact descriptors for mobile visual search and MPEG CDVS standardization , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[18]  Ian F. Akyildiz,et al.  Visual correlation-based image gathering for wireless multimedia sensor networks , 2011, 2011 Proceedings IEEE INFOCOM.

[19]  Allen Y. Yang,et al.  Towards an efficient distributed object recognition system in wireless smart camera networks , 2010, 2010 13th International Conference on Information Fusion.

[20]  Bernd Girod,et al.  Mobile Visual Search , 2011, IEEE Signal Processing Magazine.

[21]  Andrew Zisserman,et al.  Scene Classification Using a Hybrid Generative/Discriminative Approach , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Ian F. Akyildiz,et al.  Collaborative Data Compression Using Clustered Source Coding for Wireless Multimedia Sensor Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[23]  Marco Tagliasacchi,et al.  Compress-then-analyze vs. analyze-then-compress: Two paradigms for image analysis in visual sensor networks , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[24]  Marco Tagliasacchi,et al.  Multi-view coding of local features in visual sensor networks , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[25]  Mario Gerla,et al.  Vehicle location service scheme based on road map in Vehicular Sensor Networks , 2017, Comput. Networks.

[26]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[27]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[28]  Mario Gerla,et al.  Polycast: A new paradigm for information-centric data delivery in heterogeneous mobile fog networks , 2017, Int. J. Distributed Sens. Networks.

[29]  Marco Tagliasacchi,et al.  Compress-then-Analyze versus Analyze-then-Compress: What Is Best in Visual Sensor Networks? , 2016, IEEE Transactions on Mobile Computing.

[30]  Chang Wen Chen,et al.  Joint Coding/Routing Optimization for Distributed Video Sources in Wireless Visual Sensor Networks , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Marco Tagliasacchi,et al.  Multi-view coding and routing of local features in Visual Sensor Networks , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[32]  Agnieszka C. Miguel,et al.  Finding areas of motion in camera trap images , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[33]  Moad Yassin Mowafi,et al.  A novel approach for extracting spatial correlation of visual information in heterogeneous wireless multimedia sensor networks , 2014, Comput. Networks.

[34]  Ian F. Akyildiz,et al.  A Spatial Correlation Model for Visual Information in Wireless Multimedia Sensor Networks , 2009, IEEE Transactions on Multimedia.

[35]  Stefano Tubaro,et al.  Coding Visual Features Extracted From Video Sequences , 2014, IEEE Transactions on Image Processing.

[36]  Francesca Cuomo,et al.  Leveraging Multiview Video Coding in clustered Multimedia Sensor networks , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).