Enhancing lifetime of visual sensor networks with a preprocessing-based multi-face detection method

Recently, advances in hardware such as CMOS camera nodes have led to the development of Visual Sensor Networks (VSNs) that process sensed data and transmit the useful information to the base station for completing subsequent tasks. Today, object detection and sending useful information to the base station for object recognition is emerged as an important challenging issue in VSNs. Our investigations show that the face’s information is adequate for completing object recognition. According to literature, many approaches have been proposed for object detection and sending useful information to the base station to be completed subsequent tasks like object recognition. However, in most of them, lack of preprocessing methods in camera nodes causes network to be faced with large volume of data. For example when there is more than one object within the each camera node filed-of-view, conventional works deliver empty spaces among objects to the base station. Also, most of them send whole information about each object to the base station, while sending only face’s information of each object is adequate for completing object recognition. Therefore, in this paper, a preprocessing method in camera nodes named Preprocessing-based Multi-Face Detection (PMFD) is proposed. Our method works based on the extracting bounding box of each object’s face, using Boosting-based face detection algorithm, and sending only the faces’ information to the base station. The simulation results show that PMFD method has acceptable preprocessing time complexity and injects low volume of traffic into the network. Consequently, PMFD method prolongs the network lifetime in comparison with state-of-the-art algorithms.

[1]  Naoki Wakamiya,et al.  Challenging issues in visual sensor networks , 2009, IEEE Wireless Communications.

[2]  Syed Mahfuzul Aziz,et al.  Object extraction scheme and protocol for energy efficient image communication over wireless sensor networks , 2013, Comput. Networks.

[3]  Wendi Heinzelman,et al.  Proceedings of the 33rd Hawaii International Conference on System Sciences- 2000 Energy-Efficient Communication Protocol for Wireless Microsensor Networks , 2022 .

[4]  Lixing Wang,et al.  Design of a Radio Frequency Identification (RFID)-Based Monitoring and Vehicle Management System , 2016 .

[5]  James M. Rehg,et al.  Fast Asymmetric Learning for Cascade Face Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Kiyoharu Aizawa,et al.  Sketch-Based Spatial Queries for the Retrieval of Human Locomotion Patterns in Smart Environments , 2009, Adv. Multim..

[7]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[8]  Ian F. Akyildiz,et al.  Wireless Multimedia Sensor Networks: Applications and Testbeds , 2008, Proceedings of the IEEE.

[9]  Arnaud Doucet,et al.  Bayesian nonparametric image segmentation using a generalized Swendsen-Wang algorithm , 2016, 1602.03048.

[10]  M. Welsh,et al.  Vital Signs Monitoring and Patient Tracking Over a Wireless Network , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[11]  Matt Welsh,et al.  Sensor networks for emergency response: challenges and opportunities , 2004, IEEE Pervasive Computing.

[12]  Najeem Lawal,et al.  Exploration of local and central processing for a wireless camera based sensor node , 2010, ICSES 2010 International Conference on Signals and Electronic Circuits.

[13]  Takeshi Mita,et al.  Joint Haar-like features for face detection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[14]  Martin Reisslein,et al.  A survey of multimedia streaming in wireless sensor networks , 2008, IEEE Communications Surveys & Tutorials.

[15]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  Marco Tagliasacchi,et al.  A visual sensor network for object recognition: Testbed realization , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[17]  Marco Tagliasacchi,et al.  Cooperative image analysis in visual sensor networks , 2015, Ad Hoc Networks.

[18]  Özgür B. Akan,et al.  Multimedia communication in wireless sensor networks , 2005, Ann. des Télécommunications.

[19]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[20]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[21]  Paul A. Viola,et al.  Boosting Image Retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[22]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[23]  György Dán,et al.  Prediction-based load control and balancing for feature extraction in visual sensor networks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[25]  Vijay Vaidehi,et al.  Target tracking using Interactive Multiple Model for Wireless Sensor Network , 2016, Inf. Fusion.

[26]  David J. Brady,et al.  Tracking and imaging humans on heterogeneous infrared sensor arrays for law enforcement applications , 2002, SPIE Defense + Commercial Sensing.

[27]  Chong Wang,et al.  New Object Detection, Tracking, and Recognition Approaches for Video Surveillance Over Camera Network , 2015, IEEE Sensors Journal.

[28]  A. Thorstensson,et al.  Adaptations to changing speed in human locomotion: speed of transition between walking and running. , 1987, Acta physiologica Scandinavica.

[29]  Paolo Braca,et al.  Adaptive Bayesian tracking with unknown time-varying sensor network performance , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Yihua Tan,et al.  Effective Gaussian mixture learning and shadow suppression for video foreground segmentation , 2007, International Symposium on Multispectral Image Processing and Pattern Recognition.

[31]  Wendi B. Heinzelman,et al.  A Survey of Visual Sensor Networks , 2009, Adv. Multim..

[32]  Rekha Jain,et al.  Wireless Sensor Network -A Survey , 2013 .

[33]  V. Vaidehi,et al.  Multiclass object detection system in imaging sensor network using Haar-like features and Joint-Boosting algorithm , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[34]  Matt Welsh,et al.  Deploying a wireless sensor network on an active volcano , 2006, IEEE Internet Computing.

[35]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[36]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[37]  H. Kenchannavar,et al.  ENERGY EFFICIENT DATA PROCESSING IN VISUAL SENSOR NETWORK , 2010 .

[38]  Jungkyun Oh,et al.  Wireless Hydrogen Smart Sensor Based on Pt/Graphene-Immobilized Radio-Frequency Identification Tag. , 2015, ACS nano.

[39]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[40]  M. Cesana,et al.  Object recognition in visual sensor networks based on compression and transmission of binary local features , 2014 .

[41]  Narayanan Vijaykrishnan,et al.  A parallel architecture for hardware face detection , 2006, IEEE Computer Society Annual Symposium on Emerging VLSI Technologies and Architectures (ISVLSI'06).

[42]  Yong Wang,et al.  Automatic node selection and target tracking in wireless camera sensor networks , 2014, Comput. Electr. Eng..