A Survey of Visual Sensor Networks

Visual sensor networks have emerged as an important class of sensor-based distributed intelligent systems, with unique performance, complexity, and quality of service challenges. Consisting of a large number of low-power camera nodes, visual sensor networks support a great number of novel vision-based applications. The camera nodes provide information from a monitored site, performing distributed and collaborative processing of their collected data. Using multiple cameras in the network provides different views of the scene, which enhances the reliability of the captured events. However, the large amount of image data produced by the cameras combined with the network's resource constraints require exploring new means for data processing, communication, and sensor management. Meeting these challenges of visual sensor networks requires interdisciplinary approaches, utilizing vision processing, communications and networking, and embedded processing. In this paper, we provide an overview of the current state-of-the-art in the field of visual sensor networks, by exploring several relevant research directions. Our goal is to provide a better understanding of current research problems in the different research fields of visual sensor networks, and to show how these different research fields should interact to solve the many challenges of visual sensor networks.

[1]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[2]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[3]  Deborah Estrin,et al.  An energy-efficient MAC protocol for wireless sensor networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[4]  K. Obraczka,et al.  Managing the information flow in visual sensor networks , 2002, The 5th International Symposium on Wireless Personal Multimedia Communications.

[5]  Wayne H. Wolf,et al.  Smart Cameras as Embedded Systems , 2002, Computer.

[6]  Leonidas J. Guibas,et al.  Counting people in crowds with a real-time network of simple image sensors , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Chang Wen Chen,et al.  Multiple bitstream image transmission over wireless sensor networks , 2003 .

[8]  Chenyang Lu,et al.  SPEED: a stateless protocol for real-time communication in sensor networks , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[9]  Deborah Estrin,et al.  Scalable Multi-Resolution Storage and Search in Sensor Networks , 2003 .

[10]  W. Feng,et al.  Panoptes: scalable low-power video sensor networking technologies , 2003, ACM Multimedia.

[11]  Bhaskar Krishnamachari,et al.  An adaptive energy-efficient and low-latency MAC for data gathering in wireless sensor networks , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[12]  Zixiang Xiong,et al.  Distributed source coding for sensor networks , 2004, IEEE Signal Processing Magazine.

[13]  Paolo Remagnino,et al.  Distributed intelligence for multi-camera visual surveillance , 2004, Pattern Recognit..

[14]  Leonidas J. Guibas,et al.  Sensor Tasking for Occupancy Reasoning in a Network of Cameras , 2004 .

[15]  Chunming Qiao,et al.  Medium access control with a dynamic duty cycle for sensor networks , 2004, 2004 IEEE Wireless Communications and Networking Conference (IEEE Cat. No.04TH8733).

[16]  Aggelos K. Katsaggelos,et al.  Optimal sensor selection for video-based target tracking in a wireless sensor network , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[17]  Camillo J. Taylor.  A scheme for calibrating smart camera networks using active lights , 2004, SenSys '04.

[18]  William G. Griswold,et al.  A systems architecture for ubiquitous video , 2005, MobiSys '05.

[19]  Jennifer C. Hou,et al.  Maintaining Sensing Coverage and Connectivity in Large Sensor Networks , 2005, Ad Hoc Sens. Wirel. Networks.

[20]  Kay Römer,et al.  Time Synchronization and Calibration in Wireless Sensor Networks , 2005, Handbook of Sensor Networks.

[21]  Oliver Schreer,et al.  3D Videocommunication: Algorithms, concepts and real-time systems in human centred communication , 2005 .

[22]  W.B. Heinzelman,et al.  On the coverage problem in video-based wireless sensor networks , 2005, 2nd International Conference on Broadband Networks, 2005..

[23]  Chieh-Yih Wan,et al.  Pump-slowly, fetch-quickly (PSFQ): a reliable transport protocol for sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[24]  Deborah Estrin,et al.  Multiresolution storage and search in sensor networks , 2005, TOS.

[25]  Deborah Estrin,et al.  Cyclops: in situ image sensing and interpretation in wireless sensor networks , 2005, SenSys '05.

[26]  Prashant J. Shenoy,et al.  The case for multi--tier camera sensor networks , 2005, NOSSDAV '05.

[27]  Luigi Ferrigno,et al.  Balancing computational and transmission power consumption in wireless image sensor networks , 2005, IEEE Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2005..

[28]  Wu-chi Feng,et al.  Panoptes: scalable low-power video sensor networking technologies , 2003, ACM Multimedia.

[29]  Prashant J. Shenoy,et al.  SensEye: a multi-tier camera sensor network , 2005, ACM Multimedia.

[30]  Klara Nahrstedt,et al.  A bandwidth management framework for wireless camera array , 2005, NOSSDAV '05.

[31]  Hamid K. Aghajan,et al.  WiSNAP: a wireless image sensor network application platform , 2006, 2nd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, 2006. TRIDENTCOM 2006..

[32]  Teresa H. Ko,et al.  On Scaling Distributed Low-Power Wireless Image Sensors , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[33]  Eugenio Culurciello,et al.  A Lightweight Camera Sensor Network Operating on Symbolic Information , 2006 .

[34]  Michael W. Marcellin,et al.  A method for coordinating the distributed transmission of imagery , 2006, IEEE Transactions on Image Processing.

[35]  Roberto Manduchi,et al.  Energy Consumption Tradeoffs in Visual Sensor Networks , 2006 .

[36]  Dimitrios Lymberopoulos,et al.  Sensor Localization and Camera Calibration in Distributed Camera Sensor Networks , 2006, 2006 3rd International Conference on Broadband Communications, Networks and Systems.

[37]  Hamid K. Aghajan,et al.  Color-Based Multiple Agent Tracking for Wireless Image Sensor Networks , 2006, ACIVS.

[38]  Chang-Gun Lee,et al.  MMSPEED: multipath Multi-SPEED protocol for QoS guarantee of reliability and. Timeliness in wireless sensor networks , 2006, IEEE Transactions on Mobile Computing.

[39]  C. Guestrin,et al.  Distributed localization of networked cameras , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[40]  Mihaela van der Schaar,et al.  Cross-Layer Optimized Video Streaming Over Wireless Multihop Mesh Networks , 2006, IEEE Journal on Selected Areas in Communications.

[41]  Haeyong Chung,et al.  Distributed metric calibration of ad hoc camera networks , 2006, TOSN.

[42]  Sheikh Iqbal Ahamed,et al.  A survey of middleware for sensor network and challenges , 2006, 2006 International Conference on Parallel Processing Workshops (ICPPW'06).

[43]  Gang Zhou,et al.  VigilNet: An integrated sensor network system for energy-efficient surveillance , 2006, TOSN.

[44]  Alhussein A. Abouzeid,et al.  Error resilient image transport in wireless sensor networks , 2006, Comput. Networks.

[45]  Rahul Sukthankar,et al.  Distributed localization of networked cameras , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[46]  L. Guibas,et al.  Camera Network Node Selection for Target Localization in the Presence of Occlusions , 2006 .

[47]  David S. Munro,et al.  Middleware for video surveillance networks , 2006, MidSens '06.

[48]  Roberto Manduchi,et al.  Characterizing energy consumption in a visual sensor network testbed , 2006, 2nd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, 2006. TRIDENTCOM 2006..

[49]  Anthony Rowe,et al.  RT-Link: A Time-Synchronized Link Protocol for Energy- Constrained Multi-hop Wireless Networks , 2006, 2006 3rd Annual IEEE Communications Society on Sensor and Ad Hoc Communications and Networks.

[50]  A. Kak,et al.  A Look-up Table Based Approach for Solving the Camera Selection Problem in Large Camera Networks , 2006 .

[51]  Bernhard Rinner,et al.  Embedded Middleware on Distributed Smart Cameras , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[52]  Wendi B. Heinzelman,et al.  Camera selection in visual sensor networks , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[53]  Nicolas Krommenacker,et al.  Energy-Efficient Transmission of Wavelet-Based Images in Wireless Sensor Networks , 2007, EURASIP J. Image Video Process..

[54]  Hamid K. Aghajan,et al.  Application-Oriented Design of Smart Camera Networks , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[55]  Hamid Sharif,et al.  Adaptive Image Transmission with P-V Diversity in Multihop Wireless Mesh Networks , 2007 .

[56]  Wolfgang Straßer,et al.  Adaptive Probabilistic Tracking Embedded in Smart Cameras for Distributed Surveillance in a 3D Model , 2007, EURASIP J. Embed. Syst..

[57]  Radu Marculescu,et al.  Coordinated Distributed Power Management with Video Sensor Networks: Analysis, Simulation, and Prototyping , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[58]  Victor C. M. Leung,et al.  Applications and design issues for mobile agents in wireless sensor networks , 2007, IEEE Wireless Communications.

[59]  Deokwoo Jung,et al.  Model-Based Design Exploration of Wireless Sensor Node Lifetimes , 2007, EWSN.

[60]  Anthony Rowe,et al.  FireFly Mosaic: A Vision-Enabled Wireless Sensor Networking System , 2007, 28th IEEE International Real-Time Systems Symposium (RTSS 2007).

[61]  Henry Medeiros,et al.  A Light-Weight Event-Driven Protocol for Sensor Clustering in Wireless Camera Networks , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[62]  Victor C. M. Leung,et al.  Directional geographical routing for real-time video communications in wireless sensor networks , 2007, Comput. Commun..

[63]  Anthony Rowe,et al.  CMUcam3: An Open Programmable Embedded Vision Sensor , 2007 .

[64]  Anthony Rowe,et al.  FireFly Mosaic: A Vision-Enabled Wireless Sensor Networking System , 2007, RTSS 2007.

[65]  Victor C. M. Leung,et al.  Mobile Agent-Based Directed Diffusion in Wireless Sensor Networks , 2007, EURASIP J. Adv. Signal Process..

[66]  Mihaela van der Schaar,et al.  Cross-Layer Packetization and Retransmission Strategies for Delay-Sensitive Wireless Multimedia Transmission , 2007, IEEE Transactions on Multimedia.

[67]  Sufen Fong,et al.  MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[68]  Kay Römer,et al.  Facet: towards a smart camera network of mobile phones , 2007, AUTONOMICS 2007.

[69]  Bhaskar Krishnamachari,et al.  Minimum latency joint scheduling and routing in wireless sensor networks , 2007, Ad Hoc Networks.

[70]  Facet: towards a smart camera network of mobile phones , 2007, Autonomics.

[71]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[72]  Chen Wu,et al.  From Distributed Vision Networks to Human Behavior Interpretation , 2007, BMI.

[73]  Lui Sha,et al.  The Simplex Reference Model: Limiting Fault-Propagation Due to Unreliable Components in Cyber-Physical System Architectures , 2007, RTSS 2007.

[74]  Celal Ceken.  An energy efficient and delay sensitive centralized MAC protocol for wireless sensor networks , 2008, Comput. Stand. Interfaces.

[75]  Martin Reisslein,et al.  A survey of multimedia streaming in wireless sensor networks , 2008, IEEE Communications Surveys & Tutorials.

[76]  Moufida Maimour,et al.  Load repartition for congestion control in multimedia wireless sensor networks with multipath routing , 2008, 2008 3rd International Symposium on Wireless Pervasive Computing.

[77]  Naoki Wakamiya,et al.  Challenging issues in visual sensor networks , 2009, IEEE Wireless Communications.

[78]  António de Sousa.  Smart Cameras in Embedded Systems , 2020 .