A survey on wireless multimedia sensor networks

The availability of low-cost hardware such as CMOS cameras and microphones has fostered the development of Wireless Multimedia Sensor Networks (WMSNs), i.e., networks of wirelessly interconnected devices that are able to ubiquitously retrieve multimedia content such as video and audio streams, still images, and scalar sensor data from the environment. In this paper, the state of the art in algorithms, protocols, and hardware for wireless multimedia sensor networks is surveyed, and open research issues are discussed in detail. Architectures for WMSNs are explored, along with their advantages and drawbacks. Currently off-the-shelf hardware as well as available research prototypes for WMSNs are listed and classified. Existing solutions and open research issues at the application, transport, network, link, and physical layers of the communication protocol stack are investigated, along with possible cross-layer synergies and optimizations.

[1]  Özgür B. Akan,et al.  Event-to-sink reliable transport in wireless sensor networks , 2005, IEEE/ACM Transactions on Networking.

[2]  Hamid Aghajan,et al.  Development of a Mote for Wireless Image Sensor Networks , 2006 .

[3]  Rui Zhang,et al.  Wyner-Ziv coding for video: applications to compression and error resilience , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[4]  Prashant J. Shenoy,et al.  SensEye: a multi-tier camera sensor network , 2005, ACM Multimedia.

[5]  Ian F. Akyildiz,et al.  Energy efficiency based packet size optimization in wireless sensor networks , 2003, Proceedings of the First IEEE International Workshop on Sensor Network Protocols and Applications, 2003..

[6]  Mani B. Srivastava,et al.  Node-Level Energy Management for Sensor Networks in the Presence of Multiple Applications , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[7]  Nitin H. Vaidya,et al.  Capacity of multi-channel wireless networks: impact of number of channels and interfaces , 2005, MobiCom '05.

[8]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[9]  Srinivasan Seshan,et al.  A Distributed Filtering Architecture for Multimedia Sensors , 2004 .

[10]  Prashant J. Shenoy,et al.  The case for multi--tier camera sensor networks , 2005, NOSSDAV '05.

[11]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[12]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.

[13]  Wu-chi Feng,et al.  Dissecting the video sensing landscape , 2005, NOSSDAV '05.

[14]  Bernd Girod,et al.  Distributed rate allocation for multi-stream video transmission over ad hoc networks , 2005, IEEE International Conference on Image Processing 2005.

[15]  Mani B. Srivastava,et al.  Energy efficient wireless packet scheduling and fair queuing , 2004, TECS.

[16]  Deepa Kundur,et al.  Lightweight security principles for distributed multimedia based sensor networks , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[17]  Koen Langendoen,et al.  An adaptive energy-efficient MAC protocol for wireless sensor networks , 2003, SenSys '03.

[18]  Mohamed F. Younis,et al.  An energy-aware QoS routing protocol for wireless sensor networks , 2003, 23rd International Conference on Distributed Computing Systems Workshops, 2003. Proceedings..

[19]  Adam Dunkels,et al.  Distributed tcp caching for wireless sensor networks , 2004 .

[20]  David E. Culler,et al.  Reliable transfer on wireless sensor networks , 2004, 2004 First Annual IEEE Communications Society Conference on Sensor and Ad Hoc Communications and Networks, 2004. IEEE SECON 2004..

[21]  Deborah Estrin,et al.  Localization in sensor networks , 2004 .

[22]  Joseph A. Paradiso,et al.  Energy scavenging for mobile and wireless electronics , 2005, IEEE Pervasive Computing.

[23]  Deborah Estrin,et al.  An energy-efficient MAC protocol for wireless sensor networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[24]  Martin Reisslein,et al.  A survey of multimedia streaming in wireless sensor networks , 2008, IEEE Communications Surveys & Tutorials.

[25]  Anuj Batra,et al.  Multi-band OFDM Physical Layer Proposal , 2003 .

[26]  Srinivasan Seshan,et al.  IrisNet: an internet-scale architecture for multimedia sensors , 2005, MULTIMEDIA '05.

[27]  Gregory J. Pottie,et al.  Development platform for self-organizing wireless sensor networks , 1999, Defense, Security, and Sensing.

[28]  Lothar Thiele,et al.  Internal synchronization of drift-constraint clocks in ad-hoc sensor networks , 2004, MobiHoc '04.

[29]  T.C. Green,et al.  Architectures for vibration-driven micropower generators , 2004, Journal of Microelectromechanical Systems.

[30]  Sandeep S. Kulkarni,et al.  TDMA service for sensor networks , 2004, 24th International Conference on Distributed Computing Systems Workshops, 2004. Proceedings..

[31]  Xiao Qin,et al.  PARM: A Power-Aware Message Scheduling Algorithm for Real-Time Wireless Networks , 2008, 2008 11th IEEE International Conference on Computational Science and Engineering - Workshops.

[32]  Ian F. Akyildiz,et al.  Cross-Layer Quality of Service Support for UWB Wireless Multimedia Sensor Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[33]  Elza Erkip,et al.  Power efficient multimedia communication over wireless channels , 2003, IEEE J. Sel. Areas Commun..

[34]  Roberto Manduchi,et al.  Characterizing energy consumption in a visual sensor network testbed , 2006, 2nd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, 2006. TRIDENTCOM 2006..

[35]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[36]  Douglas M. Blough,et al.  Distributed Global Identification for Sensor Networks , 2005 .

[37]  Frank Zhao,et al.  Distributed Attention for Large Video Sensor Networks , 2004 .

[38]  Dharma P. Agrawal,et al.  CMAC - A multi-channel energy efficient MAC for wireless sensor networks , 2006, IEEE Wireless Communications and Networking Conference, 2006. WCNC 2006..

[39]  Mohamed F. Younis,et al.  A survey on routing protocols for wireless sensor networks , 2005, Ad Hoc Networks.

[40]  Eduardo Freire Nakamura,et al.  BeanWatcher: A Tool to Generate Multimedia Monitoring Applications for Wireless Sensor Networks , 2003, MMNS.

[41]  R. Srikant,et al.  Fair scheduling in wireless packet networks , 1999, TNET.

[42]  D. Reschke,et al.  Dynamic Packet Size Mechanism ( DPSM ) for Multimedia in Wireless networks , 2002 .

[43]  Ioannis Stavrakakis,et al.  Delivering QoS requirements to traffic with diverse delay tolerances in a TDMA environment , 1999, TNET.

[44]  Andreas F. Molisch,et al.  Localization via Ultra- Wideband Radios , 2005 .

[45]  JAMAL N. AL-KARAKI,et al.  Routing techniques in wireless sensor networks: a survey , 2004, IEEE Wireless Communications.

[46]  Naoki Wakamiya,et al.  Implementation of Video Transfer with TCP-friendly Rate Control Protocol , 2000 .

[47]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .

[48]  Nitin H. Vaidya,et al.  A MAC protocol to reduce sensor network energy consumption using a wakeup radio , 2005, IEEE Transactions on Mobile Computing.

[49]  Shashidhar Gandham,et al.  STCP: a generic transport layer protocol for wireless sensor networks , 2005, Proceedings. 14th International Conference on Computer Communications and Networks, 2005. ICCCN 2005..

[50]  Wu-chi Feng,et al.  Panoptes: scalable low-power video sensor networking technologies , 2003, ACM Multimedia.

[51]  Deborah Estrin,et al.  Deep Vision: Experiments in Exploiting Vision in Wireless Sensor Networks , 2005 .

[52]  Andrea J. Goldsmith,et al.  Cross-layer design of ad hoc networks for real-time video streaming , 2005, IEEE Wireless Communications.

[53]  Mung Chiang,et al.  Balancing transport and physical Layers in wireless multihop networks: jointly optimal congestion control and power control , 2005, IEEE Journal on Selected Areas in Communications.

[54]  Deborah Estrin,et al.  Cyclops: in situ image sensing and interpretation in wireless sensor networks , 2005, SenSys '05.

[55]  Deborah Estrin,et al.  Medium access control with coordinated adaptive sleeping for wireless sensor networks , 2004, IEEE/ACM Transactions on Networking.

[56]  Mani B. Srivastava,et al.  Topology management for sensor networks: exploiting latency and density , 2002, MobiHoc '02.

[57]  Özgür B. Akan,et al.  Spatio-temporal correlation: theory and applications for wireless sensor networks , 2004, Comput. Networks.

[58]  Mani B. Srivastava,et al.  Optimizing Sensor Networks in the Energy-Latency-Density Design Space , 2002, IEEE Trans. Mob. Comput..

[59]  David E. Culler,et al.  Perpetual environmentally powered sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[60]  Zhaohui Wu,et al.  A TCP/IP implementation for wireless sensor networks , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[61]  Christopher Taylor,et al.  Localization in Sensor Networks , 2005, Handbook of Sensor Networks.

[62]  Jan M. Rabaey,et al.  Low power distributed MAC for ad hoc sensor radio networks , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[63]  Zixiang Xiong,et al.  Distributed source coding for sensor networks , 2004, IEEE Signal Processing Magazine.

[64]  Wendi B. Heinzelman,et al.  Sensor management policies to provide application QoS , 2003, Ad Hoc Networks.

[65]  W.B. Heinzelman,et al.  On the coverage problem in video-based wireless sensor networks , 2005, 2nd International Conference on Broadband Networks, 2005..

[66]  Dario Pompili,et al.  On the interdependence of distributed topology control and geographical routing in ad hoc and sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[67]  K. Lin,et al.  Sdlib: a sensor network data and communications library for rapid and robust application development , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[68]  R. Holman,et al.  Estimation of wave phase speed and nearshore bathymetry from video imagery , 2000 .

[69]  John Heidemann,et al.  RMST: reliable data transport in sensor networks , 2003, Proceedings of the First IEEE International Workshop on Sensor Network Protocols and Applications, 2003..

[70]  M. van der Schaar,et al.  Cross-layer wireless multimedia transmission: challenges, principles, and new paradigms , 2005, IEEE Wireless Communications.

[71]  Thomas D. C. Little.  A framework for synchronous delivery of time-dependent multimedia data , 2005, Multimedia Systems.

[72]  Jeffrey Hugh Reed.  Introduction to ultra wideband communication systems, an , 2005 .

[73]  Jean-Yves Le Boudec,et al.  Network Calculus , 2001, Lecture Notes in Computer Science.

[74]  Ian F. Akyildiz,et al.  Cross-Layer Analysis of Error Control in Wireless Sensor Networks , 2006, 2006 3rd Annual IEEE Communications Society on Sensor and Ad Hoc Communications and Networks.

[75]  Chieh-Yih Wan,et al.  PSFQ: a reliable transport protocol for wireless sensor networks , 2002, WSNA '02.

[76]  Joel Koshy,et al.  VMSTAR: synthesizing scalable runtime environments for sensor networks , 2005, SenSys '05.

[77]  Bernd Girod,et al.  Towards practical Wyner-Ziv coding of video , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[78]  Adam Dunkels,et al.  Making TCP/IP Viable for Wireless Sensor Networks , 2004 .

[79]  Raghupathy Sivakumar,et al.  ATP: a reliable transport protocol for ad hoc networks , 2003, IEEE Transactions on Mobile Computing.

[80]  Qun Li,et al.  Global clock synchronization in sensor networks , 2006, IEEE Transactions on Computers.

[81]  Aggelos K. Katsaggelos,et al.  Joint source coding and transmission power management for energy efficient wireless video communications , 2002, IEEE Trans. Circuits Syst. Video Technol..

[82]  K. Yeung,et al.  802 . 11 a Modeling and MAC Enhancements for High Speed Rate Adaptive Networks , 2002 .

[83]  Ajay D. Kshemkalyani,et al.  Clock synchronization for wireless sensor networks: a survey , 2005, Ad Hoc Networks.

[84]  Chieh-Yih Wan,et al.  CODA: congestion detection and avoidance in sensor networks , 2003, SenSys '03.

[85]  Rui Zhang,et al.  Advances in channel-adaptive video streaming , 2002, Wirel. Commun. Mob. Comput..

[86]  Sathya Narayanan,et al.  MRTP: a multiflow real-time transport protocol for ad hoc networks , 2006, IEEE Transactions on Multimedia.

[87]  Moe Z. Win,et al.  Ultra-wide bandwidth time-hopping spread-spectrum impulse radio for wireless multiple-access communications , 2000, IEEE Trans. Commun..

[88]  Sébastien Tixeuil,et al.  A Distributed TDMA Slot Assignment Algorithm for Wireless Sensor Networks , 2004, ALGOSENSORS.

[89]  John Stanley,et al.  Applying Video Sensor Networks to Nearshore Environment Monitoring , 2003, IEEE Pervasive Comput..

[90]  V. C. Gungor,et al.  A Real-Time and Reliable Transport (RT)$^{2}$ Protocol for Wireless Sensor and Actor Networks , 2008, IEEE/ACM Transactions on Networking.

[91]  Bruce Perry.  Ajax hacks , 2006 .

[92]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[93]  Chang-Gun Lee,et al.  MMSPEED: multipath Multi-SPEED protocol for QoS guarantee of reliability and. Timeliness in wireless sensor networks , 2006, IEEE Transactions on Mobile Computing.

[94]  Andrea Baiocchi,et al.  Radio resource sharing for ad hoc networking with UWB , 2002, IEEE J. Sel. Areas Commun..

[95]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[96]  R. Cucchiara.  Multimedia surveillance systems , 2005, VSSN@MM.

[97]  Rainer Lienhart,et al.  Position calibration of microphones and loudspeakers in distributed computing platforms , 2005, IEEE Transactions on Speech and Audio Processing.

[98]  Anthony Rowe,et al.  A low cost embedded color vision system , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[99]  David E. Culler,et al.  The nesC language: A holistic approach to networked embedded systems , 2003, PLDI.

[100]  Dharma P. Agrawal,et al.  Data-centric attribute allocation and retrieval (DCAAR) scheme for wireless sensor networks , 2005, IEEE International Conference on Mobile Adhoc and Sensor Systems Conference, 2005..

[101]  Sen-Ching S. Cheung,et al.  Multimedia streaming using multiple TCP connections , 2005, PCCC 2005. 24th IEEE International Performance, Computing, and Communications Conference, 2005..

[102]  J. Tourrilhes.  Packet frame grouping: improving IP multimedia performance over CSMA/CA , 1998, ICUPC '98. IEEE 1998 International Conference on Universal Personal Communications. Conference Proceedings (Cat. No.98TH8384).

[103]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1997, Auton. Robots.

[104]  Wilton R. Abbott,et al.  Network Calculus , 1970 .

[105]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[106]  Dario Pompili,et al.  A Communication Architecture for Mobile Wireless Sensor and Actor Networks , 2006, 2006 3rd Annual IEEE Communications Society on Sensor and Ad Hoc Communications and Networks.

[107]  Gregory J. Pottie,et al.  Wireless integrated network sensors , 2000, Commun. ACM.

[108]  Prasant Mohapatra,et al.  Medium access control in wireless sensor networks , 2007, Comput. Networks.

[109]  Ioannis Stavrakakis,et al.  Study of various TDMA schemes for wireless networks in the presence of deadlines and overhead , 1999, IEEE J. Sel. Areas Commun..

[110]  Anthony Vetro,et al.  Energy efficient JPEG 2000 image transmission over wireless sensor networks , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[111]  Andrea J. Goldsmith,et al.  Energy-delay tradeoffs for data collection in TDMA-based sensor networks , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[112]  Ian F. Akyildiz,et al.  NeXt generation/dynamic spectrum access/cognitive radio wireless networks: A survey , 2006, Comput. Networks.

[113]  Rene L. Cruz,et al.  A calculus for network delay, Part I: Network elements in isolation , 1991, IEEE Trans. Inf. Theory.

[114]  Jörg Widmer,et al.  A joint PHY/MAC architecture for low-radiated power TH-UWB wireless ad hoc networks: Research Articles , 2005 .

[115]  William A. Arbaugh,et al.  Weighted coloring based channel assignment for WLANs , 2005, MOCO.

[116]  Thinh Nguyen,et al.  Multimedia streaming using multiple TCP connections , 2005, PCCC 2005. 24th IEEE International Performance, Computing, and Communications Conference, 2005..

[117]  Ian F. Akyildiz,et al.  Wireless sensor networks , 2007 .

[118]  Jörg Widmer,et al.  A joint PHY/MAC architecture for low-radiated power TH-UWB wireless ad hoc networks , 2005, Wirel. Commun. Mob. Comput..

[119]  M. Langlois,et al.  Society of Photo-Optical Instrumentation Engineers , 2005 .

[120]  Chenyang Lu,et al.  A spatiotemporal communication protocol for wireless sensor networks , 2005, IEEE Transactions on Parallel and Distributed Systems.

[121]  Huang Lee,et al.  QoS-based geographic routing for event-driven image sensor networks , 2005, 2nd International Conference on Broadband Networks, 2005..

[122]  Dario Pompili,et al.  A distributed coordination framework for wireless sensor and actor networks , 2005, MobiHoc '05.

[123]  Sudharman K. Jayaweera,et al.  Virtual MIMO and distributed signal processing for sensor networks - an integrated approach , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[124]  Moe Z. Win,et al.  Impulse radio: how it works , 1998, IEEE Communications Letters.

[125]  Ian F. Akyildiz,et al.  Wireless sensor and actor networks: research challenges , 2004, Ad Hoc Networks.

[126]  Özgür B. Akan,et al.  Multimedia communication in wireless sensor networks , 2005, Ann. des Télécommunications.

[127]  G.B. Giannakis,et al.  Localization via ultra-wideband radios: a look at positioning aspects for future sensor networks , 2005, IEEE Signal Processing Magazine.

[128]  Sudharman K. Jayaweera,et al.  An energy-efficient virtual MIMO architecture based on V-BLAST processing for distributed wireless sensor networks , 2004, 2004 First Annual IEEE Communications Society Conference on Sensor and Ad Hoc Communications and Networks, 2004. IEEE SECON 2004..

[129]  Georgios B. Giannakis,et al.  Ultra-wideband communications: an idea whose time has come , 2004, IEEE Signal Processing Magazine.