Wireless Multimedia Sensor Networks: Current Trends and Future Directions

Wireless Multimedia Sensor Networks (WMSNs) have emerged and shifted the focus from the typical scalar wireless sensor networks to networks with multimedia devices that are capable to retrieve video, audio, images, as well as scalar sensor data. WMSNs are able to deliver multimedia content due to the availability of inexpensive CMOS cameras and microphones coupled with the significant progress in distributed signal processing and multimedia source coding techniques. In this paper, we outline the design challenges of WMSNs, give a comprehensive discussion of the proposed architectures, algorithms and protocols for the different layers of the communication protocol stack for WMSNs, and evaluate the existing WMSN hardware and testbeds. The paper will give the reader a clear view of the state of the art at all aspects of this research area, and shed the light on its main current challenges and future trends. We also hope it will foster discussions and new research ideas among its researchers.

[1]  A. El Saddik,et al.  M-IAR: Biologically Inspired Routing Protocol for Wireless Multimedia Sensor Networks , 2008, 2008 IEEE Instrumentation and Measurement Technology Conference.

[2]  Ian F. Akyildiz,et al.  Cross-Layer Quality of Service Support for UWB Wireless Multimedia Sensor Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[3]  Navrati Saxena,et al.  Dynamic duty cycle and adaptive contention window based QoS-MAC protocol for wireless multimedia sensor networks , 2008, Comput. Networks.

[4]  Gang Zhou,et al.  MMSN: Multi-Frequency Media Access Control for Wireless Sensor Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[5]  Yao Wang,et al.  Multiple Description Coding for Video Delivery , 2005, Proceedings of the IEEE.

[6]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[7]  Navrati Saxena,et al.  A QoS-Based Energy-Aware MAC Protocol for Wireless Multimedia Sensor Networks , 2008, VTC Spring 2008 - IEEE Vehicular Technology Conference.

[8]  Bo Li,et al.  Priority-based congestion control in wireless sensor networks , 2006, IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC'06).

[9]  Moufida Maimour,et al.  Load repartition for congestion control in multimedia wireless sensor networks with multipath routing , 2008, 2008 3rd International Symposium on Wireless Pervasive Computing.

[10]  David E. Culler,et al.  Versatile low power media access for wireless sensor networks , 2004, SenSys '04.

[11]  Michele Magno,et al.  A low-power wireless video sensor node for distributed object detection , 2007, Journal of Real-Time Image Processing.

[12]  Deborah Estrin,et al.  Cyclops: in situ image sensing and interpretation in wireless sensor networks , 2005, SenSys '05.

[13]  Chi Ma,et al.  Battery-Aware Routing for Streaming Data Transmissions in Wireless Sensor Networks , 2005, 2nd International Conference on Broadband Networks, 2005..

[14]  Mihaela van der Schaar,et al.  The MPEG-4 fine-grained scalable video coding method for multimedia streaming over IP , 2001, IEEE Trans. Multim..

[15]  O. Fatemi,et al.  Multimedia-aware MMSPEED: A routing solution for video transmission in WMSN , 2008, 2008 2nd International Symposium on Advanced Networks and Telecommunication Systems.

[16]  Xue Wang,et al.  Compacted Probabilistic Visual Target Classification With Committee Decision in Wireless Multimedia Sensor Networks , 2009, IEEE Sensors Journal.

[17]  A. E. Harmanci,et al.  Performance Comparison of Error Compensation Techniques with Multipath Transmission in Wireless Multimedia Sensor Networks , 2007, 2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[18]  Kameswara Namuduri,et al.  Distributed video coding for wireless sensor networks , 2005 .

[19]  Brad Karp,et al.  GPSR : Greedy Perimeter Stateless Routing for Wireless , 2000, MobiCom 2000.

[20]  Li-Minn Ang,et al.  Survey of image compression algorithms in wireless sensor networks , 2008, 2008 International Symposium on Information Technology.

[21]  Liang Ding,et al.  Collaborative hybrid classifier learning with ant colony optimization in wireless multimedia sensor networks , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[22]  K. Shadan,et al.  Available online: , 2012 .

[23]  Navrati Saxena,et al.  Cross-Layer Algorithms for QoS Enhancement in Wireless Multimedia Sensor Networks , 2008, IEICE Trans. Commun..

[24]  Linnyer Beatrys Ruiz,et al.  A Multi-tier, Multimodal Wireless Sensor Network for Environmental Monitoring , 2007, UIC.

[25]  Prasant Mohapatra,et al.  Medium access control in wireless sensor networks , 2007, Comput. Networks.

[26]  Nitin H. Vaidya,et al.  Multi-channel mac for ad hoc networks: handling multi-channel hidden terminals using a single transceiver , 2004, MobiHoc '04.

[27]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .

[28]  M. Abbaspour,et al.  An Energy-Efficient and High-Quality MAC Protocol for Image Transmission in Wireless Sensor Networks , 2008, 2008 4th IEEE International Conference on Circuits and Systems for Communications.

[29]  Azzedine Boukerche,et al.  A reliable synchronous transport protocol for wireless image sensor networks , 2008, 2008 IEEE Symposium on Computers and Communications.

[30]  Naixue Xiong,et al.  Context-aware cross-layer optimized video streaming in wireless multimedia sensor networks , 2010, The Journal of Supercomputing.

[31]  Anthony Rowe,et al.  FireFly Mosaic: A Vision-Enabled Wireless Sensor Networking System , 2007, 28th IEEE International Real-Time Systems Symposium (RTSS 2007).

[32]  Nicolas Krommenacker,et al.  Energy-efficient image transmission in sensor networks , 2008, Int. J. Sens. Networks.

[33]  August 29-September 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems , 2000, Proceedings 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (Cat. No.PR00728).

[34]  Wenye Wang,et al.  Self-Orienting Wireless Multimedia Sensor Networks for Maximizing Multimedia Coverage , 2008, 2008 IEEE International Conference on Communications.

[35]  Deborah Estrin,et al.  Medium access control with coordinated adaptive sleeping for wireless sensor networks , 2004, IEEE/ACM Transactions on Networking.

[36]  Sajal K. Das,et al.  A Collaboration-based Storage Management Scheme in Multimedia Sensor Networks , 2008, 2008 IEEE/IFIP International Conference on Embedded and Ubiquitous Computing.

[37]  Chenyang Lu,et al.  A spatiotemporal communication protocol for wireless sensor networks , 2005, IEEE Transactions on Parallel and Distributed Systems.

[38]  Syed Ali Khayam,et al.  Energy efficient video compression for wireless sensor networks , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[39]  Azzedine Boukerche,et al.  Reconstructing the Plenoptic function from wireless multimedia sensor networks , 2008, 2008 33rd IEEE Conference on Local Computer Networks (LCN).

[40]  Ian F. Akyildiz,et al.  Wireless multimedia sensor networks: A survey , 2007, IEEE Wireless Communications.

[41]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[42]  Donald A. Adjeroh,et al.  A new priority based congestion control protocol for Wireless Multimedia Sensor Networks , 2008, 2008 International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[43]  Choong Seon Hong,et al.  Design of a QoS-Aware Routing Mechanism for Wireless Multimedia Sensor Networks , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[44]  Hayder Radha,et al.  Practical Distributed Video Coding over visual sensors , 2009, 2009 Picture Coding Symposium.

[45]  Prashant J. Shenoy,et al.  SensEye: a multi-tier camera sensor network , 2005, ACM Multimedia.

[46]  Rajashekhar C. Biradar,et al.  A survey on routing protocols in Wireless Sensor Networks , 2012, 2012 18th IEEE International Conference on Networks (ICON).

[47]  Fotini-Niovi Pavlidou,et al.  UWB Technology to Enhance the Performance of Wireless Multimedia Sensor Networks , 2007, 2007 12th IEEE Symposium on Computers and Communications.

[48]  Wei Wang,et al.  Energy-Aware Adaptive Watermarking for Real-Time Image Delivery in Wireless Sensor Networks , 2008, 2008 IEEE International Conference on Communications.

[49]  Roberto Manduchi,et al.  Characterizing energy consumption in a visual sensor network testbed , 2006, 2nd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, 2006. TRIDENTCOM 2006..

[50]  Robert Ricci,et al.  Mobile Emulab: A Robotic Wireless and Sensor Network Testbed , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[51]  Laurence T. Yang,et al.  Geographic Routing in Wireless Multimedia Sensor Networks , 2008, 2008 Second International Conference on Future Generation Communication and Networking.

[52]  J.-M. Friedt,et al.  Design of embedded sensor platform for multimedia application , 2008, 2008 First International Conference on Distributed Framework and Applications.

[53]  Luca Benini,et al.  An integrated multi-modal sensor network for video surveillance , 2005, VSSN '05.

[54]  JAMAL N. AL-KARAKI,et al.  Routing techniques in wireless sensor networks: a survey , 2004, IEEE Wireless Communications.

[55]  R. Cucchiara Multimedia surveillance systems , 2005, VSSN@MM.

[56]  Hamid Sharif,et al.  Energy-Constrained Distortion Reduction Optimization for Wavelet-Based Coded Image Transmission in Wireless Sensor Networks , 2008, IEEE Transactions on Multimedia.

[57]  Victor C. M. Leung,et al.  Cross-Layer and Path Priority Scheduling Based Real-Time Video Communications over Wireless Sensor Networks , 2008, VTC Spring 2008 - IEEE Vehicular Technology Conference.

[58]  Jianhua Ma,et al.  Cross Layer Optimization for Data Gathering in Wireless Multimedia Sensor Networks within Expected Network Lifetime , 2010, J. Univers. Comput. Sci..

[59]  Hamid K. Aghajan,et al.  WiSNAP: a wireless image sensor network application platform , 2006, 2nd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, 2006. TRIDENTCOM 2006..

[60]  Shashidhar Gandham,et al.  STCP: a generic transport layer protocol for wireless sensor networks , 2005, Proceedings. 14th International Conference on Computer Communications and Networks, 2005. ICCCN 2005..

[61]  Donald A. Adjeroh,et al.  A Model for Differentiated Service Support in Wireless Multimedia Sensor Networks , 2008, 2008 Proceedings of 17th International Conference on Computer Communications and Networks.

[62]  Roberto Manduchi,et al.  A Power-Aware, Self-Managing Wireless Camera Network for, Wide Area Monitoring , 2006 .

[63]  Wu-chi Feng,et al.  Panoptes: scalable low-power video sensor networking technologies , 2003, ACM Multimedia.

[64]  Moufida Maimour,et al.  Maximally radio-disjoint multipath routing for wireless multimedia sensor networks , 2008, WMuNeP '08.

[65]  Hai Jiang,et al.  Network Lifetime Maximization With Node Admission in Wireless Multimedia Sensor Networks , 2009, IEEE Transactions on Vehicular Technology.

[66]  Tracy Camp,et al.  MANET simulation studies: the incredibles , 2005, MOCO.

[67]  Lei Shu,et al.  Transmitting streaming data in wireless multimedia sensor networks with holes , 2007, MUM.

[68]  Deepa Kundur,et al.  Lightweight security principles for distributed multimedia based sensor networks , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[69]  Koen Langendoen,et al.  An adaptive energy-efficient MAC protocol for wireless sensor networks , 2003, SenSys '03.

[70]  E. Culurciello,et al.  Address-event imagers for sensor networks: evaluation and modeling , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[71]  Hayder Radha,et al.  Multipath multi-stream distributed reliable video delivery in Wireless Sensor Networks , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[72]  John Heidemann,et al.  RMST: reliable data transport in sensor networks , 2003, Proceedings of the First IEEE International Workshop on Sensor Network Protocols and Applications, 2003..

[73]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[74]  Mohsen Guizani,et al.  A Cluster Based On-demand Multi-Channel MAC Protocol for Wireless Multimedia Sensor Networks , 2008, 2008 IEEE International Conference on Communications.

[75]  Prashant J. Shenoy,et al.  Snapshot: A Self-Calibration Protocol for Camera Sensor Networks , 2006, 2006 3rd International Conference on Broadband Communications, Networks and Systems.

[76]  Srinivasan Seshan,et al.  IrisNet: an internet-scale architecture for multimedia sensors , 2005, MULTIMEDIA '05.

[77]  Mario Gerla,et al.  Multimedia streaming in large-scale sensor networks with mobile swarms , 2003, SGMD.

[78]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[79]  Ian F. Akyildiz,et al.  A Cross-Layer Solution for Ultrawideband Based Wireless Video Sensor Networks , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[80]  Özgür B. Akan Performance of Transport Protocols for Multimedia Communications in Wireless Sensor Networks , 2007, IEEE Communications Letters.

[81]  Chang-Gun Lee,et al.  MMSPEED: multipath Multi-SPEED protocol for QoS guarantee of reliability and. Timeliness in wireless sensor networks , 2006, IEEE Transactions on Mobile Computing.

[82]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[83]  Chieh-Yih Wan,et al.  CODA: congestion detection and avoidance in sensor networks , 2003, SenSys '03.

[84]  Andreas Savvides,et al.  XYZ: a motion-enabled, power aware sensor node platform for distributed sensor network applications , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[85]  Yannis Manolopoulos,et al.  Cooperative Caching in Wireless Multimedia Sensor Networks , 2007, MobiMedia '07.

[86]  Teresa A. Dahlberg,et al.  Explorebots: a mobile network experimentation testbed , 2005, E-WIND '05.

[87]  Deepa Kundur,et al.  HoLiSTiC: Heterogeneous Lightweight Sensornets for Trusted Visual Computing , 2006, 2006 International Conference on Intelligent Information Hiding and Multimedia.

[88]  H. Balakrishnan,et al.  Mitigating congestion in wireless sensor networks , 2004, SenSys '04.

[89]  Allen Y. Yang,et al.  CITRIC: A low-bandwidth wireless camera network platform , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[90]  Richard P. Kleihorst,et al.  Camera Mote with a High-Performance Parallel Processor for Real-Time Frame-Based Video Processing , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[91]  H. Sharif,et al.  Artificial Immune System based image pattern recognition in energy efficient Wireless Multimedia Sensor Networks , 2008, MILCOM 2008 - 2008 IEEE Military Communications Conference.

[92]  Pai H. Chou,et al.  eCAM: ultra compact, high data-rate wireless sensor node with a miniature camera , 2006, SenSys '06.

[93]  Mohamed F. Younis,et al.  Energy and QoS Aware Routing in Wireless Sensor Networks , 2005, Cluster Computing.

[94]  Eugenio Culurciello,et al.  Address-Event Video Streaming over Wireless Sensor Networks , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[95]  Anthony Rowe,et al.  FireFly: a cross-layer platform for real-time embedded wireless networks , 2007, Real-Time Systems.

[96]  Alvin S. Lim,et al.  Delay-constrained high throughput protocol for multi-path transmission over wireless multimedia sensor networks , 2008, 2008 International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[97]  Yu-Chee Tseng,et al.  iMouse: An Integrated Mobile Surveillance and Wireless Sensor System , 2007, Computer.

[98]  Hamid Aghajan,et al.  Development of a Mote for Wireless Image Sensor Networks , 2006 .

[99]  J. Farah,et al.  Joint Source-Channel Wyner-Ziv Coding in Wireless Video Sensor Networks , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[100]  Anantha Chandrakasan,et al.  Low-power wireless sensor networks , 2001, VLSI Design 2001. Fourteenth International Conference on VLSI Design.

[101]  Bo Li,et al.  A survey of transport protocols for wireless sensor networks , 2006, IEEE Network.

[102]  Huadong Ma,et al.  ASAR: An ant-based service-aware routing algorithm for multimedia sensor networks , 2008 .

[103]  Navrati Saxena,et al.  QuESt: a QoS-based energy efficient sensor routing protocol , 2009, Wirel. Commun. Mob. Comput..

[104]  Deborah Estrin,et al.  Energy-Aware High Resolution Image Acquisition via Heterogeneous Image Sensors , 2007, IEEE Journal of Selected Topics in Signal Processing.

[105]  Allen R. Hanson,et al.  Design and Implementation of a Dual-Camera Wireless Sensor Network for Object Retrieval , 2008, 2008 International Conference on Information Processing in Sensor Networks (ipsn 2008).

[106]  Li Layuan,et al.  Ant-Like Game Routing Algorithm for Wireless Multimedia Sensor Networks , 2008, 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing.

[107]  Ruzena Bajcsy,et al.  Congestion control and fairness for many-to-one routing in sensor networks , 2004, SenSys '04.

[108]  K.D. Wong Physical layer considerations for wireless sensor networks , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[109]  Loren Schwiebert,et al.  Power-Aware Metrics for Wireless Sensor Networks , 2004, IASTED PDCS.

[110]  Ian F. Akyildiz,et al.  Wireless Multimedia Sensor Networks: Applications and Testbeds , 2008, Proceedings of the IEEE.

[111]  Srinivasan Seshan,et al.  A Distributed Filtering Architecture for Multimedia Sensors , 2004 .

[112]  José M. Barceló-Ordinas,et al.  A cluster-based scheduling for object detection in wireless multimedia sensor networks , 2009, Q2SWinet '09.

[113]  Sufen Fong,et al.  MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.