Frame Loss Concealment for Multiview Video Transmission Over Wireless Multimedia Sensor Networks

In multiview video (MVV) transmission over wireless multimedia sensor networks (WMSNs), a highly compressed video stream is very susceptible to whole-frame losses due to wireless channel errors. Currently, most frame concealment methods can only handle 2-D video or 3-D video with depth, since a lost motion vector can be recovered utilizing the relationship between the color frames and their corresponding depth map. However, depth generation is infeasible in the scenario of WMSNs due to energy constraints and computational limitations of low-power video sensor nodes. In this paper, we tackle the problem of concealing lost whole frames for multiview 3-D video transmission over WMSNs. We propose a new technique, which is capable of dealing with this important problem without the aid of depth map. Experimental results are presented to demonstrate that the proposed algorithm is able to effectively conceal frames of MVV and significantly outperforms other techniques in both objective and subjective quality measurements.

[1]  Bruno Macchiavello,et al.  Loss-Resilient Coding of Texture and Depth for Free-Viewpoint Video Conferencing , 2013, IEEE Transactions on Multimedia.

[2]  Chee Kheong Siew,et al.  Forward Error Correction-Based 2-D Layered Multiple Description Coding for Error-Resilient H.264 SVC Video Transmission , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Limin Liu,et al.  Wyner-Ziv Video Coding using LDPC Codes , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.

[4]  Takuro Sato,et al.  An Intelligent Hybrid MAC With Traffic-Differentiation-Based QoS for Wireless Sensor Networks , 2013, IEEE Sensors Journal.

[5]  Chang-Su Kim,et al.  Frame loss concealment for stereoscopic video plus depth sequences , 2011, IEEE Transactions on Consumer Electronics.

[6]  Martin Reisslein,et al.  A survey of multimedia streaming in wireless sensor networks , 2008, IEEE Communications Surveys & Tutorials.

[7]  A. Chimienti,et al.  Frame concealment for H.264/AVC decoders , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..

[8]  Shuai Yang,et al.  A Whole-Frame Error Concealment Algorithm Based on Optical Flow Estimation in H.264/AVC , 2009, 2009 International Conference on Information Engineering and Computer Science.

[9]  Joohee Kim,et al.  Low-complexity distributed multiple description coding for wireless video sensor networks , 2013, IET Wirel. Sens. Syst..

[10]  Chun-Ming Huang,et al.  Error resilience supporting bi-directional frame recovery for video streaming , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[11]  Feng Wu,et al.  Channel Distortion Modeling for Multi-View Video Transmission Over Packet-Switched Networks , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Kai-Kuang Ma,et al.  Stereoscopic video error concealment for missing frame recovery using disparity-based frame difference projection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[13]  Qiang Peng,et al.  Frame loss concealment for multi-view video plus depth , 2011, 2011 IEEE 15th International Symposium on Consumer Electronics (ISCE).

[14]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[15]  张阳,et al.  Whole Frame Error Concealment with Refined Motion Extrapolation and Prescription at Encoder for H.264/AVC , 2009 .

[16]  Rongke Liu,et al.  Side Information Generation Based on Hierarchical Motion Estimation in Distributed Video Coding , 2009 .

[17]  Enrico Magli,et al.  Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation , 2005, IEEE Transactions on Multimedia.

[18]  Pamela C. Cosman,et al.  Network-Based H.264/AVC Whole-Frame Loss Visibility Model and Frame Dropping Methods , 2012, IEEE Transactions on Image Processing.

[19]  Pavan Turaga,et al.  Diamond Sentry: Integrating Sensors and Cameras for Real-Time Monitoring of Indoor Spaces , 2011, IEEE Sensors Journal.

[20]  Enrico Magli,et al.  Low-delay peer-to-peer media streaming based on network coding over randomized multicast trees , 2012, IEEE Transactions on Multimedia.

[21]  Wen-Chih Chen,et al.  Recovery of Lost Motion Vectors Using Encoded Residual Signals , 2013, IEEE Transactions on Broadcasting.

[22]  Yücel Altunbasak,et al.  Multiframe error concealment for MPEG-coded video delivery over error-prone networks , 2002, IEEE Trans. Image Process..

[23]  Yuan Zhou,et al.  Modeling of Transmission Distortion for Multi-View Video in Packet Lossy Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[24]  J. Hagenauer,et al.  Channel coding and transmission aspects for wireless multimedia , 1999, Proc. IEEE.

[25]  Francesca Cuomo,et al.  An Empirical Model of Multiview Video Coding Efficiency for Wireless Multimedia Sensor Networks , 2013, IEEE Transactions on Multimedia.

[26]  João Ascenso,et al.  Advanced side information creation techniques and framework for Wyner-Ziv video coding , 2008, J. Vis. Commun. Image Represent..

[27]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[28]  Ben-Shung Chow.  A Limited Resources-Based Approach to Coding for Wireless Video Sensor Networks , 2009, IEEE Sensors Journal.

[29]  Hao Chen,et al.  A Novel Frame Error Concealment Algorithm Based on Dynamic Texture Synthesis , 2010, 2010 Data Compression Conference.

[30]  Gwo-Long Li,et al.  Effective error concealment algorithm of whole frame loss for H.264 video coding standard by recursive motion vector refinement , 2010, IEEE Transactions on Consumer Electronics.

[31]  Jing Wu,et al.  A Reliable and High-Bandwidth Multihop Wireless Sensor Network for Mine Tunnel Monitoring , 2009, IEEE Sensors Journal.

[32]  Bo Yan,et al.  Efficient Frame Concealment for Depth Image-Based 3-D Video Transmission , 2012, IEEE Trans. Multimedia.

[33]  Bo Wang,et al.  An improved error concealment scheme for entire frame loss of H.264/AVC , 2009, 2009 International Conference on Multimedia Computing and Systems.

[34]  Chang-Su Kim,et al.  Error Concealment of H.264/AVC Video Frames for Mobile Video Broadcasting , 2007, IEEE Transactions on Consumer Electronics.

[35]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[36]  Haohong Wang,et al.  Video Surveillance Over Wireless Sensor and Actuator Networks Using Active Cameras , 2011, IEEE Transactions on Automatic Control.

[37]  Wen Gao,et al.  A highly effective error concealment method for whole frame loss , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[38]  Ying Chen,et al.  Error Resilient Coding and Error Concealment in Scalable Video Coding , 2009 .