Efficient Frame Concealment for Depth Image-Based 3-D Video Transmission

In depth image-based 3-D video transmission, the compressed video stream is very likely to be corrupted by channel errors. Due to the high compression ratio of H.264/AVC, it is often common that an entire coded picture is packetized into one packet. Thus the loss of a packet may result in the loss of the whole video frame. Currently, most of the frame concealment methods are mainly for 2-D video transmission. In this paper, we have proposed an efficient frame concealment algorithm for depth image-based 3-D video transmission, which is able to provide accurate estimation for the motion vectors of the lost frame with the help of the depth information. Simulation results show that it is highly effective and significantly outperforms other existing frame recovery methods by up to 2.91 dB.

[1]  Enrico Magli,et al.  Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation , 2005, IEEE Transactions on Multimedia.

[2]  Luc Van Gool,et al.  ATTEST: Advanced Three-dimensional Television System Technologies , 2002 .

[3]  Panos Nasiopoulos,et al.  An improved error concealment algorithm for intra-frames in H.264/AVC , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[4]  Bo Yan.  A Novel H.264 Based Motion Vector Recovery Method for 3D Video Transmission , 2007, IEEE Transactions on Consumer Electronics.

[5]  Bo Li,et al.  Coolstreaming: Design, Theory, and Practice , 2007, IEEE Transactions on Multimedia.

[6]  Zhenyu Wu,et al.  An error concealment scheme for entire frame losses based on H.264/AVC , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[7]  Yücel Altunbasak,et al.  Multiframe error concealment for MPEG-coded video delivery over error-prone networks , 2002, IEEE Trans. Image Process..

[8]  Pascal Frossard,et al.  Network Coding of Rateless Video in Streaming Overlays , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Jin Wang,et al.  Depth Image-Based Temporal Error Concealment for 3-D Video Transmission , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Miguel Castro,et al.  Scribe: a large-scale and decentralized application-level multicast infrastructure , 2002, IEEE J. Sel. Areas Commun..

[11]  Qiang Peng,et al.  Block-based temporal error concealment for video packet using motion vector extrapolation , 2002, IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions.

[12]  Gwo-Long Li,et al.  Effective error concealment algorithm of whole frame loss for H.264 video coding standard by recursive motion vector refinement , 2010, IEEE Transactions on Consumer Electronics.

[13]  Jiang Li,et al.  An Error Concealment Algorithm for Entire Frame Loss in Video Transmission , 2004 .

[14]  Chun-Ming Huang,et al.  Error resilience supporting bi-directional frame recovery for video streaming , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[15]  S. Krause,et al.  OverSim: A Flexible Overlay Network Simulation Framework , 2007, 2007 IEEE Global Internet Symposium.

[16]  Chang-Su Kim,et al.  Frame loss concealment for stereoscopic video based on inter-view similarity of motion and intensity difference , 2010, 2010 IEEE International Conference on Image Processing.

[17]  Enrico Magli,et al.  An error concealment algorithm for streaming video , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[18]  László Lovász,et al.  Building scalable and robust peer-to-peer overlay networks for broadcasting using network coding , 2007, PODC '05.

[19]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[20]  Luc Van Gool,et al.  Advanced three-dimensional television system technologies , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[21]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[22]  C. Fehn.  A 3D-TV system based on video plus depth information , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[23]  Hamid Gharavi,et al.  Spatial interpolation algorithm for error concealment , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  Enrico Magli,et al.  A resilient and low-delay P2P streaming system based on network coding with random multicast trees , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.