An effiicient full frame algorithm for object-based error concealment in 3D depth-based video

In real-time video transmission, the loss of packet results in visual quality degraded for the succeeding frames. This paper proposes an efficient full frame algorithm for depth-based 3-D videos. Each frame can be regarded as combination of objects. True motion estimation (TME) and depth map are exploited to calculate the motion vector (MV) for each object. In this paper, the object is defined as the pixels with the same MV and similar depth value. The object-based MV can extrapolate each object in reference frame to reconstruct the damage frame. In the consideration of computational complexity, in this method, only the high frequency regions need to execute TME. In this paper, we provide a new method to obtain the objects according to temporal and depth information. From the simulation results, our algorithm gives better visual quality and PSNR in most case with lower complexity.

[1]  Yi Liu,et al.  Multi-frame error concealment for H.264/AVC frames with complexity adaptation , 2008, IEEE Transactions on Consumer Electronics.

[2]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[3]  Zhou Wang,et al.  Best neighborhood matching: an information loss restoration technique for block-based image coding systems , 1998, IEEE Trans. Image Process..

[4]  Chuen-Ching Wang,et al.  A Multi-Pass True Motion Estimation Scheme With Motion Vector Propagation for Frame Rate Up-Conversion Applications , 2008, Journal of Display Technology.

[5]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[6]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[7]  Ming-Chieh Chi,et al.  Temporal error concealment algorithm by recursive block-matching principle , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Bo Yan A Novel H.264 Based Motion Vector Recovery Method for 3D Video Transmission , 2007, IEEE Transactions on Consumer Electronics.

[9]  Jin Wang,et al.  Depth Image-Based Temporal Error Concealment for 3-D Video Transmission , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Zhenyu Wu,et al.  An error concealment scheme for entire frame losses based on H.264/AVC , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[11]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[12]  Ioannis Pitas,et al.  MPEG-2 error concealment based on block-matching principles , 2000, IEEE Trans. Circuits Syst. Video Technol..

[13]  Bo Yan,et al.  Efficient Frame Concealment for Depth Image-Based 3-D Video Transmission , 2012, IEEE Transactions on Multimedia.

[14]  C.-C.J. Kuo,et al.  Video error concealment with outer and inner boundary matching algorithms , 2007, SPIE Optical Engineering + Applications.