Improved interview video error concealment on whole frame packet loss

Proposed multiview error concealment method is 5.53dB better than latest method.Optimal reference view selection for DIBR (Depth image based rendering) is proposed.The 1-to-1 pixels are chosen, and the light compensation is estimated correctly.The many-to-1 pixels are better estimated with the aid of depth information.Hole pixels are improved efficiently with the neighboring available motion vectors. An improved DIBR-based (Depth image based rendering) whole frame error concealment method for multiview video with depth is designed. An optimal reference view selection is first proposed. The paper further includes three modified parts for the DIBRed pixels. First, the missing 1-to-1 pixels are concealed by the pixels from another view. The light differences between views are taken care of by the information of the motion vector of the projected coordination and a reverse DIBR procedure. Second, the generation of the many-to-1 pixels is improved via their depth information. Third, the hole pixels are found using the estimated motion vectors derived efficiently from a weighted function of the neighboring available motion vectors and their distance to the target hole pixel. The experimental results show that, compared to the state-of-the-art method, the combined system of the four proposed methods is superior and improves the performance by 5.53dB at maximum.

[1]  Yi Liu,et al.  Multi-frame error concealment for H.264/AVC frames with complexity adaptation , 2008, IEEE Transactions on Consumer Electronics.

[2]  Cécile Dufour,et al.  An efficient error concealment implementation for MPEG-4 video streams , 2001, IEEE Trans. Consumer Electron..

[3]  Xueming Qian,et al.  Recovering Connected Error Region Based on Adaptive Error Concealment Order Determination , 2009, IEEE Transactions on Multimedia.

[4]  V. Kamakoti,et al.  Efficient Motion Vector Recovery Algorithm for H.264 Using B-Spline Approximation , 2010, IEEE Transactions on Broadcasting.

[5]  Qiang Peng,et al.  Block-based temporal error concealment for video packet using motion vector extrapolation , 2002, IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions.

[6]  Wen Gao,et al.  Packet Video Error Concealment With Auto Regressive Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Oscar C. Au,et al.  Video Error Concealment Using Spatio-Temporal Boundary Matching and Partial Differential Equation , 2008, IEEE Transactions on Multimedia.

[8]  Bo Yan A Novel H.264 Based Motion Vector Recovery Method for 3D Video Transmission , 2007, IEEE Transactions on Consumer Electronics.

[9]  Shigang Wang,et al.  Error concealment for stereoscopic video using illumination compensation , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[10]  Xiangjian He,et al.  An efficient error concealment algorithm for H.264/AVC using regression modeling-based prediction , 2010, IEEE Transactions on Consumer Electronics.

[11]  Chang-Su Kim,et al.  Frame loss concealment for stereoscopic video plus depth sequences , 2011, IEEE Transactions on Consumer Electronics.

[12]  Lap-Pui Chau,et al.  Efficient motion vector recovery algorithm for H.264 based on a polynomial model , 2005, IEEE Transactions on Multimedia.

[13]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[14]  Yanling Xu,et al.  Adaptive temporal error concealment scheme for H.264/AVC video decoder , 2008, IEEE Transactions on Consumer Electronics.

[15]  Thomas Eriksson,et al.  Packet Video Error Concealment With Gaussian Mixture Models , 2008, IEEE Transactions on Image Processing.

[16]  Gwo-Long Li,et al.  Effective error concealment algorithm of whole frame loss for H.264 video coding standard by recursive motion vector refinement , 2010, IEEE Transactions on Consumer Electronics.

[17]  Liu Da The Error Concealment Feature in the H.26L Test Model , 2003 .

[18]  Bo Yan,et al.  Efficient Motion Vector Interpolation for Error Concealment of H.264/AVC , 2011, IEEE Transactions on Broadcasting.

[19]  Bo Yan,et al.  Efficient Frame Concealment for Depth Image-Based 3-D Video Transmission , 2012, IEEE Trans. Multimedia.

[20]  Ting-Lan Lin,et al.  Multiview video error concealment with improved pixel estimation and illumination compensation , 2013, 2013 International Symposium on Intelligent Signal Processing and Communication Systems.

[21]  Aljoscha Smolic,et al.  View Synthesis for Advanced 3D Video Systems , 2008, EURASIP J. Image Video Process..

[22]  André Kaup,et al.  Inter-Sequence Error Concealment Techniques for Multi-Broadcast TV Reception , 2011, IEEE Transactions on Broadcasting.

[23]  Myounghoon Kim,et al.  Spatial error concealment for H.264 using sequential directional interpolation , 2008, IEEE Transactions on Consumer Electronics.

[24]  Thomas Eriksson,et al.  Mixture Model- and Least Squares-Based Packet Video Error Concealment , 2009, IEEE Transactions on Image Processing.

[25]  Jin Wang,et al.  Depth Image-Based Temporal Error Concealment for 3-D Video Transmission , 2010, IEEE Transactions on Circuits and Systems for Video Technology.