Error concealment for motion-compensated interpolation

Motion-compensated interpolation is usually employed at the receiver end in order to improve the quality of the video, when a low-bit-rate video is encoded in conjunction with frame dropping. The authors propose a scheme that can exploit the block-based motion vector field available at the decoder to avoid the complex motion estimation. The scheme is based on an iterative refinement technique that employs the finite-element method to efficiently conceal the interpolation errors caused by unfilled holes or overlapped pixels in the predicted frames. As a consequence, no pixel classification is needed in the proposed scheme, thus reducing substantially the computational complexity. The scheme is capable of concealing the errors in the homogeneous regions as well as in regions containing sharp edges. The proposed scheme is simulated with the original frames of a number of test sequences, as well as implemented with the H.264/AVC decoded frames. The results from these extensive simulations show that the proposed scheme results in reconstructed frames having a better visual quality and a lower computational complexity than the existing schemes.

[1]  Zhengguo Li,et al.  A congestion control strategy for multipoint videoconferencing , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[2]  C.-C. Jay Kuo,et al.  Motion-compensated interpolation for low-bit-rate video quality enhancement , 1998, Optics & Photonics.

[3]  Tie-Yan Liu,et al.  Frame interpolation scheme using inertia motion prediction , 2003, Signal Process. Image Commun..

[4]  Roberto Castagno,et al.  A method for motion adaptive frame rate up-conversion , 1996, IEEE Trans. Circuits Syst. Video Technol..

[5]  K. Huebner The finite element method for engineers , 1975 .

[6]  Ness B. Shroff,et al.  A Bayesian approach to error concealment in encoded video streams , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[7]  Holger Blume Nonlinear vector error tolerant interpolation of intermediate video images by weighted medians , 1999, Signal Process. Image Commun..

[8]  J. Z. Zhu,et al.  The finite element method , 1977 .

[9]  Nikolas P. Galatsanos,et al.  Projection-based spatially adaptive reconstruction of block-transform compressed images , 1995, IEEE Trans. Image Process..

[10]  John W. Woods,et al.  Frame-rate up-conversion using transmitted motion and segmentation fields for very low bit-rate video coding , 1997, Proceedings of International Conference on Image Processing.

[11]  C.-C. Jay Kuo,et al.  Spatial and Temporal Error Concealment Techniques for Video Transmission Over Noisy Channels , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Robert THOMA,et al.  Motion compensating interpolation considering covered and uncovered background , 1989, Signal Process. Image Commun..

[13]  Ioannis Pitas,et al.  MPEG-2 error concealment based on block-matching principles , 2000, IEEE Trans. Circuits Syst. Video Technol..

[14]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[15]  Zheng Zhou,et al.  A new algorithm for motion-compensated frame interpolation , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[16]  K. Kawaguchi,et al.  Frame rate up-conversion considering multiple motion , 1997, Proceedings of International Conference on Image Processing.

[17]  Stefano Tubaro,et al.  Motion compensated image interpolation , 1990, IEEE Trans. Commun..

[18]  Ioannis Pitas,et al.  Digital Image Processing Algorithms and Applications , 2000 .

[19]  W. Kwok,et al.  Multi-directional interpolation for spatial error concealment , 1993 .