A concealment method for video communications in an error-prone environment

In this paper, we propose a two-stage error-concealment method for block-based compressed video which was transmitted in an error-prone environment. In the first stage, we obtain initial estimates of the missing blocks. If the motion vectors associated with the missing blocks are available, motion compensation is used to provide good estimates. Otherwise, a novel algorithm which preserves image continuity is used to estimate the blocks. In the second stage, a maximum a posteriori (MAP) estimator, which employs an adaptive Markov random field (MRF) as the image a priori model is used to improve the video reconstruction quality. The adaptive model enables the estimation to incorporate information embedded not only in the immediate neighborhood pixels but also in a wider neighborhood into the reconstruction procedure without increasing the order of the MRF model. The proposed concealment method achieves very good computation-performance tradeoffs, as demonstrated via experimental results.

[1]  Mohammed Ghanbari,et al.  Cell-loss concealment in ATM video codecs , 1993, IEEE Trans. Circuits Syst. Video Technol..

[2]  Wenjun Zeng,et al.  Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[3]  W. Kwok,et al.  Multi-directional interpolation for spatial error concealment , 1993 .

[4]  Rabab Kreidieh Ward,et al.  Reconstruction of motion vector missing macroblocks in H.263 encoded video transmission over lossy networks , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[5]  Teresa H. Y. Meng,et al.  Transform coded image reconstruction exploiting interblock correlation , 1995, IEEE Trans. Image Process..

[6]  R. Talluri,et al.  Error-resilient video coding in the ISO MPEG-4 standard , 1998, IEEE Commun. Mag..

[7]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[9]  Ness B. Shroff,et al.  Error Concealment in Encoded Video Streams , 1998 .

[10]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[11]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.