Packet Video Error Concealment With Gaussian Mixture Models

In this paper, Gaussian mixture modeling is applied to error concealment for block-based packet video. A Gaussian mixture model for video data is obtained offline and is thereafter utilized online in order to restore lost blocks from spatial and temporal surrounding information. We propose estimators on closed form for missing data in the case of varying available neighboring contexts. Our error concealment strategy increases peak signal-to-noise ratio compared to previously proposed schemes. Examples of improved subjective visual quality by means of the proposed method are also supplied.

[1]  David G. Messerschmitt,et al.  Resynchronization of motion compensated video affected by ATM cell loss , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[3]  Oscar C. Au,et al.  Modified motion compensated temporal frame interpolation for very low bit rate video , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[4]  Ness B. Shroff,et al.  Error concealment in MPEG video streams over ATM networks , 2000, IEEE Journal on Selected Areas in Communications.

[5]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[6]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[7]  Robert J. Marks,et al.  Recovery of image blocks using the method of alternating projections , 2005, IEEE Transactions on Image Processing.

[8]  S. Kay.  Fundamentals of statistical signal processing: estimation theory , 1993 .

[9]  Kai-Kuang Ma,et al.  Error concealment for video transmission with dual multiscale Markov random field modeling , 2003, IEEE Trans. Image Process..

[10]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[11]  Tsuhan Chen,et al.  Model-based error concealment for wireless video , 2002, IEEE Trans. Circuits Syst. Video Technol..

[12]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[13]  Thomas Eriksson,et al.  Qualitative Analysis of Video Packet Loss Concealment with Gaussian Mixtures , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[14]  Rabab Kreidieh Ward,et al.  A concealment method for video communications in an error-prone environment , 2000, IEEE Journal on Selected Areas in Communications.

[15]  Douglas A. Reynolds,et al.  Robust text-independent speaker identification using Gaussian mixture speaker models , 1995, IEEE Trans. Speech Audio Process..

[16]  Mohammed Ghanbari,et al.  Cell-loss concealment in ATM video codecs , 1993, IEEE Trans. Circuits Syst. Video Technol..

[17]  Daniel Persson,et al.  A statistical approach to packet loss concealment for video , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[18]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  Yao Wang,et al.  Second-order derivative-based smoothness measure for error concealment in DCT-based codecs , 1998, IEEE Trans. Circuits Syst. Video Technol..

[20]  Yao Wang,et al.  Coding and cell-loss recovery in DCT-based packet video , 1993, IEEE Trans. Circuits Syst. Video Technol..

[21]  Jun Zhang,et al.  Nonlinear prediction for Gaussian mixture image models , 2004, IEEE Transactions on Image Processing.

[22]  Teresa H. Y. Meng,et al.  Transform coded image reconstruction exploiting interblock correlation , 1995, IEEE Trans. Image Process..

[23]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[24]  Kris Popat,et al.  Cluster-based probability model and its application to image and texture processing , 1997, IEEE Trans. Image Process..

[25]  Jörn Ostermann,et al.  Image and video coding-emerging standards and beyond , 1998, IEEE Trans. Circuits Syst. Video Technol..