Stochastic Modeling of the Spatiotemporal Wavelet Coefficients and Applications to Quality Enhancement and Error Concealment

We extend a stochastic model of hierarchical dependencies between wavelet coefficients of still images to the spatiotemporal decomposition of video sequences, obtained by a motion-compensated wavelet decomposition. We propose new estimators for the parameters of this model which provide better statistical performances. Based on this model, we deduce an optimal predictor of missing samples in the spatiotemporal wavelet domain and use it in two applications: quality enhancement and error concealment of scalable video transmitted over packet networks. Simulation results show significant quality improvement achieved by this technique with different packetization strategies for a scalable video bit stream.

[1]  Levent Sendur,et al.  Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency , 2002, IEEE Trans. Signal Process..

[2]  F. Kossentini,et al.  Error concealment methods, a comparative study , 1999, Engineering Solutions for the Next Millennium. 1999 IEEE Canadian Conference on Electrical and Computer Engineering (Cat. No.99TH8411).

[3]  John W. Woods,et al.  Motion-compensated 3-D subband coding of video , 1999, IEEE Trans. Image Process..

[4]  Pierre Moulin,et al.  Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients , 2001, IEEE Trans. Image Process..

[5]  Teresa H. Y. Meng,et al.  Transform coded image reconstruction exploiting interblock correlation , 1995, IEEE Trans. Image Process..

[6]  R. Talluri,et al.  Error-resilient video coding in the ISO MPEG-4 standard , 1998, IEEE Commun. Mag..

[7]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[8]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[9]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[10]  Ness B. Shroff,et al.  Error Concealment in Encoded Video Streams , 1998 .

[11]  Eero P. Simoncelli.  Modeling the joint statistics of images in the wavelet domain , 1999, Optics & Photonics.

[12]  Zixiang Xiong,et al.  Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT) , 2000, IEEE Trans. Circuits Syst. Video Technol..

[13]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[14]  Jia Jie.  Bayesian denoising of visual images in the wavelet domain , 2003 .

[15]  Rabab Kreidieh Ward,et al.  A concealment method for video communications in an error-prone environment , 2000, IEEE Journal on Selected Areas in Communications.

[16]  Mohammed Ghanbari,et al.  Cell-loss concealment in ATM video codecs , 1993, IEEE Trans. Circuits Syst. Video Technol..

[17]  Sheila S. Hemami,et al.  Efficient sign coding and estimation of zero-quantized coefficients in embedded wavelet image codecs , 2003, IEEE Trans. Image Process..

[18]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[19]  Béatrice Pesquet-Popescu,et al.  Three-dimensional lifting schemes for motion compensated video compression , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[20]  Christian Gourieroux,et al.  Statistics and econometric models , 1995 .

[21]  Justin K. Romberg,et al.  Bayesian tree-structured image modeling using wavelet-domain hidden Markov models , 2001, IEEE Trans. Image Process..

[22]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  John W. Woods,et al.  Invertible three-dimensional analysis/synthesis system for video coding with half-pixel-accurate motion compensation , 1998, Electronic Imaging.

[24]  Kai-Kuang Ma,et al.  Error concealment for video transmission with dual multiscale Markov random field modeling , 2003, IEEE Trans. Image Process..