Distortion estimates for adaptive lifting transforms with noise

Multimedia analysis, enhancement and coding methods often resort to adaptive transforms that exploit local characteristics of the input source. Following the signal decomposition stage, the produced transform coefficients and the adaptive transform parameters can be subject to quantization and/or data corruption (e.g. due to transmission or storage limitations). As a result, mismatches between the analysis- and synthesis-side transform coefficients and adaptive parameters may occur, severely impacting the reconstructed signal and therefore affecting the quality of the subsequent analysis, processing and display task. Hence, a thorough understanding of the quality degradation ensuing from such mismatches is essential for multimedia applications that rely on adaptive signal decompositions. This paper focuses on lifting-based adaptive transforms that represent a broad class of adaptive decompositions. By viewing the mismatches in the transform coefficients and the adaptive parameters as perturbations in the synthesis system, we derive analytic expressions for the expected reconstruction distortion. Our theoretical results are experimentally assessed using 1D adaptive decompositions and motion-adaptive temporal decompositions of video signals.

[1]  Feng Wu,et al.  Barbell-Lifting Based 3-D Wavelet Coding Scheme , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Ergun Erçelebi,et al.  Image enhancement via space-adaptive lifting scheme exploiting subband dependency , 2010, Digit. Signal Process..

[3]  John W. Woods,et al.  Scalable Motion Vector Coding Based on CABAC for MC-EZBC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Mihaela van der Schaar,et al.  Analytical Rate-Distortion-Complexity Modeling of Wavelet-Based Video Coders , 2008, IEEE Transactions on Signal Processing.

[5]  B. Girod,et al.  Multiview Video Compression , 2007, IEEE Signal Processing Magazine.

[6]  Ebroul Izquierdo,et al.  Rate-Distortion Optimized Motion-Compensated Prediction for Packet Loss Resilient Video Coding , 2007, IEEE Transactions on Image Processing.

[7]  Alberto Signoroni,et al.  State-of-the-Art and Trends in Scalable Video Compression With Wavelet-Based Approaches , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Mihaela van der Schaar,et al.  Unconstrained motion compensated temporal filtering (UMCTF) for efficient and flexible interframe wavelet video coding , 2005, Signal Process. Image Commun..

[9]  Thomas Rusert,et al.  Enhanced interframe wavelet video coding considering the interrelation of spatio-temporal transform and motion compensation , 2004, Signal Process. Image Commun..

[10]  Mihaela van der Schaar,et al.  Emerging Technologies in Wireless LANs: Cross-layer Optimized Video Streaming over Wireless Multi-hop Mesh Networks , 2007 .

[11]  Béatrice Pesquet-Popescu,et al.  Estimation of quantization noise for adaptive-prediction lifting schemes , 2009, 2009 IEEE International Workshop on Multimedia Signal Processing.

[12]  Mihaela van der Schaar,et al.  In-band motion compensated temporal filtering , 2004, Signal Process. Image Commun..

[13]  A. Laub,et al.  The singular value decomposition: Its computation and some applications , 1980 .

[14]  M. Wada,et al.  Reversible variable length codes , 1995, IEEE Trans. Commun..

[15]  Béatrice Pesquet-Popescu,et al.  Distortion evaluation in transform domain for adaptive lifting schemes , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[16]  Peter Schelkens,et al.  Embedded Multiple Description Coding of Video , 2006, IEEE Transactions on Image Processing.

[17]  Henk J. A. M. Heijmans,et al.  Combining Seminorms in Adaptive Lifting Schemes and Applications to Image Analysis and Compression , 2006, Journal of Mathematical Imaging and Vision.

[18]  David S. Taubman,et al.  Perceptual Optimization for Scalable Video Compression Based on Visual Masking Principles , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Hamid R. Rabiee,et al.  A novel rotation/scale invariant template matching algorithm using weighted adaptive lifting scheme transform , 2010, Pattern Recognit..

[20]  Bernd Girod,et al.  Analysis on Quantization Error Propagation for Motion-Compensated Lifted Wavelet Video Coding , 2005, 2005 IEEE 7th Workshop on Multimedia Signal Processing.

[21]  Wenxian Yang,et al.  4-D Wavelet-Based Multiview Video Coding , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[23]  G. Piella,et al.  Adaptive lifting schemes with perfect reconstruction , 2002, IEEE Trans. Signal Process..

[24]  Boualem Boashash,et al.  The bootstrap and its application in signal processing , 1998, IEEE Signal Process. Mag..

[25]  Mihaela van der Schaar,et al.  Operational rate-distortion modeling for wavelet video coders , 2006, IEEE Transactions on Signal Processing.

[26]  Bernd Girod,et al.  Optimum update for motion-compensated lifting , 2005, IEEE Signal Processing Letters.

[27]  David S. Taubman,et al.  Highly scalable video compression with scalable motion coding , 2003, ICIP.

[28]  Richard E. Ladner,et al.  Unequal loss protection: graceful degradation of image quality over packet erasure channels through forward error correction , 2000, IEEE Journal on Selected Areas in Communications.

[29]  Peter Schelkens,et al.  Motion and texture rate-allocation for prediction-based scalable motion-vector coding , 2005, Signal Process. Image Commun..

[30]  Richard G. Baraniuk,et al.  Nonlinear wavelet transforms for image coding via lifting , 2003, IEEE Trans. Image Process..

[31]  Michel Barlaud,et al.  Design of signal-adapted multidimensional lifting scheme for lossy coding , 2004, IEEE Transactions on Image Processing.

[32]  Béatrice Pesquet-Popescu,et al.  A fully scalable 3D subband video codec , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[33]  David S. Taubman,et al.  Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression , 2003, IEEE Trans. Image Process..

[34]  Jens-Rainer Ohm,et al.  Advances in Scalable Video Coding , 2005, Proceedings of the IEEE.

[35]  W. Sweldens The Lifting Scheme: A Custom - Design Construction of Biorthogonal Wavelets "Industrial Mathematics , 1996 .

[36]  Michel Barlaud,et al.  Model-based bit allocation between wavelet subbands and motion information in MCWT video coders , 2006, 2006 14th European Signal Processing Conference.