INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO

Independent work of different research groups has recently demonstrated that the conventional "t+2D" architecture which is currently investigated in the SVC standardization may provide limited efficiency and flexibility with respect to resolution scalability. A significant part of the problem lays in the fact that, although the temporal motion-compensated transform is applied in the full-resolution input frames during encoding (i.e. prior to the spatial transform), low-resolution decoders cannot replicate this process since certain high-resolution, high-frequency content is missing. More importantly, as the motion vectors are estimated at full resolution, the shift uncertainty introduced during the motion-vector downscaling process (in order to make vectors applicable at low-resolution frames) can produce visual artifacts in cases where motion is modelled incorrectly. In this contribution, we start from the basic concepts that justify the fundamental operation of a "2D+t" architecture, which is motion compensation making use of the Overcomplete Discrete Wavelet Transform (ODWT). We then review our previously-proposed architecture for the efficient performance of motion- compensated temporal filtering (MCTF) in the wavelet domain. Experimental results indicating the problems of the "t+2D" architecture for low-resolution decoding, as well a comparative test between "t+2D" and "2D+t" systems under the same framework of advanced MCTF, substantiate the performance of the proposed architectures.

[1]  Hyun Wook Park,et al.  Motion estimation using low-band-shift method for wavelet-based moving-picture coding , 2000, IEEE Trans. Image Process..

[2]  T. G. Voevodkina,et al.  [Holographic interferometry]. , 1985, Laboratornoe delo.

[3]  Zeev Zalevsky,et al.  Space–bandwidth product of optical signals and systems , 1996 .

[4]  Tibor Balogh,et al.  The HoloVizio system , 2006, Electronic Imaging.

[5]  Kannan Ramchandran,et al.  Scalable wavelet video coding using aliasing-reduced hierarchical motion compensation , 2000, IEEE Trans. Image Process..

[6]  Peter Schelkens,et al.  Complete-to-overcomplete discrete wavelet transforms: theory and applications , 2005, IEEE Transactions on Signal Processing.

[7]  Masahiro Yamaguchi,et al.  Holographic three-dimensional printer: new method. , 1992, Applied optics.

[8]  J. Goodman Introduction to Fourier optics , 1969 .

[9]  Mihaela van der Schaar,et al.  Fully-scalable wavelet video coding using in-band motion compensated temporal filtering , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[10]  David S. Taubman,et al.  An efficient content-adaptive motion-compensated 3-D DWT with enhanced spatial and temporal scalability , 2006, IEEE Transactions on Image Processing.

[11]  Claudia Mayer Motion compensated in-band prediction for wavelet-based spatially scalable video coding , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[12]  Xin Li,et al.  All-phase motion compensated prediction in the wavelet domain for high performance video coding , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[13]  Peter Schelkens,et al.  Single-rate calculation of overcomplete discrete wavelet transforms for scalable coding applications , 2005, Signal Process..