Complexity scalable motion compensated wavelet video encoding

We present a framework for the systematic analysis of video encoding complexity, measured in terms of the number of motion estimation (ME) computations, that we illustrate on motion compensated wavelet video coding schemes. We demonstrate the graceful complexity scalability of these schemes through the modification of the spatiotemporal decomposition structure and the ME parameters, and the use of spatiotemporal prediction. We generate a wide range of rate-distortion-complexity (R-D-C) operating points for different sequences, by modifying these options. Using our analytical framework we derive closed form expressions for the number of ME computations for these different coding modes and show that they accurately capture the computational complexity independent of the underlying content characteristics. Our framework for complexity analysis can be combined with rate-distortion modeling to determine the encoding structure and parameters for optimal R-D-C tradeoffs.

[1]  Tsuhan Chen,et al.  Classification based mode decisions for video over network , 2001, IEEE Trans. Multim..

[2]  Christophe Tillier,et al.  3D, 3-band, 3-tap temporal lifting for scalable video coding , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[3]  Deepak S. Turaga,et al.  Differential motion vector coding for scalable coding , 2003, IS&T/SPIE Electronic Imaging.

[4]  John W. Woods,et al.  Embedded video coding using invertible motion compensated 3-D subband/wavelet filter bank , 2001, Signal Process. Image Commun..

[5]  Béatrice Pesquet-Popescu,et al.  Three-dimensional lifting schemes for motion compensated video compression , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[6]  John W. Woods,et al.  Motion-compensated 3-D subband coding of video , 1999, IEEE Trans. Image Process..

[7]  David S. Taubman,et al.  Highly scalable video compression using a lifting-based 3D wavelet transform with deformable mesh motion compensation , 2002, ICIP.

[8]  Jens-Rainer Ohm,et al.  Transition filtering and optimized quantization in interframe wavelet video coding , 2003, Visual Communications and Image Processing.

[9]  Mihaela van der Schaar,et al.  Complexity metric driven energy optimization framework for implementing MPEG-21 scalable video decoders , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[10]  Mihaela van der Schaar,et al.  Rate-distortion-complexity modeling for network and receiver aware adaptation , 2005, IEEE Transactions on Multimedia.

[11]  Jens-Rainer Ohm,et al.  Three-dimensional subband coding with motion compensation , 1994, IEEE Trans. Image Process..

[12]  Béatrice Pesquet-Popescu,et al.  A fully scalable 3D subband video codec , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[13]  Mihaela van der Schaar,et al.  Rate-distortion modeling for wavelet video coders , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[14]  David S. Taubman,et al.  Motion-compensated highly scalable video compression using an adaptive 3D wavelet transform based on lifting , 2001, ICIP.

[15]  Mihaela van der Schaar,et al.  Unconstrained motion compensated temporal filtering (UMCTF) framework for wavelet video coding , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).