Layered multiple description video coding using dual-tree discrete wavelet transform and H.264/AVC

A novel hybrid layered multiple description video coding (HLMDVC) algorithm is proposed to provide a robust and flexible video transmission via unreliable networks, like Internet or the wireless network. First, the input video sequence is encoded by a standard H.264/AVC encoder in low bit rate to form the base layer, which is then duplicated to each description. Second, the 3D dual-tree discrete wavelet transform is performed on the difference between the reconstructed base layer and the input sequence to produce four wavelet coefficient trees. Then the noise shaping is used to reduce the redundancy of these coefficient trees. After that, the four sparse wavelet coefficient trees are separately encoded by 3D-SPIHT encoders. The resulted four bitstreams are partitioned into two groups, separately forming enhancement layers of two descriptions. The redundancy of the proposed multiple description video coding scheme can be easily adjusted by changing the bitrate of the base layer to fit for different transmission channels. The directional selectivity feature of 3D dual-tree discrete wavelet transform frees the enhancement layer coding from the time consuming motion estimation, such that no mismatch happens and the coding efficiency is improved. Simulation results have shown that the quality of the reconstructed video of the proposed HLMDVC algorithm is superior to that by the state-of-the-art multiple description video coding methods.

[1]  Anthony Vetro,et al.  Video Coding Using 3D Dual-Tree Wavelet Transform , 2007, EURASIP J. Image Video Process..

[2]  Nick Kingsbury,et al.  The dual-tree complex wavelet transform: a new technique for shift invariance and directional filters , 1998 .

[3]  Anthony Vetro,et al.  An investigation of 3D dual-tree wavelet transform for video coding , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[4]  Kai-Kuang Ma,et al.  H.264-based Multiple Description Video Coder and Its DSP Implementation , 2006, 2006 International Conference on Image Processing.

[5]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[6]  Wen-Jiin Tsai,et al.  Rate-distortion optimized mode selection method for multiple description video coding , 2013, Multimedia Tools and Applications.

[7]  Yuanyuan Xu,et al.  End-to-End Rate-Distortion Optimized Description Generation for H.264 Multiple Description Video Coding , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Gabriella Olmo,et al.  Redundant Slice Optimal Allocation for H.264 Multiple Description Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Bu-Sung Lee,et al.  Robust Image Coding Based Upon Compressive Sensing , 2012, IEEE Transactions on Multimedia.

[10]  Zixiang Xiong,et al.  Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT) , 2000, IEEE Trans. Circuits Syst. Video Technol..

[11]  Canhui Cai,et al.  Layered multiple description video coding , 2008, 2008 9th International Conference on Signal Processing.

[12]  Pascal Frossard,et al.  Multiple Description Video Coding With H.264/AVC Redundant Pictures , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Christophe Tillier,et al.  A Motion-Compensated Overcomplete Temporal Decomposition for Multiple Description Scalable Video Coding , 2007, EURASIP J. Image Video Process..

[14]  Wen-Jiin Tsai,et al.  Hybrid Multiple Description Coding Based on H.264 , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Michael T. Orchard,et al.  Multiple-description video coding using motion-compensated temporal prediction , 2002, IEEE Trans. Circuits Syst. Video Technol..

[16]  Kai-Kuang Ma,et al.  A novel multiple description video coding based on data reuse , 2013, 2013 IEEE International Conference on Image Processing.

[17]  Vinay A. Vaishampayan,et al.  Balanced interframe multiple description video compression , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[18]  Yao Zhao,et al.  Multiple Description Coding for H.264/AVC With Redundancy Allocation at Macro Block Level , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Roberto Rinaldo,et al.  Polyphase spatial subsampling multiple description coding of video streams with H264 , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[20]  Vivek K. Goyal,et al.  Multiple description coding: compression meets the network , 2001, IEEE Signal Process. Mag..

[21]  Nick G. Kingsbury,et al.  Overcomplete image coding using iterative projection-based noise shaping , 2002, Proceedings. International Conference on Image Processing.