Exploring the Distributed Video Coding in a Quality Assessment Context

In the popular video coding trend, the encoder has the task to exploit both spatial and temporal redundancies present in the video sequence, which is a complex procedure; As a result almost all video encoders have five to ten times more complexity than their decoders. In a video compression process, one of the main tasks at the encoder side is motion estimation which is to extract the temporal correlation between frames. Distributed video coding (DVC) proposed the idea that can lead to low complexity encoders and higher complexity decoders. DVC is a new paradigm in video compression based on the information theoretic ideas of Slepian-Wolf and Wyner-Ziv theorems. Wyner-Ziv coding is naturally robust against transmission errors and can be used for joint source and channel coding. Side Information is one of the key components of the Wyner-Ziv decoder. Better side information generation will result in better functionality of Wyner-Ziv coder. In this paper we proposed a new method that can generate side information with a better quality and thus better compression. We’ve used HVS (human visual system) based image quality metrics as our quality criterion. The motion estimation we’ve used in the decoder is modified due to these metrics such that we could obtain finer side information. The motion compensation is optimized for perceptual quality metrics and leads to better side information generation compared to conventional MSE (mean squared error) or SAD (sum of absolute difference) based motion compensation currently used in the literature. Better motion compensation means better compression.

[1]  Aidong Men,et al.  Improved Side Information Generation and Virtual Channel Modeling for Distributed Video Coding , 2009, 2009 5th International Conference on Wireless Communications, Networking and Mobile Computing.

[2]  Zhou Wang,et al.  Translation insensitive image similarity in complex wavelet domain , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[3]  Hyun-Soo Kang,et al.  Improved Side Information Generation Using Field Coding for Wyner-Ziv Codec , 2009 .

[4]  Xiaodong Liu,et al.  A Novel Content-Based Side-Information Generation Approach for Distributed Video Coding , 2009, 2009 WASE International Conference on Information Engineering.

[5]  Luis Torres,et al.  An Approach to Distributed Video Coding Using 3D Face Models , 2006, 2006 International Conference on Image Processing.

[6]  Long-Wen Chang,et al.  Designing JPEG quantization tables based on human visual system , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[7]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[8]  Warnakulasuriya Anil Chandana Fernando,et al.  An Iterative Refinement Technique for Side Information Generation in DVC , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[9]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[10]  David R. Bull,et al.  Fusion Methods for Side Information Generation in Multi-View Distributed Video Coding Systems , 2007, 2007 IEEE International Conference on Image Processing.

[11]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[12]  Alan C. Bovik,et al.  A Structural Similarity Metric for Video Based on Motion Models , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[13]  A. Bovik F Mean Squared Error: Love It or Leave It? , 2009 .

[14]  Borko Furht,et al.  Handbook of Video Databases: Design and Applications , 2003 .

[15]  B. Girod,et al.  WYNER-ZIV CODING OF STEREO IMAGES WITH UNSUPERVISED LEARNING OF DISPARITY , 2007 .

[16]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[17]  Catarina Brites,et al.  IMPROVING FRAME INTERPOLATION WITH SPATIAL MOTION SMOOTHING FOR PIXEL DOMAIN DISTRIBUTED VIDEO CODING , 2005 .

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Donggyu Sim,et al.  Side information generation using adaptive search range for distributed video coding , 2009, 2009 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[20]  Hua Zhang,et al.  A video structural similarity quality metric based on a joint spatial-temporal visual attention model , 2009 .

[21]  Xin Huang,et al.  Improved side information generation for Distributed Video Coding , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[22]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .

[24]  Said Nader-Esfahani,et al.  A perceptual based motion compensation technique for video coding , 2010, 2010 6th Iranian Conference on Machine Vision and Image Processing.

[25]  Christine Guillemot,et al.  Mesh-Based Motion-Compensated Interpolation for Side Information Extraction in Distributed Video Coding , 2006, 2006 International Conference on Image Processing.

[26]  Han-Jin Cho,et al.  A Novel Motion Compensated Frame Interpolation Method for Improving Side Information in Distributed Video Coding , 2007, 2007 International Symposium on Information Technology Convergence (ISITC 2007).

[27]  Rui Zhang,et al.  Wyner-Ziv coding of motion video , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..