Distributed Coding of Highly Correlated Image Sequences with Motion-Compensated Temporal Wavelets

This paper discusses robust coding of visual content for a distributed multimedia system. The system encodes independently two correlated video signals and reconstructs them jointly at a central decoder. The video signals are captured from a dynamic scene, where each signal is robustly coded by a motion-compensated Haar wavelet. The efficiency of the decoder is improved by a disparity analysis of the first image pair of the sequences, followed by disparity compensation of the remaining images of one sequence. We investigate how this scene analysis at the decoder can improve the coding efficiency. At the decoder, one video signal is used as side information to decode efficiently the second video signal. Additional bitrate savings can be obtained with disparity compensation at the decoder. Further, we address the theoretical problem of distributed coding of video signals in the presence of correlated video side information. We utilize a motion-compensated spatiotemporal transform to decorrelate each video signal. For certain assumptions, the optimal motion-compensated spatiotemporal transform for video coding with video side information at high rates is derived. It is shown that the motion-compensated Haar wavelet belongs to this class of transforms. Given the correlation of the video side information, the theoretical bitrate reduction for the distributed coding scheme is investigated. Interestingly, the efficiency of multiview side information is dependent on the level of temporal decorrelation: for a given correlation SNR of the side information, bitrate savings due to side information are decreasing with improved temporal decorrelation.

[1]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUSS): design and construction , 1999 .

[2]  Markus Flierl,et al.  Video Coding with Superimposed Motion-Compensated Signals: Applications to H.264 and Beyond , 2004 .

[3]  Markus Flierl.  DISTRIBUTED CODING OF DYNAMIC SCENES , 2004 .

[4]  Michael Gastpar,et al.  On compression using the distributed Karhunen-Loeve transform , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  Ying Zhao,et al.  Data compression of correlated non-binary sources using punctured turbo codes , 2002, Proceedings DCC 2002. Data Compression Conference.

[6]  Ying Zhao,et al.  Compression of correlated binary sources using turbo codes , 2001, IEEE Communications Letters.

[7]  Bernd Girod,et al.  Distributed compression for large camera arrays , 2004, IEEE Workshop on Statistical Signal Processing, 2003.

[8]  Zixiang Xiong,et al.  Compression of binary sources with side information at the decoder using LDPC codes , 2002, IEEE Communications Letters.

[9]  Shlomo Shamai,et al.  Nested linear/Lattice codes for structured multiterminal binning , 2002, IEEE Trans. Inf. Theory.

[10]  Pier Luigi Dragotti,et al.  Distributed compression in camera sensor networks , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[11]  Michael Gastpar,et al.  The distributed Karhunen-Loeve transform , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[12]  Kannan Ramchandran,et al.  Enhancing analog image transmission systems using digital side information: a new wavelet-based image coding paradigm , 2001, Proceedings DCC 2001. Data Compression Conference.

[13]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[14]  Michael Gastpar,et al.  Correction of "The Distributed Karhunen - Loeve Transform" , 2007 .

[15]  Pier Luigi Dragotti,et al.  Distributed compression of the plenoptic function , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[16]  Markus Flierl,et al.  Video coding with motion compensation for groups of pictures , 2002, Proceedings. International Conference on Image Processing.

[17]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[18]  B. Girod,et al.  Transforms for high-rate distributed source coding , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[19]  Zixiang Xiong,et al.  Distributed source coding for sensor networks , 2004, IEEE Signal Processing Magazine.

[20]  Béatrice Pesquet-Popescu,et al.  Three-dimensional lifting schemes for motion compensated video compression , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[21]  Michael Gastpar,et al.  The distributed, partial, and conditional Karhunen-Loeve transforms , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[22]  Rui Zhang,et al.  Wyner-Ziv coding of motion video , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[23]  Pierre Vandergheynst,et al.  Video coding with motion-compensated temporal transforms and side information , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[24]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[25]  Kannan Ramchandran,et al.  Distributed compression in a dense microsensor network , 2002, IEEE Signal Process. Mag..

[26]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[27]  B. Girod,et al.  Wyner-Ziv quantization and transform coding of noisy sources at high rates , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[28]  Bernd Girod,et al.  Compression with side information using turbo codes , 2002, Proceedings DCC 2002. Data Compression Conference.

[29]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[30]  Kannan Ramchandran,et al.  PRISM: an uplink-friendly multimedia coding paradigm , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[31]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[32]  Pierre Vandergheynst,et al.  Distributed coding of dynamic scenes with motion-compensated wavelets , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[33]  Markus Flierl,et al.  Video coding with motion-compensated lifted wavelet transforms , 2004, Signal Process. Image Commun..

[34]  David S. Taubman,et al.  Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression , 2003, IEEE Trans. Image Process..