Improved view interpolation for side information in multiview distributed video coding

Distributed video coding (DVC) is an attractive coding scheme for distribute camera networks because it has the potential to achieve low-complexity encoding and to exploit inter-view correlation without communication among cameras during encoding. It is well-known that the quality of the side information strongly impacts the coding performance of DVC. Therefore, this paper proposes an adaptive filtering method that yields improved view interpolation side information (VISI). The proposed adaptive filter compensates the inter-view mismatches caused by heterogeneous cameras. The filter coefficients are estimated to minimize the differences between the view-interpolated frame and the decoded frame on the key frame just prior to the WZF decoding step. Simulations show that the proposed method improves VISI quality by about 2 dB on breakdancers and about 3 dB on ballet sequences.

[1]  Mourad Ouaret,et al.  Iterative Multiview Side Information for Enhanced Reconstruction in Distributed Video Coding , 2009, EURASIP J. Image Video Process..

[2]  Catarina Brites,et al.  IMPROVING FRAME INTERPOLATION WITH SPATIAL MOTION SMOOTHING FOR PIXEL DOMAIN DISTRIBUTED VIDEO CODING , 2005 .

[3]  Thomas Wiegand,et al.  3D Video and Free Viewpoint Video - Technologies, Applications and MPEG Standards , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[4]  Bernd Girod,et al.  Distributed compression for large camera arrays , 2004, IEEE Workshop on Statistical Signal Processing, 2003.

[5]  Mourad Ouaret,et al.  Multiview Distributed Video Coding with encoder driven fusion , 2007, 2007 15th European Signal Processing Conference.

[6]  Rui Zhang,et al.  Wyner-Ziv coding of motion video , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[7]  Masayuki Tanimoto Overview of free viewpoint television , 2006, Signal Process. Image Commun..

[8]  Anthony Vetro,et al.  View Synthesis for Multiview Video Compression , 2006 .

[9]  Mourad Ouaret,et al.  Fusion-based multiview distributed video coding , 2006, VSSN '06.

[10]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[11]  J. Wolfowitz The rate distortion function for source coding with side information at the decoder , 1979 .

[12]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[13]  X. Artigas,et al.  Side Information Generation for Multiview Distributed Video Coding Using a Fusion Approach , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.

[14]  Kannan Ramchandran,et al.  PRISM: A video coding archi-tecture based on distributed compression principles , 2003 .

[15]  Augusto Sarti,et al.  Image compression in a multi-camera system based on a distributed source coding approach , 2005, 2005 13th European Signal Processing Conference.

[16]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.