Graph Matching Based Side Information Generation for Distributed Multi-View Video Coding

In this paper, we adopt constrained relaxation for distributed multi-view video coding (DMVC). The novel framework integrates the graph-based segmentation and matching to generate inter-view correlated side information without knowing the camera parameters. Moreover, graph-based representations of multi-view images are incorporated to form more distinctive feature constraints. The sparse data as a good hypothesis space aim for a best matching optimization of inter-view side information with compact syndromes, from inferred relaxed coset. The plausible filling-in from a priori feature constraints between neighboring views could reinforce a promising compensation to inter-view side information generation for joint multi-view decoding. In order to find distinctive feature matching with a more stable approximation, PCA-SIFT and TPS (thin plate spline) are adopted to reduce the dimension of SIFT descriptors and construct a more accurate inter-view motion model. The experimental results validate the high estimation precision and the rate-distortion improvements.

[1]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[2]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .

[3]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[4]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[5]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[6]  Ram Zamir,et al.  The rate loss in the Wyner-Ziv problem , 1996, IEEE Trans. Inf. Theory.

[7]  Yo-Sung Ho,et al.  A Framework for Multi-view Video Coding Using Layered Depth Images , 2005, PCM.

[8]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[9]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[10]  Marcus A. Magnor,et al.  Model-based coding of multiviewpoint imagery , 2000, Visual Communications and Image Processing.

[11]  Catarina Brites,et al.  IMPROVING FRAME INTERPOLATION WITH SPATIAL MOTION SMOOTHING FOR PIXEL DOMAIN DISTRIBUTED VIDEO CODING , 2005 .

[12]  B. Girod,et al.  Rate-Adaptive Distributed Source Coding using Low-Density Parity-Check Codes , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..

[13]  Kannan Ramchandran,et al.  Duality between source coding and channel coding and its extension to the side information case , 2003, IEEE Trans. Inf. Theory.

[14]  F. Pereira,et al.  Evaluating a feedback channel based transform domain Wyner-Ziv video codec , 2008, Signal Process. Image Commun..

[15]  A. Murat Tekalp,et al.  Scalable Multi-View Video Coding for Interactive 3DTV , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[16]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.

[17]  Wen Gao,et al.  Wyner–Ziv-Based Multiview Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Zhihai He Image compression using constrained relaxation , 2007, Electronic Imaging.

[19]  Yao Wang,et al.  Multiview video sequence analysis, compression, and virtual viewpoint synthesis , 2000, IEEE Trans. Circuits Syst. Video Technol..

[20]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[21]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[22]  Bernd Girod,et al.  Distributed compression for large camera arrays , 2004, IEEE Workshop on Statistical Signal Processing, 2003.

[23]  Hans-Peter Seidel,et al.  Multivideo compression in texture space , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[24]  Zhihai He,et al.  Side information generation with constrained relaxation for distributed multi-view video coding , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[25]  Riccardo Leonardi,et al.  Distributed Monoview and Multiview Video Coding: Basics, Problems and Recent Advances , 2007 .

[26]  Mourad Ouaret,et al.  Fusion-based multiview distributed video coding , 2006, VSSN '06.

[27]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[28]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[29]  X. Artigas,et al.  Side Information Generation for Multiview Distributed Video Coding Using a Fusion Approach , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.