Virtual View Interpolation and Prediction Structure for Full Parallax Multi-view Video

In this work, we propose virtual view interpolation algorithm and prediction structure for full parallax multi-view video coding. The proposed virtual view interpolation algorithm estimates the disparity information by bilateral criterion and disparity smoothness. The interpolated view is used as additional reference frame, and novel direct mode is applied to it. Simulation results demonstrate that our proposed virtual view interpolation algorithm shows the better quality than the conventional interpolation algorithm. Moreover, the proposed prediction structure, which uses the interpolated view as an additional reference with novel direct mode, shows the significant coding gain.

[1]  Sehoon Yea,et al.  View Synthesis Prediction for Rate-Overhead Reduction in FTV , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[2]  Aljoscha Smolic,et al.  Coding Algorithms for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Chang-Su Kim,et al.  Error concealment of multi-view video sequences using inter-view and intra-view correlations , 2009, J. Vis. Commun. Image Represent..

[4]  Toshiaki Fujii,et al.  Multiview Video Coding Using View Interpolation and Color Correction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Sehoon Yea,et al.  RD-Optimized View Synthesis Prediction for Multiview Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[6]  Chang-Su Kim,et al.  Compression of 2-D wide multi-view video sequences using view interpolation , 2008, 2008 15th IEEE International Conference on Image Processing.

[7]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[8]  Sehoon Yea,et al.  Depth Estimation for View Synthesis in Multiview Video Coding , 2007, 2007 3DTV Conference.

[9]  Aljoscha Smolic,et al.  Efficient Compression of Multi-View Video Exploiting Inter-View Dependencies Based on H.264/MPEG4-AVC , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[10]  Luciano Alparone,et al.  Adaptively weighted vector-median filters for motion-fields smoothing , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.