Low complexity independent multi-view video coding

In 3D multi-view video coding (MVC), disparity estimation (DE) are used to exploit the correlation among different view sequences. The DE process greatly increases the computational complexity of the MVC. In this paper, a novel independent low complexity multi-view video coder (I-MVC) is introduced. In the proposed MVC, the coding complexity is shifted from the encoder side to the decoder side. Instead of disparity estimation, the proposed I-MVC deploys independent component analysis (ICA) on the video streams to remove the correlation between the view sequences. The correlated (dependent) video sequences are decomposed into uncorrelated (independent) sequences and a mixing matrix. Each independent sequence is independently encoded by the H.264/AVC video coder. Then the mixing matrix is used at decoder to jointly decode the received independent sequences. Our experimental results show that the proposed I-MVC has better coding efficiency than conventional 3D multi-view video coder. The I-MVC gives more than 21% savings in overall bit rate and reduces the MVC computational complexity by 49% with less than 0.2 dB loss in the video peak signal to noise ratio.

[1]  Tao Yan,et al.  View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Mei Yu,et al.  Adaptive Multiview Video Coding Scheme Based on Spatiotemporal Correlation Analyses , 2009 .

[3]  Hany S. Hussein,et al.  Blind configuration of multi-view video coding , 2012, 2012 IEEE International Conference on Consumer Electronics (ICCE).

[4]  Masayuki Tanimoto,et al.  Multiview Imaging and 3DTV , 2007, IEEE Signal Processing Magazine.

[5]  Jiang Gang,et al.  Multi-Modal Multi-View Video Coding Based on Correlation Analysis , 2007 .

[6]  E. Candes,et al.  11-magic : Recovery of sparse signals via convex programming , 2005 .

[7]  Kwanghoon Sohn,et al.  Fast Disparity and Motion Estimation for Multi-view Video Coding , 2007, IEEE Transactions on Consumer Electronics.

[8]  Ying Chen,et al.  Low-complexity asymmetric multiview video coding , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[9]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Peter Eisert,et al.  Free viewpoint video extraction, representation, coding, and rendering , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[11]  E. Oja,et al.  Independent Component Analysis , 2001 .

[12]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[13]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[14]  Wen Gao,et al.  A Fast Inter Frame Prediction Algorithm for Multi-View Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[15]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[16]  Aljoscha Smolic,et al.  Coding Algorithms for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.