A Multiple Hexagon Search Algorithm for Motion and Disparity Estimation in Multiview Video Coding

In single viewpoint video coding, there are many fast block matching motion estimation algorithms proposed, such as three-step search, four-step search, diamond search as well as hexagon-based search and so on. However, experimental analysis show that these algorithms are not suitable for using directly in Multiview View Coding (MVC). Since the increased search range, the larger format of multiview video as well as the correlations between inter-view frames are not considered by these algorithms, they may easy led the block matching search into local minimum, the Rate-Distortion (R-D) performance will degrade dramatically. In this paper, we propose a novel multiple hexagon search algorithm to address this problem. Firstly, according to the original initial search point, four sub-search windows are constructed. Then, the hexagon based search algorithm will be performed respectively in the four sub-search windows. The final result is the best search point with the minimum R-D cost among the best points in the four sub-search windows. In order to trade off the computational complexity and R-D performance, two adaptive early termination strategies are proposed. The experimental results show that the proposed algorithm yields a quite promising coding performance in terms of R-D performance and computational complexity. Especially, the proposed algorithm can work well in multiview video sequences with various motion and disparity activities.

[1]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[2]  Itu-T and Iso Iec Jtc Advanced video coding for generic audiovisual services , 2010 .

[3]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[4]  B. Girod,et al.  Multiview Video Compression , 2007, IEEE Signal Processing Magazine.

[5]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[6]  Tao Yan,et al.  Early SKIP mode decision for MVC using inter-view correlation , 2010, Signal Process. Image Commun..

[7]  Sam Kwong,et al.  Efficient prediction algorithm of integer DCT coefficients for H.264/AVC optimization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[9]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Gangyi Jiang,et al.  Efficient Multi-Reference Frame Selection Algorithm for Hierarchical B Pictures in Multiview Video Coding , 2011, IEEE Transactions on Broadcasting.

[11]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[12]  Lap-Pui Chau,et al.  Hexagon-based search pattern for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[13]  C.-C. Jay Kuo,et al.  Fast Mode Decision Based on Mode Adaptation , 2010, IEEE Transactions on Circuits and Systems for Video Technology.