Projection based advanced motion model for cubic mapping for 360-degree video

This paper proposes a novel advanced motion model to handle the irregular motion for the cubic map projection of 360-degree video. Since the irregular motion is mainly caused by the projection from the sphere to the cube map, we first try to project the pixels in both the current picture and reference picture from unfolding cube back to the sphere. Then through utilizing the characteristic that most of the motions in the sphere are uniform, we can derive the relationship between the motion vectors of various pixels in the unfold cube. The proposed advanced motion model is implemented in the High Efficiency Video Coding reference software. Experimental results demonstrate that quite obvious performance improvement can be achieved for the sequences with obvious motions.

[1]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[2]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Thomas Wiegand,et al.  Affine multipicture motion-compensated prediction , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[5]  Wen Gao,et al.  A comparison of fractional-pel interpolation filters in HEVC and H.264/AVC , 2012, 2012 Visual Communications and Image Processing.

[6]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  A. Navarro,et al.  Improvements to TZ search motion estimation algorithm for multiview video coding , 2012, 2012 19th International Conference on Systems, Signals and Image Processing (IWSSIP).

[8]  Yao Zhao,et al.  Control-Point Representation and Differential Coding Affine-Motion Compensation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Madhukar Budagavi,et al.  Motion estimation and compensation for fisheye warped video , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[10]  André Kaup,et al.  Motion estimation for fisheye video sequences combining perspective projection with camera calibration information , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[11]  Miska M. Hannuksela,et al.  Fisheye video coding using elastic motion compensated reference frames , 2016, 2016 IEEE International Conference on Image Processing (ICIP).