A new motion model for panoramic video coding

Virtual reality (VR) has been a hot topic in both research and industry, calling for more efficient compression of panoramic videos. Currently, panoramic video is played as if it is spherical, but such video is actually mapped to planar video, e.g. using equirectangular projection, before compression and transmission. The projection causes deformation and thus makes the traditional translational motion model not efficient. In this paper, we propose a new motion model based on spherical coordinates transform to compensate for the deformation in panoramic videos. Our model requires no additional motion vector but rather derives pixel-wise 2D motion vectors from a block-level 3D motion vector. Our experimental results show the significant bits saving achieved by the new model, which leads to as high as 8.0% BD-rate on the test sequences.

[1]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Madhukar Budagavi,et al.  Motion estimation and compensation for fisheye warped video , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[3]  J. Snyder Flattening the Earth: Two Thousand Years of Map Projections , 1994 .

[4]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Houqiang Li,et al.  An affine motion compensation framework for high efficiency video coding , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[6]  André Kaup,et al.  Motion estimation for fisheye video sequences combining perspective projection with camera calibration information , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[7]  Miska M. Hannuksela,et al.  Fisheye video coding using elastic motion compensated reference frames , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  Zheng Jiali,et al.  Panoramic video coding using affine motion compensated prediction , 2007, MM 2007.

[9]  Zehdreh Allen-Lafayette,et al.  Flattening the Earth, Two Thousand Years of Map Projections , 1998 .