Optical Flow-Based Fast Motion Parameters Estimation for Affine Motion Compensation

This study proposes a lightweight solution to estimate affine parameters in affine motion compensation. Most of the current approaches start with an initial approximation based on the standard motion estimation, which only estimates the translation parameters. From there, iterative methods are used to find the best parameters, but they require a significant amount of time. The proposed method aims to speed up the process in two ways, first, skip evaluating affine prediction when it is likely to bring no encoding efficiency benefit, and second, by estimating better initial values for the iteration process. We use the optical flow between the reference picture and the current picture to estimate quickly the best encoding mode and get a better initial estimation. We achieve a reduction in encoding time over the reference of half when compared to the state of the art, with a loss in efficiency below 1%.

[1]  Cordelia Schmid,et al.  EpicFlow: Edge-preserving interpolation of correspondences for optical flow , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Jens-Rainer Ohm,et al.  Improved higher order motion compensation in HEVC with block-to-block translational shift compensation , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[3]  Mathias Wien,et al.  Distance scaling of higher order motion parameters in an extension of HEVC , 2016, 2016 Picture Coding Symposium (PCS).

[4]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Oleg G. Ponomarev,et al.  Fast Rate Estimation for RDO Mode Decision in HEVC , 2014, Entropy.

[7]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[8]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Matthias Narroschke,et al.  Extending HEVC by an affine motion model , 2013, 2013 Picture Coding Symposium (PCS).

[10]  Cordula Heithausen,et al.  Motion compensation with higher order motion models for HEVC , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  David Taubman,et al.  HEVC-EPIC: Fast Optical Flow Estimation From Coded Video via Edge-Preserving Interpolation , 2018, IEEE Transactions on Image Processing.

[12]  Wei-Jung Chien,et al.  An Improved Framework of Affine Motion Compensation in Video Coding , 2019, IEEE Transactions on Image Processing.

[13]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[14]  Dong Liu,et al.  An Efficient Four-Parameter Affine Motion Model for Video Coding , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Toshiyuki Yoshida,et al.  Block-Matching-Based Implementation of Affine Motion Estimation for HEVC , 2018, IEICE Trans. Inf. Syst..