Motion estimation via hierarchical block matching and graph cut

Block matching based motion estimation algorithms are adopted in numerous practical video processing applications due to their low complexity. However, conventional block matching based methods process each block independently to minimize the energy function, which results in a local minimum. It fails to preserve the motion details. In this paper, we formulate the motion estimation as a labeling problem. The candidate labels are initialized by adopting a hierarchical block matching method. Then, we employ a graph cut algorithm to efficiently solve the global labeling problem with candidate labels. Experimental results show that the proposed approach can well preserve the motion details and outperforms all other block based motion estimation methods in terms of endpoint error and angle error on the Middleburry optical flow benchmark.

[1]  Borko Furht,et al.  Motion estimation algorithms for video compression , 1996 .

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Jörn Ostermann,et al.  Decoder-side hierarchical motion estimation for dense vector fields , 2010, 28th Picture Coding Symposium.

[4]  Yücel Altunbasak,et al.  Joint Framework for Motion Validity and Estimation Using Block Overlap , 2013, IEEE Transactions on Image Processing.

[5]  Gerard de Haan,et al.  Smoothness Constraints in Recursive Search Motion Estimation for Picture Rate Conversion , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Daniel Cremers,et al.  Structure- and motion-adaptive regularization for high accuracy optic flow , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[9]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Daniel Cremers,et al.  An Improved Algorithm for TV-L 1 Optical Flow , 2009, Statistical and Geometrical Approaches to Visual Motion Analysis.

[11]  Sebastian Fischer,et al.  Exploring Artificial Intelligence In The New Millennium , 2016 .

[12]  Gerard de Haan,et al.  Sub-pixel motion estimation with 3-D recursive search block-matching , 1994, Signal Process. Image Commun..

[13]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Yasuyuki Matsushita,et al.  Motion detail preserving optical flow estimation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.