Optic flow based on multi-scale anchor point movement and discontinuity-preserving regularization

We introduce a new method to determine the flow field of an image sequence using multi-scale anchor points. These anchor points manifest themselves in the scale-space representation of an image. The novelty of our method lies largely in the fact that the relation between the scale-space anchor points and the flow field is formulated in terms of soft constraints in a variational method. This leads to an algorithm for the computation of the flow field that differs fundamentally from previously proposed ones based on hard constraints. We show a significant performance increase when our method is applied to the Yosemite image sequence, a standard and well-established benchmark sequence in optic flow research. Also, it is shown that this performance is not sensitive to slight changes in the two parameters used and that, with the same parameter values, our method yields very good results in the Rubber Whale image sequence as well.

[1]  Thomas Brox,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Highly Accurate Optic Flow Computation with Theoretically Justified Warping Highly Accurate Optic Flow Computation with Theoretically Justified Warping , 2022 .

[2]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[3]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[4]  Luc Florack,et al.  The Topological Structure of Scale-Space Images , 2000, Journal of Mathematical Imaging and Vision.

[5]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[6]  Thomas Brox,et al.  Variational Motion Segmentation with Level Sets , 2006, ECCV.

[7]  Joachim Weickert,et al.  Variational Optic Flow Computation with a Spatio-Temporal Smoothness Constraint , 2001, Journal of Mathematical Imaging and Vision.

[8]  Max A. Viergever,et al.  Scale Space Hierarchy , 2003, Journal of Mathematical Imaging and Vision.

[9]  Luc Florack,et al.  Image Structure , 1997, Computational Imaging and Vision.

[10]  Mads Nielsen,et al.  What Do Features Tell about Images? , 2001, Scale-Space.

[11]  Nahum Kiryati,et al.  Piecewise-Smooth Dense Optical Flow via Level Sets , 2006, International Journal of Computer Vision.

[12]  Mads Nielsen,et al.  Feature-Based Image Analysis , 2003, International Journal of Computer Vision.

[13]  Patrick Bouthemy,et al.  Computation and analysis of image motion: A synopsis of current problems and methods , 1996, International Journal of Computer Vision.

[14]  Luc Florack,et al.  Optic Flow from Multi-scale Dynamic Anchor Point Attributes , 2006, ICIAR.

[15]  Luc Florack,et al.  Towards a New Paradigm for Motion Extraction , 2006, ICIAR.

[16]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[17]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[19]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.

[20]  Robert Gilmore,et al.  Catastrophe Theory for Scientists and Engineers , 1981 .

[21]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[22]  Gerald Sommer,et al.  Dense Optical Flow Estimation from the Monogenic Curvature Tensor , 2007, SSVM.

[23]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[24]  Luc Florack,et al.  Coarse-to-Fine Image Reconstruction Based on Weighted Differential Features and Background Gauge Fields , 2009, SSVM.

[25]  Timo Kohlberger,et al.  A Multigrid Platform for Real-Time Motion Computation with Discontinuity-Preserving Variational Methods , 2006, International Journal of Computer Vision.

[26]  Ajit Singh,et al.  An estimation-theoretic framework for image-flow computation , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[27]  J. Damon.  Local Morse Theory for Solutions to the Heat Equation and Gaussian Blurring , 1995 .

[28]  Alfred M. Bruckstein,et al.  Over-Parameterized Variational Optical Flow , 2007, International Journal of Computer Vision.

[29]  Bart M. ter Haar Romeny,et al.  Front-End Vision and Multi-Scale Image Analysis , 2003, Computational Imaging and Vision.

[30]  Luc Florack,et al.  A Linear Image Reconstruction Framework Based on Sobolev Type Inner Products , 2005, International Journal of Computer Vision.

[31]  Joachim Weickert,et al.  Reliable Estimation of Dense Optical Flow Fields with Large Displacements , 2000, International Journal of Computer Vision.

[32]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.