Very high accuracy velocity estimation using orientation tensors

In a previous paper, the author presented a new velocity estimation algorithm, using orientation tensors and parametric motion models to provide both fast and accurate results. One of the tradeoffs between accuracy and speed was that no attempts were made to obtain regions of coherent motion when estimating the parametric models. In this paper we show how this can be improved by doing a simultaneous segmentation of the motion field. The resulting algorithm is slower than the previous one, but more accurate. This is shown by evaluation on the well-known Yosemite sequence, where already the previous algorithm showed an accuracy which was substantially better than for earlier published methods. This result has now been improved further.

[1]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[3]  Jörgen Karlholm,et al.  Local Signal Models for Image Sequence Analysis , 1998 .

[4]  Josef Bigun.  Local symmetry features in image processing , 1988 .

[5]  Michael J. Black,et al.  Skin and bones: multi-layer, locally affine, optical flow and regularization with transparency , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Gunnar Farnebäck.  Orientation Estimation Based on Weighted Projection onto Quadratic Polynomials , 2000, VMV.

[7]  Leif Haglund,et al.  Adaptive Multidimensional Filtering , 1991 .

[8]  S. Lippman,et al.  The Scripps Institution of Oceanography , 1959, Nature.

[9]  C. Westin.  A Tensor Framework for Multidimensional Signal Processing , 1994 .

[10]  Frederic Dufaux,et al.  Segmentation-Based Motion Estimation for Second Generation Video Coding Techniques , 1996 .

[11]  Gunnar Farnebäck,et al.  Fast and Accurate Motion Estimation Using Orientation Tensors and Parametric Motion Models , 2000, ICPR.

[12]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[13]  Hans Knutsson,et al.  Signal processing for computer vision , 1994 .

[14]  Michael J. Black,et al.  Estimating Optical Flow in Segmented Images Using Variable-Order Parametric Models With Local Deformations , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Richard Szeliski,et al.  Hierarchical spline-based image registration , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Hans Knutsson,et al.  Estimation of Velocity and Acceleration in Time Sequences , 1991 .

[17]  Gunnar Farnebäck.  Motion-based segmentation of image sequences , 1996 .

[18]  Gunnar Farnebäck.  Spatial Domain Methods for Orientation and Velocity Estimation , 1999 .