Accurate dense optical flow estimation using adaptive structure tensors and a parametric model

An accurate optical flow estimation algorithm is proposed in this paper. By combining the three-dimensional (3D) structure tensor with a parametric flow model, the optical flow estimation problem is converted to a generalized eigenvalue problem. The optical flow can be accurately estimated from the generalized eigenvectors. The confidence measure derived from the generalized eigenvalues is used to adaptively adjust the coherent motion region to further improve the accuracy. Experiments using both synthetic sequences with ground truth and real sequences illustrate our method. Comparisons with classical and recently published methods are also given to demonstrate the accuracy of our algorithm.

[1]  David J. Fleet,et al.  Likelihood functions and confidence bounds for total-least-squares problems , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[2]  Jitendra Malik,et al.  Robust computation of optical flow in a multi-scale differential framework , 2005, International Journal of Computer Vision.

[3]  B. Jähne Image sequence analysis of complex physical objects: nonlinear small scale water surface waves , 1987, ICCV 1987.

[4]  Peter Meer,et al.  A general method for Errors-in-Variables problems in computer vision , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  H. Spies,et al.  Accurate optical flow in noisy image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  David J. Fleet,et al.  Computing Optical Flow with Physical Models of Brightness Variation , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Hanno Scharr,et al.  Study of Dynamical Processes with Tensor-Based Spatiotemporal Image Processing Techniques , 1998, ECCV.

[8]  Rama Chellappa,et al.  A General Motion Model and Spatio-Temporal Filters for Computing Optical Flow , 1994, International Journal of Computer Vision.

[9]  Gunnar Farnebäck Very high accuracy velocity estimation using orientation tensors , 2001, ICCV 2001.

[10]  Gunnar Farnebäck,et al.  Fast and Accurate Motion Estimation Using Orientation Tensors and Parametric Motion Models , 2000, ICPR.

[11]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[12]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[13]  Gunnar Farnebäck Spatial Domain Methods for Orientation and Velocity Estimation , 1999 .

[14]  Bernd Jähne,et al.  Spatio-Temporal Image Processing , 1993, Lecture Notes in Computer Science.