Adaptive vs. non‐adaptive strategies for the computation of optical flow

Confident adaptive algorithms are described, evaluated, and compared with other algorithms that implement the estimation of motion. A Galerkin finite element adaptive approach is described for computing optical flow, which uses an adaptive triangular mesh in which the resolution increases where motion is found to occur. The mesh facilitates a reduction in computational effort by enabling processing to focus on particular objects of interest in a scene. Compared with other state‐of‐the‐art methods in the literature our adaptive methods show only motion where main movement is known to occur, indicating a methodological improvement. The mesh refinement, based on detected motion, gives an alternative to methods reported in the literature, where the adaptation is usually based on a gradient intensity measure. A confidence is calculated for the detected motion and if this measure passes the threshold then the motion is used in the adaptive mesh refinement process. The idea of using the reliability hypothesis test is straightforward. The incorporation of the confidence serves the purpose of increasing the optical flow determination reliability. Generally, the confident flow seems most consistent, accurate and efficient, and focuses on the main moving objects within the image. © 2006 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 16, 35–50, 2006

[1]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[2]  Luc Florack,et al.  The Intrinsic Structure of Optic Flow Incorporating Measurement Duality , 1998, International Journal of Computer Vision.

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[5]  T. M. Chin,et al.  Probabilistic and sequential computation of optical flow using temporal coherence , 1994, IEEE Trans. Image Process..

[6]  Philip J. Morrow,et al.  Estimation of Motion through Inverse Finite Element Methods with Triangular Meshes , 2001, CAIP.

[7]  Isabelle Herlin,et al.  Non Uniform Multiresolution Method for Optical Flow and Phase Portrait Models: Environmental Applications , 2004, International Journal of Computer Vision.

[8]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[9]  Hans-Hellmut Nagel,et al.  Displacement vectors derived from second-order intensity variations in image sequences , 1983, Comput. Vis. Graph. Image Process..

[10]  David Suter,et al.  Robust Optic Flow Computation , 1998, International Journal of Computer Vision.

[11]  Nicholas Ayache,et al.  Dense Non-Rigid Motion Estimation in Sequences of Medical Images Using Differential Constraints , 2004, International Journal of Computer Vision.

[12]  Pierre Moulin,et al.  Multiscale modeling and estimation of motion fields for video coding , 1997, IEEE Trans. Image Process..

[13]  Philip J. Morrow,et al.  Adaptive Grid Refinement Procedures for Efficient Optical Flow Computation , 2004, International Journal of Computer Vision.

[14]  Andrea Giachetti,et al.  Refinement of Optical Flow Estimation and Detection of Motion Edges , 1996, ECCV.

[15]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[16]  Michael Spann,et al.  Robust Optical Flow Computation Based on Least-Median-of-Squares Regression , 1999, International Journal of Computer Vision.

[17]  David J. Fleet,et al.  Computation of normal velocity from local phase information , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Shang-Hong Lai,et al.  Reliable and Efficient Computation of Optical Flow , 1998, International Journal of Computer Vision.

[19]  Bryan Scotney,et al.  Evaluation of Inverse Finite Element Techniques for Gradient Based Motion Estimation , 2001 .

[20]  Heinrich Niemann,et al.  Finite element method for determination of optical flow , 1992, Pattern Recognit. Lett..