Performance of optical flow techniques

While different optical flow techniques continue to appear, there has been a lack of quantitative evaluation of existing methods. For a common set of real and synthetic image sequences, we report the results of a number of regularly cited optical flow techniques, including instances of differential, matching, energy-based, and phase-based methods. Our comparisons are primarily empirical, and concentrate on the accuracy, reliability, and density of the velocity measurements; they show that performance can differ significantly among the techniques we implemented.

[1]  Paul Beaudet,et al.  Rotationally invariant image operators , 1978 .

[2]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[3]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[5]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[6]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[7]  Hans-Hellmut Nagel,et al.  Displacement vectors derived from second-order intensity variations in image sequences , 1983, Comput. Vis. Graph. Image Process..

[8]  Hilary Buxton,et al.  Computation of optic flow from the motion of edge features in image sequences , 1984, Image Vis. Comput..

[9]  E. Hildreth.  The computation of the velocity field , 1984, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[11]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[12]  Allen M. Waxman,et al.  Contour Evolution, Neighborhood Deformation, and Global Image Flow: Planar Surfaces in Motion , 1985 .

[13]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[14]  B. D. Lucas.  Generalized image matching by the method of differences , 1985 .

[15]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Joseph K. Kearney,et al.  Optical Flow Estimation: An Error Analysis of Gradient-Based Methods with Local Optimization , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Shahriar Negahdaripour,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence , 2004 .

[18]  P. Anandan.  Measuring Visual Motion From Image Sequences , 1987 .

[19]  B. Jähne.  Image sequence analysis of complex physical objects: nonlinear small scale water surface waves , 1987, ICCV 1987.

[20]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[21]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[22]  Alessandro Verri,et al.  Against Quantitative Optical Flow , 1987 .

[23]  James J. Little,et al.  Parallel Optical Flow Using Local Voting , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[24]  James H. Duncan,et al.  Temporal Edges: The Detection Of Motion And The Computation Of Optical Flow , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[25]  HANS-HELLMUT NAGEL,et al.  On a Constraint Equation for the Estimation of Displacement Rates in Image Sequences , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[27]  A. Verri,et al.  Analysis of differential and matching methods for optical flow , 1989, [1989] Proceedings. Workshop on Visual Motion.

[28]  A. Verri,et al.  Constraints for the computation of optical flow , 1989, [1989] Proceedings. Workshop on Visual Motion.

[29]  Edward M. Riseman,et al.  A data set for quantitative motion analysis , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  A. Yuille,et al.  A model for the estimate of local image velocity by cells in the visual cortex , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[31]  Giulio Sandini,et al.  Estimation of depth from motion using an anthropomorphic visual sensor , 1990, Image Vis. Comput..

[32]  Giulio Sandini,et al.  On The Estimation Of Depth From Motion Using An Anthropomorphic Visual Sensor , 1990, ECCV.

[33]  Ajit Singh,et al.  An estimation-theoretic framework for image-flow computation , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[34]  G. Granlund,et al.  Estimation of velocity, acceleration and disparity in time sequences , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[35]  Johan Wiklund,et al.  Multidimensional Orientation Estimation with Applications to Texture Analysis and Optical Flow , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Yee-Hong Yang,et al.  Experimental evaluation of motion constraint equations , 1991, CVGIP Image Underst..

[37]  Ajit Singh,et al.  Optic flow computation : a unified perspective , 1991 .

[38]  Leif Haglund,et al.  Adaptive Multidimensional Filtering , 1991 .

[39]  David J. Fleet,et al.  Phase singularities in scale-space , 1991, Image Vis. Comput..

[40]  Edward H. Adelson,et al.  Probability distributions of optical flow , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  David J. Fleet,et al.  Performance of optical flow techniques , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[42]  Yiannis Aloimonos,et al.  Active Egomotion Estimation: A Qualitative Approach , 1992, ECCV.

[43]  Andrew Blake,et al.  Surface Orientation and Time to Contact from Image Divergence and Deformation , 1992, ECCV.

[44]  David J. Fleet.  Measurement of image velocity , 1992 .

[45]  David J. Fleet,et al.  Stability of Phase Information , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Eero P. Simoncelli.  Distributed representation and analysis of visual motion , 1993 .

[47]  Allan D. Jepson,et al.  Subspace methods for recovering rigid motion I: Algorithm and implementation , 2004, International Journal of Computer Vision.

[48]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[49]  A. Verri,et al.  A computational approach to motion perception , 1988, Biological Cybernetics.

[50]  David J. Heeger,et al.  Optical flow using spatiotemporal filters , 2004, International Journal of Computer Vision.

[51]  John K. Tsotsos,et al.  The feasibility of motion and structure from noisy time-varying image velocity information , 1991, International Journal of Computer Vision.

[52]  Berthold K. P. Horn,et al.  Direct methods for recovering motion , 1988, International Journal of Computer Vision.

[53]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.