Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Variational Optic Flow Computation in Real-time Variational Optic Flow Computation in Real-time

This paper investigates the usefulness of bidirectional multigrid methods for variational optical flow computations. Although these numerical schemes are among the fastest methods for solving equation systems, they are rarely applied in the field of computer vision. We demonstrate how to employ those numerical methods for the treatment of variational optical flow formulations and show that the efficiency of this approach even allows for real-time performance on standard PCs. As a representative for variational optic flow methods, we consider the recently introduced combined local-global method. It can be considered as a noise-robust generalization of the Horn and Schunck technique. We present a decoupled, as well as a coupled, version of the classical Gau/spl szlig/-Seidel solver, and we develop several multigrid implementations based on a discretization coarse grid approximation. In contrast, with standard bidirectional multigrid algorithms, we take advantage of intergrid transfer operators that allow for nondyadic grid hierarchies. As a consequence, no restrictions concerning the image size or the number of traversed levels have to be imposed. In the experimental section, we juxtapose the developed multigrid schemes and demonstrate their superior performance when compared to unidirectional multigrid methods and nonhierachical solvers. For the well-known 316/spl times/252 Yosemite sequence, we succeeded in computing the complete set of dense flow fields in three quarters of a second on a 3.06-GHz Pentium4 PC. This corresponds to a frame rate of 18 flow fields per second which outperforms the widely-used Gau/spl szlig/-Seidel method by almost three orders of magnitude.

[1]  Kazufumi Ito,et al.  Optimal Control Formulation for Determining Optical Flow , 2002, SIAM J. Sci. Comput..

[2]  Demetri Terzopoulos,et al.  Image Analysis Using Multigrid Relaxation Methods , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Wilfried Enkelmann,et al.  Investigations of multigrid algorithms for the estimation of optical flow fields in image sequences , 1988, Comput. Vis. Graph. Image Process..

[4]  A. Ravishankar Rao,et al.  Computing oriented texture fields , 1991, CVGIP Graph. Model. Image Process..

[5]  William L. Briggs,et al.  A multigrid tutorial, Second Edition , 2000 .

[6]  Joachim Weickert,et al.  Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow Methods , 2005, International Journal of Computer Vision.

[7]  Louis A. Hageman,et al.  Iterative Solution of Large Linear Systems. , 1971 .

[8]  F. Glazer Multilevel Relaxation in Low-Level Computer Vision , 1984 .

[9]  D. Brandt,et al.  Multi-level adaptive solutions to boundary-value problems math comptr , 1977 .

[10]  Long Chen INTRODUCTION TO MULTIGRID METHODS , 2005 .

[11]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[12]  W. Clem Karl,et al.  Efficient multiscale regularization with applications to the computation of optical flow , 1994, IEEE Trans. Image Process..

[13]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[14]  Timo Kohlberger,et al.  Parallel Variational Motion Estimation by Domain Decomposition and Cluster Computing , 2004, ECCV.

[15]  Ulrich Rüde,et al.  A Variational Multigrid for Computing the Optical Flow , 2003, VMV.

[16]  Joachim Weickert,et al.  A Theoretical Framework for Convex Regularizers in PDE-Based Computation of Image Motion , 2001, International Journal of Computer Vision.

[17]  Patrick Pérez,et al.  Dense estimation and object-based segmentation of the optical flow with robust techniques , 1998, IEEE Trans. Image Process..

[18]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[19]  C. Lamberti,et al.  Application of continuum theory and multi-grid methods to motion evaluation from 3D echocardiography , 1997, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[20]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[21]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Timo Kohlberger,et al.  Real-Time Optic Flow Computation with Variational Methods , 2003, CAIP.

[23]  Sugata Ghosal,et al.  A Fast Scalable Algorithm for Discontinuous Optical Flow Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Joachim Weickert,et al.  Combining the Advantages of Local and Global Optic Flow Methods , 2002, DAGM-Symposium.

[25]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[26]  P. Deuflhard,et al.  The cascadic multigrid method for elliptic problems , 1996 .

[27]  William L. Briggs,et al.  A multigrid tutorial , 1987 .

[28]  Brendan McCane,et al.  Recovering Motion Fields: An Evaluation of Eight Optical Flow Algorithms , 1998, BMVC.

[29]  Dr. M. G. Worster Methods of Mathematical Physics , 1947, Nature.

[30]  Hans-Hellmut Nagel,et al.  Estimation of Optical Flow Based on Higher-Order Spatiotemporal Derivatives in Interlaced and Non-Interlaced Image Sequences , 1995, Artif. Intell..

[31]  Johan Wiklund,et al.  Multidimensional Orientation Estimation with Applications to Texture Analysis and Optical Flow , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.