Duality TV-L1 flow with fundamental matrix prior

Variational techniques yield the most accurate results for dense optical flow fields between two images. They have the nice property of inherent smoothness to cope with untextured image regions: the filling-in of such regions is driven by neighbouring pixels. Such filling-in is not always the best choice. If the scene is mostly stationary and the camera is moving, the direction of the optical flow vectors can be restricted using the fundamental matrix. In this paper we propose an exact solution of the variational optical flow, using the fundamental matrix geometry as an additional weak prior. Our novel approach currently performs best on the Middlebury flow evaluation which includes images from stationary and dynamic scenes.

[1]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[4]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[5]  Fridtjof Stein,et al.  Efficient Computation of Optical Flow Using the Census Transform , 2004, DAGM-Symposium.

[6]  Timo Kohlberger,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Variational Optic Flow Computation in Real-time Variational Optic Flow Computation in Real-time , 2022 .

[7]  Antonin Chambolle,et al.  Total Variation Minimization and a Class of Binary MRF Models , 2005, EMMCVPR.

[8]  Uwe Franke,et al.  Kalman Filter based Detection of Obstacles and Lane Boundary in Monocular Image Sequences , 2005, AMS.

[9]  Joachim Weickert,et al.  Optic Flow Goes Stereo: A Variational Method for Estimating Discontinuity-Preserving Dense Disparity Maps , 2005, DAGM-Symposium.

[10]  Tony F. Chan,et al.  Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection , 2006, International Journal of Computer Vision.

[11]  Horst Bischof,et al.  A Duality Based Approach for Realtime TV-L1 Optical Flow , 2007, DAGM-Symposium.

[12]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[13]  Joachim Weickert,et al.  A Variational Model for the Joint Recovery of the Fundamental Matrix and the Optical Flow , 2008, DAGM-Symposium.

[14]  Jens Klappstein,et al.  Space-Time Multi-Resolution Banded Graph-Cut for Fast Segmentation , 2008, DAGM-Symposium.

[15]  J. Klappstein.  Optical-Flow Based Detection of Moving Objects in Traffic Scenes , 2008 .