Weighted root mean square approach to select the optimal smoothness parameter of the variational optical flow algorithms

Variational methods are the most widely used approaches for optical flow computation. Many complicated algorithms have been proposed to improve their performance, yet little work has focused on how to select the optimal smoothness parameter λ of the variational optical flow algorithm itself. We present a weighted root mean square error method to automatically select the optimal smoothness parameter λ. Furthermore, we detail a scientific method for selecting the reference λ0 based on the quality of the frame, and propose an efficient brute-force approach to assign a group of λ, that will reduce the number of λ candidates to be tested by cutting down the search range. Experimental results validate the effectiveness of our methods.

[1]  Timo Kohlberger,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Variational Optic Flow Computation in Real-time Variational Optic Flow Computation in Real-time , 2022 .

[2]  Rudolf Mester,et al.  Bayesian Model Selection for Optical Flow Estimation , 2007, DAGM-Symposium.

[3]  Iain Matthews,et al.  Efficient Image Alignment with Outlier Rejection , 2002 .

[4]  Dmitry Chetverikov,et al.  Illumination-robust variational optical flow using cross-correlation , 2010, Comput. Vis. Image Underst..

[5]  Nikolas P. Galatsanos,et al.  Methods for choosing the regularization parameter and estimating the noise variance in image restoration and their relation , 1992, IEEE Trans. Image Process..

[6]  Edward H. Adelson,et al.  Human-assisted motion annotation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[8]  Seth J. Teller,et al.  Particle Video: Long-Range Motion Estimation Using Point Trajectories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Horst Bischof,et al.  A Duality Based Approach for Realtime TV-L1 Optical Flow , 2007, DAGM-Symposium.

[10]  Joachim Weickert,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Optic Flow in Harmony Optic Flow in Harmony Optic Flow in Harmony , 2022 .

[11]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[13]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[14]  Victor Solo,et al.  A data-driven method for choosing smoothing parameters in optical flow problems , 1997, Proceedings of International Conference on Image Processing.

[15]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[16]  Michael J. Black,et al.  Learning Optical Flow , 2008, ECCV.

[17]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[18]  Mark A. Lukas,et al.  Methods for choosing the regularization parameter , 1992 .

[19]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.