Enhancing accuracy and sharpness of motion field with adaptive scheme and occlusion-aware filter

In this study, the authors propose an adaptive scheme to improve motion estimation of a variational model based on image features and flow quality measurements. Using image features, the authors introduce adaptive functions and inject them into the energy function to fine-tune the estimation process. They propose a hybrid scheme to deal with large motions and improve the accuracy of the flow field. They introduce a trusted-map based on constraints to measure flow quality. They use this map as a reference for the proposed occlusion-aware filter. The proposed filter and hybrid scheme are integrated to correct the flow field iteratively, thus significantly improving the estimation results. The filter also enhances the flow field in occlusion areas. The authors experimental results demonstrate that their method provides sharp flow fields and significantly improved estimation accuracy.

[1]  Hans-Peter Seidel,et al.  Complementary Optic Flow , 2009, EMMCVPR.

[2]  Chandra Kambhamettu,et al.  Hierarchical belief propagation to reduce search space using CUDA for stereo and motion estimation , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[3]  Yücel Altunbasak,et al.  Motion estimation using block overlap minimization , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[4]  Michael J. Black,et al.  Layered image motion with explicit occlusions, temporal consistency, and depth ordering , 2010, NIPS.

[5]  Steven M. Seitz,et al.  Filter flow , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Alfred M. Bruckstein,et al.  Over-Parameterized Optical Flow Using a Stereoscopic Constraint , 2011, SSVM.

[7]  Jae Wook Jeon,et al.  Improving Motion Estimation Using Image-Driven Functions and Hybrid Scheme , 2011, PSIVT.

[8]  Frédéric Champagnat,et al.  Clarifying the implementation of warping in the combined local global method for optic flow computation , 2010, 2010 18th European Signal Processing Conference.

[9]  Timo Kohlberger,et al.  Discontinuity-Preserving Computation of Variational Optic Flow in Real-Time , 2005, Scale-Space.

[10]  Tristrom Cooke.  Two Applications of Graph-Cuts to Image Processing , 2008, 2008 Digital Image Computing: Techniques and Applications.

[11]  Daniel P. Huttenlocher,et al.  Learning for Optical Flow Using Stochastic Optimization , 2008, ECCV.

[12]  Nassir Navab,et al.  Optical flow estimation with uncertainties through dynamic MRFs , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[14]  Thomas Brox,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Highly Accurate Optic Flow Computation with Theoretically Justified Warping Highly Accurate Optic Flow Computation with Theoretically Justified Warping , 2022 .

[15]  Michael J. Black,et al.  Learning Optical Flow , 2008, ECCV.

[16]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[17]  Timo Kohlberger,et al.  A Multigrid Platform for Real-Time Motion Computation with Discontinuity-Preserving Variational Methods , 2006, International Journal of Computer Vision.

[18]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[19]  Horst Bischof,et al.  A Duality Based Approach for Realtime TV-L1 Optical Flow , 2007, DAGM-Symposium.

[20]  Sang Uk Lee,et al.  Optical flow estimation with adaptive convolution kernel prior on discrete framework , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Timo Kohlberger,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Variational Optic Flow Computation in Real-time Variational Optic Flow Computation in Real-time , 2022 .

[22]  Joachim Weickert,et al.  Towards ultimate motion estimation: combining highest accuracy with real-time performance , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[23]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[24]  D. Cremers,et al.  Duality TV-L1 flow with fundamental matrix prior , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[25]  Carsten Rother,et al.  FusionFlow: Discrete-continuous optimization for optical flow estimation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Hui Cheng,et al.  Bilateral Filtering-Based Optical Flow Estimation with Occlusion Detection , 2006, ECCV.

[27]  Jae Wook Jeon,et al.  Tuning optical flow estimation with image-driven functions , 2011, 2011 IEEE International Conference on Robotics and Automation.

[28]  Cheng Lei,et al.  Optical flow estimation on coarse-to-fine region-trees using discrete optimization , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[29]  Li Xu,et al.  A Segmentation Based Variational Model for Accurate Optical Flow Estimation , 2008, ECCV.

[30]  Xiaofeng Ren,et al.  Local grouping for optical flow , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[32]  Janusz Konrad,et al.  Occlusion-Aware Optical Flow Estimation , 2008, IEEE Transactions on Image Processing.

[33]  Horst Bischof,et al.  Motion estimation with non-local total variation regularization , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[35]  Daniel Cremers,et al.  An Improved Algorithm for TV-L 1 Optical Flow , 2009, Statistical and Geometrical Approaches to Visual Motion Analysis.