Motion estimation using the fast and adaptive bidimensional empirical mode decomposition

Motion estimation is a basic step that can be used to serve several processes in computer vision. This motion is currently approximated by the visual displacement field called optical flow. Currently, several methods are used to estimate it, but a good compromise between computational cost and accuracy is hard to achieve. This paper tackles the problem by proposing a new technique based on the FABEMD (fast and adaptive bidimensional empirical mode decomposition) with the aim of improving the well-known pyramidal algorithm of Lucas and Kanade (LK) which, in principle, utilizes two consecutive frames extracted from video sequence to determine a dense optical flow. The proposed algorithm uses the FABEMD method to decompose each of the two considered frames into several BIMFs (bidimensional intrinsic mode functions) that are matched in number and proprieties. Thus, to compute the optical flow, the LK algorithm is applied to each of the two matching BIMFs which belong to the same mode of the decomposition. Although the implementation does not use an iterative refinement, the results show that the proposed approach is less sensitive to noise and provides improved motion estimation with a reduction of computing time compared to iterative methods.

[1]  Timo Kohlberger,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Variational Optic Flow Computation in Real-time Variational Optic Flow Computation in Real-time , 2022 .

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  C. L. Philip Chen,et al.  Optimization of Sensor Locations and Sensitivity Analysis for Engine Health Monitoring Using Minimum Interference Algorithms , 2007, 2007 IEEE International Conference on System of Systems Engineering.

[4]  Takeo Kanade,et al.  Optical flow estimation using wavelet motion model , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Edward H. Adelson,et al.  Probability distributions of optical flow , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Zheng Li-xin,et al.  Block Matching Algorithms for Motion Estimation , 2005 .

[7]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[8]  Sergio Saponara,et al.  Integrated video motion estimator with Retinex-like pre-processing for robust motion analysis in automotive scenarios: algorithmic and real-time architecture design , 2010, Journal of Real-Time Image Processing.

[9]  C.-C. Jay Kuo,et al.  Fast motion vector estimation using multiresolution-spatio-temporal correlations , 1997, IEEE Trans. Circuits Syst. Video Technol..

[10]  Martin Kraus,et al.  Pyramid filters based on bilinear interpolation , 2007, GRAPP.

[11]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[12]  Anna Linderhed,et al.  2D empirical mode decompositions in the spirit of image compression , 2002, SPIE Defense + Commercial Sensing.

[13]  Jean Claude Nunes,et al.  Image analysis by bidimensional empirical mode decomposition , 2003, Image Vis. Comput..

[14]  Vasileios Argyriou,et al.  A Study of Sub-pixel Motion Estimation using Phase Correlation , 2006, BMVC.

[15]  Markku Renfors,et al.  Code Tracking Algorithms for Mitigating Multipath Effects in Fading Channels for Satellite-Based Positioning , 2008, EURASIP J. Adv. Signal Process..

[16]  Alan C. Bovik,et al.  Handbook of Image and Video Processing (Communications, Networking and Multimedia) , 2005 .

[17]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[18]  Jesmin F. Khan,et al.  Fast and Adaptive Bidimensional Empirical Mode Decomposition Using Order-Statistics Filter Based Envelope Estimation , 2008, EURASIP J. Adv. Signal Process..

[19]  Jean Claude Nunes,et al.  Texture analysis based on local analysis of the Bidimensional Empirical Mode Decomposition , 2005, Machine Vision and Applications.

[20]  Jesmin F. Khan,et al.  A novel approach of fast and adaptive bidimensional empirical mode decomposition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[22]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[23]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[24]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[25]  Harold H. Szu,et al.  Wavelet and Independent Component Analysis Applications IX , 2002 .

[26]  P.N.T. Wells,et al.  Handbook of Image and Video Processing , 2001 .

[27]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.