Dense disparity estimation based on the bi-dimensional empirical mode decomposition and Riesz transformation

This paper proposed to apply the Bi-dimensional Empirical Mode Decomposition (BEMD) to the dense disparity estimation problem. The BEMD is a fully data-driven method and does not need predetermined filter and wavelet functions. It is locally adaptive and has obvious advantages in analyzing non-linear and non-stationary signals. Firstly we decompose the original stereo images by 2D-sifting process of the BEMD respectively. Through this procedure, a serial of Intrinsic Mode Functions (IMFs) and a residue are achieved. The residue denotes the DC component of the signal. Secondly, subtract the residue from original image. The resulting two dimensional signals can be thought of being free of disturbing frequencies, such as noise and illumination components. Subsequently, to obtain robust local structure information of the images, the plural Riesz transformation is utilized to achieve corresponding 2D analytic signals of the images. Thirdly, extract local phase information of the analytic signals. The similarity of local phase of stereo images, instead of local intensity information, are taken as the basis of calculating matching cost, which could reveal local structure with more robustness. At last, dense disparity map is estimated based on the proposed method. The winnertakes-all (WTA) strategy is applied to compute disparity of each pixel separately. Comparative experiment is conducted to compare the performance of the method with intensity-based methods. Rather good results have been achieved.

[1]  T. Sanger,et al.  Stereo disparity computation using Gabor filters , 1988, Biological Cybernetics.

[2]  Balasubramanian Raman,et al.  Dual tree fractional quaternion wavelet transform for disparity estimation. , 2014, ISA transactions.

[3]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[4]  Xiaodong Huang,et al.  Dense disparity estimation based on the continuous wavelet transform [stereo image analysis] , 2004, Canadian Conference on Electrical and Computer Engineering 2004 (IEEE Cat. No.04CH37513).

[5]  David J. Fleet,et al.  Phase-based disparity measurement , 1991, CVGIP Image Underst..

[6]  Jean Claude Nunes,et al.  Image analysis by bidimensional empirical mode decomposition , 2003, Image Vis. Comput..

[7]  Michael Hansen,et al.  Optimization of Stereo Disparity Estimation Using the Instantaneous Frequency , 1997, CAIP.

[8]  Antonios Gasteratos,et al.  Review of Stereo Vision Algorithms: From Software to Hardware , 2008 .

[9]  Jean Claude Nunes,et al.  Empirical Mode Decomposition: Applications on Signal and Image Processing , 2009, Adv. Data Sci. Adapt. Anal..

[10]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[11]  W. van der Mark,et al.  A comparative study of fast dense stereo vision algorithms , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[12]  Dimitri Van De Ville,et al.  Multiresolution Monogenic Signal Analysis Using the Riesz–Laplace Wavelet Transform , 2009, IEEE Transactions on Image Processing.

[13]  Miao Liao,et al.  Real-time stereo using approximated joint bilateral filtering and dynamic programming , 2012, Journal of Real-Time Image Processing.