PRECISE DISPARITY ESTIMATION FOR NARROW BASELINE STEREO BASED ON MULTISCALE SUPERPIXELS AND PHASE CORRELATION

Abstract. With the rapid development of subpixel matching algorithms, the estimation of image shifts with an accuracy of higher than 0.05 pixels is achieved, which makes the narrow baseline stereovision possible. Based on the subpixel matching algorithm using the robust phase correlation (PC), in this work, we present a novel hierarchical and adaptive disparity estimation scheme for narrow baseline stereo, which consists of three main steps: image coregistration, pixel-level disparity estimation, and subpixel refinement. The Fourier-Mellin transform with subpixel PC is used to co-register two input images. Then, the pixel-level disparities are estimated in an iterative manner, which is achieved through multiscale superpixels. The pixel-level PC is performed with the window sizes and locations adaptively determined according to superpixels, with the disparity values calcualted. Fast weighted median filtering based on edge-aware filter is adopted to refine the disparity results. At last, the accurate disparities are calculated via a robust subpixel PC method. The combination of multiscale superpixel hierarchy, adaptive determination of the window size and location of correlation, fast weighted median filtering and subpixel PC make the proposed scheme be able to overcome the issues of either low-texture areas or fattening effect. Experimental results on a pair of UAV images and the comparison with the fixed-window PC methods, the iterative scheme with fixed variation strategy, and a sophisticated implementation using global optimization demonstrate the superiority and reliability of the proposed scheme.

[1]  Jianguo Liu,et al.  Precise Subpixel Disparity Measurement From Very Narrow Baseline Stereo , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[3]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[4]  Yusheng Xu,et al.  A Novel Subpixel Phase Correlation Method Using Singular Value Decomposition and Unified Random Sample Consensus , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Julie Delon,et al.  Small Baseline Stereovision , 2007, Journal of Mathematical Imaging and Vision.

[6]  Jie Li,et al.  Hierarchical and Adaptive Phase Correlation for Precise Disparity Estimation of UAV Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Chengcheng Guo,et al.  Illumination-Robust Subpixel Fourier-Based Image Correlation Methods Based on Phase Congruency , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Enhua Wu,et al.  Constant Time Weighted Median Filtering for Stereo Matching and Beyond , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  M. Pierrot-Deseilligny,et al.  A MULTIRESOLUTION AND OPTIMIZATION-BASED IMAGE MATCHING APPROACH : AN APPLICATION TO SURFACE RECONSTRUCTION FROM SPOT 5-HRS STEREO IMAGERY , 2006 .

[10]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[11]  T. Higuchi,et al.  A Subpixel Image Matching Technique Using Phase-Only Correlation , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[12]  Michael T. Orchard,et al.  A fast direct Fourier-based algorithm for subpixel registration of images , 2001, IEEE Trans. Geosci. Remote. Sens..

[13]  Ye Zhen,et al.  Generating DEM of Very Narrow Baseline Stereo Using Multispectral Images , 2013 .

[14]  Takeshi Arai,et al.  Fine image matching for narrow baseline stereovision , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[15]  Neus Sabater,et al.  How Accurate Can Block Matches Be in Stereo Vision? , 2011, SIAM J. Imaging Sci..

[16]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  T. Higuchi,et al.  A Sub-Pixel Correspondence Search Technique for Computer Vision Applications , 2004 .

[18]  Sébastien Leprince,et al.  Automatic and Precise Orthorectification, Coregistration, and Subpixel Correlation of Satellite Images, Application to Ground Deformation Measurements , 2007, IEEE Transactions on Geoscience and Remote Sensing.