An O(1) disparity refinement method for stereo matching

Disparity refinement is the final step but also the timing bottleneck of stereo matching due to its high computational complexity. Weighted media filter refinement method and non-local refinement method are two typical refinement methods with O(N) computational complexity for each pixel where N indicates the maximum disparity. This paper presents an O(1) disparity refinement method based on belief aggregation and belief propagation. The aggregated belief, which means the possibility of correct disparity value, is efficiently computed on a minimum spanning tree first, and then the belief aggregation is fast performed on another minimum spanning tree in two sequential passes (first from leaf nodes to root, then from root to leaf nodes). Only 2 additions and 4 multiplications are required for each pixel at all disparity levels, so the computational complexity is O(1). Performance evaluation on Middlebury data sets shows that the proposed method has good performances both in accuracy and speed. We proposed an O(1) disparity refinement method for each pixel.Speed evaluation shows constant result due to O(1) computational complexity.Accuracy evaluation shows better performance than 2 typical refinement methods.

[1]  Neil A. Dodgson,et al.  Real-Time Spatiotemporal Stereo Matching Using the Dual-Cross-Bilateral Grid , 2010, ECCV.

[2]  Narendra Ahuja,et al.  A constant-space belief propagation algorithm for stereo matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Fatih Porikli,et al.  Constant time O(1) bilateral filtering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Jae Wook Jeon,et al.  Domain Transformation-Based Efficient Cost Aggregation for Local Stereo Matching , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[6]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[7]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, International Journal of Computer Vision.

[8]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Xiaoming Huang,et al.  A fast non-local disparity refinement method for stereo matching , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[10]  Gérard G. Medioni,et al.  3-D Surface Description from Binocular Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Manuel M. Oliveira,et al.  Domain transform for edge-aware image and video processing , 2011, SIGGRAPH 2011.

[13]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[14]  Weiming Dong,et al.  Segment-tree based cost aggregation for stereo matching with enhanced segmentation advantage , 2013, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Patrick Hébert,et al.  Median Filtering in Constant Time , 2007, IEEE Transactions on Image Processing.

[16]  M. Kass,et al.  Smoothed local histogram filters , 2010, SIGGRAPH 2010.

[17]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[18]  Alain Crouzil,et al.  Similarity measures for image matching despite occlusions in stereo vision , 2011, Pattern Recognit..

[19]  Enhua Wu,et al.  Constant Time Weighted Median Filtering for Stereo Matching and Beyond , 2013, 2013 IEEE International Conference on Computer Vision.

[20]  Qingxiong Yang,et al.  A non-local cost aggregation method for stereo matching , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Carlo Tomasi,et al.  A Pixel Dissimilarity Measure That Is Insensitive to Image Sampling , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Xing Mei,et al.  Stereo Matching with Reliable Disparity Propagation , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[23]  Minglun Gong,et al.  Near-real-time stereo matching with slanted surface modeling and sub-pixel accuracy , 2011, Pattern Recognit..

[24]  Parris K. Egbert,et al.  Fast 8-Bit Median Filtering Based on Separability , 2007, 2007 IEEE International Conference on Image Processing.