A fast area-based stereo matching algorithm

Abstract This paper proposes an area-based stereo algorithm suitable to real time applications. The core of the algorithm relies on the uniqueness constraint and on a matching process that rejects previous matches as soon as more reliable ones are found. The proposed approach is also compared with bidirectional matching (BM), since the latter is the basic method for detecting unreliable matches in most area-based stereo algorithms. We describe the algorithm's matching core, the additional constraints introduced to improve the reliability and the computational optimizations carried out to achieve a very fast implementation. We provide a large set of experimental results, obtained on a standard set of images with ground-truth as well as on stereo sequences, and computation time measurements. These data are used to evaluate the proposed algorithm and compare it with a well-known algorithm based on BM.

[1]  J. Hesser,et al.  Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[2]  Vladimir M. Pentkovski,et al.  Implementing Streaming SIMD Extensions on the Pentium III Processor , 2000, IEEE Micro.

[3]  Luigi di Stefano,et al.  Fast stereo matching for the VIDET system using a general purpose processor with multimedia extensions , 2000, Proceedings Fifth IEEE International Workshop on Computer Architectures for Machine Perception.

[4]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[5]  Emanuele Trucco,et al.  Symmetric Stereo with Multiple Windowing , 2000, Int. J. Pattern Recognit. Artif. Intell..

[6]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Takeo Kanade,et al.  Development of a video-rate stereo machine , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[8]  Gooitzen S. van der Wal,et al.  The Acadia vision processor , 2000, Proceedings Fifth IEEE International Workshop on Computer Architectures for Machine Perception.

[9]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[10]  Luigi di Stefano,et al.  Dense stereo based on the uniqueness constraint , 2002, Object recognition supported by user interaction for service robots.

[11]  M. Okutomi,et al.  A simple stereo algorithm to recover precise object boundaries and smooth surfaces , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[12]  Pascal Fua,et al.  Combining Stereo and Monocular Information to Compute Dense Depth Maps that Preserve Depth Discontinuities , 1991, IJCAI.

[13]  Oliver. Faugeras,et al.  Real time correlation based stereo algorithm and application , 1993 .

[14]  Uri C. Weiser,et al.  MMX technology extension to the Intel architecture , 1996, IEEE Micro.

[15]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[16]  Jonathan M. Garibaldi,et al.  Real-Time Correlation-Based Stereo Vision with Reduced Border Errors , 2002, International Journal of Computer Vision.

[17]  Reinhard Männer,et al.  Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation , 2004, International Journal of Computer Vision.

[18]  Geoffrey Egnal,et al.  Detecting binocular half-occlusions: empirical comparisons of four approaches , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Changming Sun.  A Fast Stereo Matching Method , 1997 .

[20]  A. Verri,et al.  A compact algorithm for rectification of stereo pairs , 2000 .

[21]  Ruby B. Lee.  Multimedia extensions for general-purpose processors , 1997, 1997 IEEE Workshop on Signal Processing Systems. SiPS 97 Design and Implementation formerly VLSI Signal Processing.