Fast Edge-Based Stereo Matching Algorithms through Search Space Reduction

SUMMARY Finding corresponding edges is considered being the most difficult part of edge-based stereo matching algorithms. Usually, correspondence for a feature point in the first image is obtained by searching in a predefined region of the second image, based on epipolar line and maximum disparity. Reduction of search region can increase performances of the matching process, in the context of execution time and accuracy. Traditionally, hierarchical multiresolution techniques, as the fastest methods are used to decrease the search space and therefore increase the processing speed. Considering maximum of directional derivative of disparity in real scenes, we formulated some relations between maximum search space in the second images with respect to relative displacement of connected edges (as the feature points), in successive scan lines of the first images. Then we proposed a new matching strategy to reduce the search space for edge-based stereo matching algorithms. Afterward, we developed some fast stereo matching algorithms based on the proposed matching strategy and the hierarchical multiresolution techniques. The proposed algorithms have two stages: feature extraction and feature matching. We applied these new algorithms on some stereo images and compared their results with those of some hierarchical multiresolution ones. The execution times of our proposed methods are decreased between 30% to 55%, in the feature matching stage. Moreover, the execution time of the overall algorithms (including the feature extraction and the feature matching) is decreased between 15% to 40% in real scenes. Meanwhile in some cases, the accuracy is increased too. Theoretical investigation and experimental results show that our algorithms have a very good performance with real complex scenes, therefore these new algorithms are very suitable for fast edge-based stereo applications in real scenes like robotic applications.

[1]  Won-Ho Kim,et al.  Fast disparity estimation using geometric properties and selective sample decimation for stereoscopic image coding , 1999, IEEE Trans. Consumer Electron..

[2]  Karim Faez,et al.  Reduction of the search space region in the edge based stereo correspondence , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[3]  Herbert Jahn Parallel epipolar stereo matching , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Giulio Sandini,et al.  Trajectory planning and real-time control of an autonomous mobile robot equipped with vision and ultrasonic sensors , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[5]  J P Frisby,et al.  PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit , 1985, Perception.

[6]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[7]  Charles V. Stewart,et al.  Geometric constraints and stereo disparity computation , 1996, International Journal of Computer Vision.

[8]  Don Ray Murray,et al.  Stereo vision based mapping and navigation for mobile robots , 1997, Proceedings of International Conference on Robotics and Automation.

[9]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[10]  Yi-Ping Hung,et al.  Multipass hierarchical stereo matching for generation of digital terrain models from aerial images , 1998, Machine Vision and Applications.

[11]  Daniele D. Giusto,et al.  Hierarchical block matching for disparity estimation in stereo sequences , 1995, Proceedings., International Conference on Image Processing.

[12]  Masayuki Inaba,et al.  Real-time color stereo vision system for a mobile robot based on field multiplexing , 1997, Proceedings of International Conference on Robotics and Automation.

[13]  J.-G. Postaire,et al.  A neural implementation for high speed processing in linear stereo vision , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[14]  Charles V. Stewart,et al.  On the derivation of geometric constraints in stereo , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Narendra Ahuja,et al.  Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Ramakant Nevatia,et al.  Stereo Error Detection, Correction, and Evaluation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Shuichi Tanaka,et al.  A rule-based approach to binocular stereopsis , 1988 .

[18]  J. Mayhew,et al.  Disparity Gradient, Lipschitz Continuity, and Computing Binocular Correspondences , 1985 .

[19]  I. Masaki Three dimensional vision system for intelligent vehicles , 1993, Proceedings of IECON '93 - 19th Annual Conference of IEEE Industrial Electronics.

[20]  John Riley,et al.  Exploiting Walsh-based attributes to stereo vision , 1996, IEEE Trans. Signal Process..

[21]  S. Nayar,et al.  Ordinal Measures for Image Correspondence , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Karim Faez,et al.  Search Space Reduction in the Edge Based Stereo Correspondence , 2001, VMV.

[23]  Mohan M. Trivedi,et al.  Multi-Primitive Hierarchical (MPH) Stereo Analysis , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Shree K. Nayar,et al.  Ordinal Measures for Image Correspondence , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Joachim M. Buhmann,et al.  Real-time phase-based stereo for a mobile robot , 1996, Proceedings of the First Euromicro Workshop on Advanced Mobile Robots (EUROBOT '96).

[26]  Andreas F. Koschan,et al.  Towards real-time stereo employing parallel algorithms for edge-based and dense stereo matching , 1995, Proceedings of Conference on Computer Architectures for Machine Perception.

[27]  Adrian F. Clark,et al.  Periscopic stereo for virtual world creation , 1997 .

[28]  Martial Hebert,et al.  Weakly-calibrated stereo perception for rover navigation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[29]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[30]  H. K. Nishihara Real-time stereo- and motion-based figure ground discrimination and tracking using LOG sign correlation , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[31]  Wilfried Brauer,et al.  Intensity- and Gradient-Based Stereo Matching Using Hierarchical Gaussian Basis Functions , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Ze-Nian Li,et al.  Analysis of disparity gradient based cooperative stereo , 1996, IEEE Trans. Image Process..

[33]  B. Julesz,et al.  A disparity gradient limit for binocular fusion. , 1980, Science.

[34]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[35]  Gérard G. Medioni,et al.  3-D Surface Description from Binocular Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Julian Magarey,et al.  Multiresolution stereo image matching using complex wavelets , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).