Trinocular Stereo: Theoretical Advantages and a New Algorithm

This paper presents a new three-camera stereo matching algorithm, called the Trinocular Local Matching Algorithm (TLMA), that helps to overcome some of the inherent problems in binocular matching. These problems include (1) the inability of binocular algorithms to obtain matches for horizontal edge segments, (2) secondary errors that arise in image regions containing unmatched horizontal segments, (3) the inability of binocular algorithms to obtain matches in occluded regions, (4) incorrect matches that may be accepted in occluded regions, and (5) the matching ambiguity of periodic image texture. TLMA matches images taken from cameras positioned on the vertices of an isosceles right triangle. Edges detected in the base image are matched with either the right or top image. For each candidate match a support value is computed using three support measures: the disparity gradient, the trinocular disparity gradient and cross-channel consistency multiresolution. Support values are compared for competing matches to determine the confidence in each match. High confidence matches that pass a final consistency check, called the area rule, are accepted as correct. TLMA is shown to avoid some of the design errors of previous trinocular algorithms. Preliminary experimental results on both real and synthetic images comparing TLMA with a similarly defined binocular algorithm demonstrate TLMA's effectiveness in producing improved matching results.

[1]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[2]  Narendra Ahuja,et al.  Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Liang-Hua Chen,et al.  Synergistic Smooth Surface Stereo , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Nicholas Ayache,et al.  Towards Real-time Trinocular Stereo , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[6]  J P Frisby,et al.  PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit , 1985, Perception.

[7]  Eric Krotkov,et al.  Focusing , 2004, International Journal of Computer Vision.

[8]  A. Lynn Abbott,et al.  Surface Reconstruction By Dynamic Integration Of Focus, Camera Vergence, And Stereo , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[9]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[10]  W. Eric L. Grimson,et al.  Computational Experiments with a Feature Based Stereo Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  A. Waxman,et al.  Using disparity functional for stereo correspondence and surface reconstruction , 1987 .