Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming

This paper presents a stereo matching algorithm using the dynamic programming technique. The stereo matching problem, that is, obtaining a correspondence between right and left images, can be cast as a search problem. When a pair of stereo images is rectified, pairs of corresponding points can be searched for within the same scanlines. We call this search intra-scanline search. This intra-scanline search can be treated as the problem of finding a matching path on a two-dimensional (2D) search plane whose axes are the right and left scanlines. Vertically connected edges in the images provide consistency constraints across the 2D search planes. Inter-scanline search in a three-dimensional (3D) search space, which is a stack of the 2D search planes, is needed to utilize this constraint. Our stereo matching algorithm uses edge-delimited intervals as elements to be matched, and employs the above mentioned two searches: one is inter-scanline search for possible correspondences of connected edges in right and left images and the other is intra-scanline search for correspondences of edge-delimited intervals on each scanline pair. Dynamic programming is used for both searches which proceed simultaneously: the former supplies the consistency constraint to the latter while the latter supplies the matching score to the former. An interval-based similarity metric is used to compute the score. The algorithm has been tested with different types of images including urban aerial images, synthesized images, and block scenes, and its computational requirement has been discussed.

[1]  James Wong.  COMPUTER SCIENCE DEPARTMENT , 1971 .

[2]  Alfred V. Aho,et al.  The Design and Analysis of Computer Algorithms , 1974 .

[3]  Bruce T. Lowerre,et al.  The HARPY speech recognition system , 1976 .

[4]  G. S. Rao,et al.  6th annual symposium on computer architecture , 1979 .

[5]  Hans P. Moravec.  Visual Mapping by a Robot Rover , 1979, IJCAI.

[6]  Robert L. Henderson,et al.  Automatic Stereo Reconstruction Of Man-Made Targets , 1979, Other Conferences.

[7]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[8]  Bryan D. Ackland,et al.  An integrated multiprocessing array for time warp pattern matching , 1981, ISCA '81.

[9]  W E Grimson,et al.  A computer implementation of a theory of human stereo vision. , 1981, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[10]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.

[11]  Takeo Kanade,et al.  The 3D MOSAIC Scene Understanding System , 1983, IJCAI.

[12]  H. T. Kung,et al.  Architecture of the PSC-a programmable systolic chip , 1983, ISCA '83.

[13]  Bryan D. Ackland,et al.  Dynamic Time Warp Pattern Matching Using an Integrated Multiprocessing Array , 1983, IEEE Transactions on Computers.

[14]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[15]  Dan I. Moldovan,et al.  Semantic Network Array Processor and Its Applications to Image Understanding , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.