A convolver-based real-time stereo machine (SAZAN)

For 3D reconstruction, polynocular stereo based on multiple image fusion is a promising method. We developed a convolver-based nine-eye stereo machine called SAZAN. It performs real-time acquisition of dense depth map at 20 MDPS (Million Depth-pixels Per Second). The reduction of matching ambiguities, which is the most crucial part in stereo matching, is effectively performed by filtering operations of 2D convolver LSI. Several new ideas and capabilities including a nonlinear data reduction of LoG outputs, an efficient geometric calibration and a subpixel disparity are also implemented in hardware. Considering the hardware size and the various factors that have an influence on the final processing quality, the computational performance is compared with existing stereo systems including the CMU stereo machine.

[1]  Roger Y. Tsai,et al.  Multiframe Image Point Matching and 3-D Surface Reconstruction , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[3]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[4]  Jon A. Webb Implementation and performance of fast parallel multi-baseline stereo vision , 1993, 1993 Computer Architectures for Machine Perception.

[5]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Takeo Kanade,et al.  CMU Video-Rate Stereo Machine , 1995 .

[7]  Takeo Kanade,et al.  A stereo machine for video-rate dense depth mapping and its new applications , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[9]  Larry H. Matthies,et al.  Stereo vision for planetary rovers: Stochastic modeling to near real-time implementation , 1991, Optics & Photonics.