A stereo machine for video-rate dense depth mapping and its new applications

We have developed a video-rate stereo machine that has the capability of generating a dense depth map at the video rate. The performance bench marks of the CMU video-rate stereo machine are: 1) multi-image input of up to 6 cameras; 2) throughput of 30 million point/spl times/disparity measurement per second; 3) frame rate of 30 frame/sec; 4) a dense depth map of up to 256/spl times/240 pixels; 5) disparity search range of up to 60 pixels; 6) high precision of depth output up to 8 bits (with interpolation). The capability of passively producing such a dense depth map (3D representation) of a scene at the video rate can open up a new class of applications of 3D vision: merging real and virtual worlds in real time.

[1]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[2]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[3]  Ali E. Kayaalp,et al.  A Pipeline Architecture For Near Real-Time Stereo Range Detection , 1989, Other Conferences.

[4]  Takeo Kanade,et al.  A multiple-baseline stereo , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[6]  T. Kanade,et al.  Experiments in Multiple-Baseline Stereo , 1992 .

[7]  Shigeo Hirose,et al.  Real-time stereo vision with multiple arrayed camera , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[8]  Jon A. Webb.  Implementation and performance of fast parallel multi-baseline stereo vision , 1993, 1993 Computer Architectures for Machine Perception.

[9]  Laurent Moll,et al.  Real time correlation-based stereo: algorithm, implementations and applications , 1993 .

[10]  Takeo Kanade,et al.  Virtualized reality: concepts and early results , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[11]  Takeo Kanade,et al.  CMU Video-Rate Stereo Machine , 1995 .

[12]  Takeo Kanade,et al.  Development of a video-rate stereo machine , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.