Pseudo-Stereo Vision System: A Detailed Study

In this paper, a new stereovision system based on mirrors is presented. It is composed of three mirrors, a beam-splitter and a camera. It is called Pseudo-Stereo Vision System (PSVS) and can be used in real time applications. Two parallel virtual cameras are created with the geometric properties and parameters of the real camera. PSVS captures, in one shot, a complex image, created by the superposition of the left and right views of the system. The apparatus has no moving parts, low cost and double resolution compared with other monocular systems based on mirrors. It can be constructed in any dimension covering any type of camera, length of baseline and accuracy of depth measurements. The design and construction details of the system as well as the appearing refraction phenomena to the apparatus are analytically presented. Analytical expressions are derived for the calculation of mirrors dimensions, minimum common view distance and minimum length of baseline. Mirrors alignment method is also described. Equations providing the Cartesian coordinates of a point in space, taking into consideration refraction phenomena to beam-splitter and camera calibration parameters, are proved. Two new methods for the separation of complex images to pairs of left and right images using gray scale or color cameras are explained and the first real experimental results are illustrated. Finally, experimental results, where the PSVS is mounted on the end effector of a PUMA 761 robotic manipulator are presented.

[1]  Hyongsuk Kim,et al.  A Depth Measurement System Associated with a Mono-Camera and a Rotating Mirror , 2002, IEEE Pacific Rim Conference on Multimedia.

[2]  W. Teoh,et al.  An inexpensive stereoscopic vision system for robots , 1984, ICRA.

[3]  Yael Pritch,et al.  Omnistereo: Panoramic Stereo Imaging , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Hanqi Zhuang,et al.  Simultaneous robot/world and tool/flange calibration by solving homogeneous transformation equations of the form AX=YB , 1994, IEEE Trans. Robotics Autom..

[5]  In-So Kweon,et al.  A novel stereo camera system by a biprism , 2000, IEEE Trans. Robotics Autom..

[6]  John N. Lygouras,et al.  A pseudo stereo vision system as a sensor for real time path control of a robot , 2002, IMTC/2002. Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.00CH37276).

[7]  Paul Salama,et al.  Error concealment in encoded images and video , 1999 .

[8]  A. Ardeshir Goshtasby,et al.  Design of a single-lens stereo camera system , 1993, Pattern Recognit..

[9]  Shree K. Nayar,et al.  Rectified catadioptric stereo sensors , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[10]  Shree K. Nayar,et al.  Planar catadioptric stereo: geometry and calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[11]  Murat Draman,et al.  A Robotic Vision System , 1984 .

[12]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Masayuki Inaba,et al.  A stereo viewer based on a single camera with view-control mechanisms , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[14]  Shree K. Nayar,et al.  Stereo with mirrors , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[15]  Shree K. Nayar,et al.  Real-Time Omnidirectional and Panoramic Stereo , 1998 .

[16]  Yuichiro Oya,et al.  Circular Dynamic Stereo and Its Image Processing , 2002 .

[17]  Leno S. Pedrotti,et al.  Optics and Vision , 1997 .

[18]  Frederic Devernay,et al.  Système de miroirs pour la stéréoscopie , 1995 .

[19]  THEODORE PACHIDIS,et al.  A Novel Corner Detection Algorithm for Camera Calibration and Calibration Facilities , 2002 .

[20]  Stefan K. Gehrig,et al.  Enhanced Stereo Vision Using Free-Form Surface Mirrors , 2001, RobVis.

[21]  Ness B. Shroff,et al.  Error concealment techniques for encoded video streams , 1995, Proceedings., International Conference on Image Processing.

[22]  John Lygouras,et al.  Robot Path Generation by Viewing a Static Scene from a Single Camera , 2002 .

[23]  Shree K. Nayar,et al.  A Real-Time Catadioptric Stereo System Using Planar Mirrors , 2001 .

[24]  THEODORE PACHIDIS,et al.  A Graphical User Interface for the Initial Path Generation of a Robotic Manipulator for an Arc Welding System , 2002 .

[25]  J. Lygouras,et al.  Pseudo Stereo Vision System: modifications for accurate measurements in 3-D space using camera calibration , 2002, 2nd ISA/IEEE Sensors for Industry Conference,.

[26]  In-So Kweon,et al.  A biprism-stereo camera system , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[27]  Anup Basu,et al.  Panoramic stereo , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[28]  Edward J. Delp,et al.  Real-time Error Concealment in Compressed Digital Video Streams , 1999 .