Hybrid Stereo Sensor with Omnidirectional Vision Capabilities: Overview and Calibration Procedures

In this paper, we present a compact hybrid video sensor that combines perspective and omnidirectional vision to achieve a 360deg field of view, as well as high-resolution images. Those characteristics, in association with 3D metric reconstruction capabilities, are suitable for vision tasks such as surveillance and obstacle detection for autonomous robot navigation. We describe the sensor calibration procedure, with particular regard to mirror-to-camera positioning. We also present some results obtained in testing the accuracy of 3D reconstruction, which have confirmed the correctness of the calibration.

[1]  Hiroshi Ishiguro.  Development of low-cost compact omnidirectional vision sensors , 2001 .

[2]  Mongi A. Abidi,et al.  Fusion of Omnidirectional and PTZ Cameras for Accurate Cooperative Tracking , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[3]  Nicolas Ragot,et al.  An efficient catadioptric sensor calibration based on a low-cost test-pattern , 2006, VISAPP.

[4]  David Ryan Koes,et al.  Precise omnidirectional camera calibration , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Tom Duckett,et al.  3D modeling of indoor environments by a mobile robot with a laser scanner and panoramic camera , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[6]  Jean-Arcady Meyer,et al.  BIOLOGICALLY BASED ARTIFICIAL NAVIGATION SYSTEMS: REVIEW AND PROSPECTS , 1997, Progress in Neurobiology.

[7]  Atsushi Imiya,et al.  Panoramic image transform of omnidirectional images using discrete geometry techniques , 2004 .

[8]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[9]  Patrick Rives,et al.  Calibration between a central catadioptric camera and a laser range finder for robotic applications , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[10]  Gaurav S. Sukhatme,et al.  People tracking and following with mobile robot using an omnidirectional camera and a laser , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[11]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[12]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[13]  P. Sturm.  Mixing catadioptric and perspective cameras , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[14]  S. B. Kang,et al.  Panoramic vision : sensors, theory, and applications , 2001 .

[15]  L. Marcenaro,et al.  Dual camera intelligent sensor for high definition 360 degrees surveillance , 2005 .

[16]  Stefano Cagnoni,et al.  A Non-traditional Omnidirectional Vision System with Stereo Capabilities for Autonomous Robots , 2001, AI*IA.

[17]  Stefano Cagnoni,et al.  Omnidirectional stereo systems for robot navigation , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[18]  Xilin Chen,et al.  Calibration of a hybrid camera network , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Shree K. Nayar,et al.  Omnidirectional Vision Systems: 1998 PI Report , 1998 .

[20]  Shree K. Nayar,et al.  Caustics of catadioptric cameras , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[21]  Jon Rigelsford,et al.  Panoramic Vision: Sensors, Theory and Applications , 2002 .

[22]  Atsushi Imiya,et al.  Panoramic image transform of omnidirectional images using discrete geometry techniques , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[23]  Wen-Hsiang Tsai,et al.  Construction of perspective and panoramic images from omni-images taken from hypercatadioptric cameras for visual surveillance , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.