Monitoring Around a Vehicle by a Spherical Image Sensor

This paper describes a prototype of a full-view spherical image sensor, gives a method for sensor calibration, and discusses display modalities of the captured full-view image for monitoring around a vehicle. To monitor the whole surrounding situation of a dynamic environment by a single camera, a spherical field of view (FOV) is divided into two hemispherical views. Each hemispherical FOV is imaged by a fisheye lens. Both of the hemispherical views are fused by a mirror to acquire them on a single image plane. To calibrate the full-view spherical image sensor, a three-dimensional (3-D) calibration pattern is used to compute the internal parameters of each fisheye lens and their relative orientation based upon a spherical camera model. Finally, several display modalities are discussed to show drivers the relevant spherical image information on planar displays for monitoring around a vehicle

[1]  Norishige Chiba,et al.  Acquisition of spherical image by fish-eye conversion lens , 2004, IEEE Virtual Reality 2004.

[2]  Juho Kannala,et al.  A generic camera calibration method for fish-eye lenses , 2004, ICPR 2004.

[3]  José Manuel Pastor,et al.  Visual sign information extraction and identification by deformable models for intelligent vehicles , 2004, IEEE Transactions on Intelligent Transportation Systems.

[4]  Takeo Kato,et al.  Preceding vehicle recognition based on learning from sample images , 2002, IEEE Trans. Intell. Transp. Syst..

[5]  Liang Zhao,et al.  Stereo- and neural network-based pedestrian detection , 2000, IEEE Trans. Intell. Transp. Syst..

[6]  Kostas Daniilidis,et al.  Normalized Cross-Correlation for Spherical Images , 2004, ECCV.

[7]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[8]  Michael D. Naish,et al.  Developing a Modular Active Spherical Vision System , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  Shigang Li,et al.  Spherical stereo for the construction of immersive VR environment , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[10]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[12]  Dariu Gavrila,et al.  Real-time dense stereo for intelligent vehicles , 2006, IEEE Transactions on Intelligent Transportation Systems.

[13]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[14]  Yasushi Yagi,et al.  Real-time omnidirectional image sensor (COPIS) for vision-guided navigation , 1994, IEEE Trans. Robotics Autom..

[15]  Romuald Aufrère,et al.  Accurate road following and reconstruction by computer vision , 2002, IEEE Trans. Intell. Transp. Syst..

[16]  Se-Young Oh,et al.  Three-feature based automatic lane detection algorithm (TFALDA) for autonomous driving , 2003, IEEE Trans. Intell. Transp. Syst..

[17]  Edward M. Riseman,et al.  Image-based homing , 1991, IEEE Control Systems.

[18]  Shree K. Nayar,et al.  Catadioptric omnidirectional camera , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  A. E. Conrady.  Decentred Lens-Systems , 1919 .

[20]  Shigang Li,et al.  Employing a Fish-Eye for Scene Tunnel Scanning , 2006, ACCV.

[21]  Akira Hayashi,et al.  NAVIGATION BY INTEGRATING ICONIC AND GPS INFORMATION , 1998 .

[22]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[23]  Aurelio Piazzi,et al.  Visual perception of obstacles and vehicles for platooning , 2000, IEEE Trans. Intell. Transp. Syst..

[24]  Jiang Yu Zheng.  Digital Route Panoramas , 2003, IEEE Multim..

[25]  Zehang Sun,et al.  On-road vehicle detection using evolutionary Gabor filter optimization , 2005, IEEE Transactions on Intelligent Transportation Systems.

[26]  Juho Kannala,et al.  A generic camera calibration method for fish-eye lenses , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[27]  J. Gaspar,et al.  Omni-directional vision for robot navigation , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[28]  Saburo Tsuji,et al.  Panoramic representation for route recognition by a mobile robot , 1992, International Journal of Computer Vision.

[29]  Kenro Miyamoto,et al.  Fish Eye Lens , 1964 .

[30]  Kostas Daniilidis,et al.  Rotation estimation from spherical images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[31]  Yasushi Yagi,et al.  Omnidirectional imaging with hyperboloidal projection , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[32]  Xilin Chen,et al.  Detection of text on road signs from video , 2005, IEEE Trans. Intell. Transp. Syst..

[33]  Alfred O. Hero,et al.  Simultaneous detection of lane and pavement boundaries using model-based multisensor fusion , 2000, IEEE Trans. Intell. Transp. Syst..