Panoramic Vision System to Eliminate Driver’s Blind Spots using a Laser Sensor and Cameras

In this paper, we propose a multipurpose panoramic vision system for eliminating the blind spot and informing the driver of approaching vehicles using three cameras and a laser sensor. A wide-angle camera is attached to the car trunk and two cameras are attached under each side-view mirror to eliminate the blind spot of a vehicle. A laser sensor is attached on the rear-left of the vehicle to gather information from around the vehicle. The proposed system performs a pre-processing to estimate several system parameters. We compute a warping map to compensate the wide-angle lens distortion of the rear camera. We estimate the focus-of-contraction (FOC) in the rear image, and interactively compute the homography between the rear image and the laser sensor data. Homographies between each side-view image and the rear image are also computed in the pre-processing step. Using the system parameters obtained in the pre-processing step, the proposed system generates a panoramic mosaic view to eliminate the blind spot. First we obtain the undistorted rear image using the warping map. Then, we find road boundaries and classify approaching vehicles in laser sensor data, and overlap the laser sensor data on the rear image for further visualization. Next, the system performs the image registration process after segmentation of road and background regions based on road boundaries. Finally, it generates various views such as a cylindrical panorama view, a top view, a side view and an information panoramic mosaic view for displaying varied safety information.

[1]  Ehud Rivlin,et al.  Finding the focus of expansion and estimating range using optical flow images and a matched filter , 2004, Machine Vision and Applications.

[2]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[3]  Wolfgang Effelsberg,et al.  Multi perspective panoramic imaging , 2009, Image Vis. Comput..

[4]  David Salesin,et al.  Photographing long scenes with multi-viewpoint panoramas , 2006, SIGGRAPH 2006.

[5]  Naoki Suganuma,et al.  Obstacle Detection Based on Occupancy Grid Maps Using Stereovision System , 2010, Int. J. Intell. Transp. Syst. Res..

[6]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[7]  J. M. M. Montiel,et al.  Relocation using laser and vision , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[8]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[9]  Jun-Wei Hsieh,et al.  Automatic traffic surveillance system for vehicle tracking and classification , 2006, IEEE Transactions on Intelligent Transportation Systems.

[10]  Springer Fachmedien Wiesbaden.  Around View Monitor , 2013 .

[11]  S. Kubota,et al.  A Global Optimization Algorithm for Real-Time On-Board Stereo Obstacle Detection Systems , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[12]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[13]  Shree K. Nayar,et al.  Catadioptric omnidirectional camera , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Soon Ki Jung,et al.  Constructing cylindrical panoramic image using equidistant matching , 1999 .

[15]  Richard Szeliski,et al.  Seamless Stitching using Multi-Perspective Plane Sweep , 2004 .

[16]  Rui P. Rocha,et al.  Data Fusion Calibration for a 3D Laser Range Finder and a Camera using Inertial Data , 2009, ECMR.

[17]  Hendrik P. A. Lensch,et al.  Automatic multiperspective images , 2006, EGSR '06.

[18]  Shunsuke Kamijo,et al.  Incident Detection in Heavy Traffics in Tunnels by the Interlayer Feedback Algorithm , 2010, Int. J. Intell. Transp. Syst. Res..

[19]  Jianping Xu,et al.  Active clamp dual-end convertor , 1998 .

[20]  Fumio Harashima,et al.  Intelligent Vehicle Technologies , 2002 .

[21]  R Andrew Hicks,et al.  Blind-spot problem for motor vehicles. , 2005, Applied optics.

[22]  Jianwei Zhang,et al.  Multi sensor fusion of camera and 3D laser range finder for object recognition , 2010, 2010 IEEE Conference on Multisensor Fusion and Integration.

[23]  Wolfgang Effelsberg,et al.  Multi-Camera Video Stitching , 2006 .

[24]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[25]  J. Xing,et al.  Mitigation of expressway traffic congestion through transportation demand management with toll discount , 2010 .

[26]  Hao Wu,et al.  MDDV: a mobility-centric data dissemination algorithm for vehicular networks , 2004, VANET '04.