Parking assistance using dense motion-stereo

The ability of generating and interpreting a three-dimensional representation of the environment in real-time is one of the key technologies for autonomous vehicles. While active sensors like ultrasounds have been commercially used, their cost and precision is not favorable. On the other hand, integrating passive sensors, like video cameras, in modern vehicles is quite appealing especially because of their low cost. However, image processing requires reliable real-time algorithms to retrieve depth from visual information. In addition, the limited processing power in automobiles and other mobile platforms makes this problem even more challenging. In this paper we introduce a parking assistance system which relies on dense motion-stereo to compute depth maps of the observed environment in real-time. The flexibility and robustness of our method is showcased with different applications: automatic parking slot detection, a collision warning for the pivoting ranges of the doors and an image-based rendering technique to visualize the environment around the host vehicle. We evaluate the accuracy and reliability of our system and provide quantitative and qualitative results. A comparison to ultrasound and feature-based motion-stereo solutions shows that our approach is more reliable.

[1]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[2]  Ho Gi Jung,et al.  Automatic free parking space detection by using motion stereo-based 3D reconstruction , 2010, Machine Vision and Applications.

[3]  N. Mattern,et al.  Free space determination for parking slots using a 3D PMD sensor , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[4]  C. Zach Fast and High Quality Fusion of Depth Maps , 2008 .

[5]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[6]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[7]  J. Klappstein,et al.  Monocular Motion Detection Using Spatial Constraints in a Unified Manner , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[8]  N. Kaempchen,et al.  Stereo vision based pose estimation of parking lots using 3D vehicle models , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[9]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Miao Liao,et al.  High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[11]  David Nistér,et al.  Frame Decimation for Structure and Motion , 2000, SMILE.

[12]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Ze-Nian Li,et al.  A survey of motion-parallax-based 3-D reconstruction algorithms , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  Hujun Bao,et al.  Recovering consistent video depth maps via bundle optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Ho Gi Jung,et al.  Light Stripe Projection based Parking Space Detection for Intelligent Parking Assist System , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[16]  Jonathan M. Garibaldi,et al.  Real-Time Correlation-Based Stereo Vision with Reduced Border Errors , 2002, International Journal of Computer Vision.

[17]  Nassir Navab,et al.  Efficient Disparity Computation without Maximum Disparity for Real-Time Stereo Vision , 2009, BMVC.

[18]  Kai-Tai Song,et al.  Lateral Driving Assistance Using Optical Flow and Scene Analysis , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[19]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Toshiaki Kakinami,et al.  Evaluation of a Vision-Based Parking Assistance System , 2005 .

[21]  Philip L. Davidson,et al.  Real-time stereo vision using semi-global matching on programmable graphics hardware , 2006, SIGGRAPH '06.

[22]  Slobodan Ilic,et al.  Probabilistic Disparity Fusion for Real-Time Motion-Stereo , 2010 .

[23]  Byung-Sung Kim,et al.  Parking space detection using ultrasonic sensor in parking assistance system , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[24]  Ho Gi Jung,et al.  Free Parking Space Detection Using Optical Flow-based Euclidean 3D Reconstruction , 2007, MVA.

[25]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[26]  Alan Brunton,et al.  Belief Propagation on the GPU for Stereo Vision , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[27]  Jan-Michael Frahm,et al.  Real-Time Visibility-Based Fusion of Depth Maps , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[28]  Ho Gi Jung,et al.  Parking Slot Markings Recognition for Automatic Parking Assist System , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[29]  Ming Xie,et al.  Vision-guided automatic parking for smart car , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[30]  H. Hirschmüller Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[31]  Laurent Moll,et al.  Real time correlation-based stereo: algorithm, implementations and applications , 1993 .

[32]  Helmut Spannheimer,et al.  Der Parkassistent - Ein weiteres innovatives Fahrerassistenzsystem zum Thema ConnectedDrive aus der BMW-Fahrzeugforschung , 2003 .

[33]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[34]  Jonas Larsson,et al.  A semi-automated parallel parking system for passenger cars , 2006 .

[35]  Eric Wahl,et al.  Efficient stereo matching for moving cameras and decalibrated rigs , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[36]  Reinhard Männer,et al.  Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation , 2004, International Journal of Computer Vision.

[37]  C. Vestri,et al.  3D parking assistant system , 2004, IEEE Intelligent Vehicles Symposium, 2004.