Multi-vehicle cooperative perception and augmented reality for driver assistance: A possibility to ‘see’ through front vehicle

A typical scenario where a front vehicle (the first vehicle) occludes the view of another vehicle (the second vehicle) is often encountered in traffic environment and can be potentially dangerous. For enhancing traffic safety in this scenario, multi-vehicle cooperative perception between the two vehicles is useful. Besides, better visualization of the cooperative perception result might be needed for driver assistance. Based on these motivations, a method of multi-vehicle cooperative perception which realizes an effect of augmented reality is proposed in this paper; the effect of augmented reality here means a direct and natural visualization of the occluded environment for the second vehicle, as if a person at the second vehicle can see through the front vehicle and directly perceive the environment occluded. The proposed cooperative perception method can be used for applications of completely automated mode while the effect of augmented reality would also be convenient for driver assistance. Theoretical and technical details of the proposed method are described; field tests results are given to demonstrate the performance of the proposed method.1

[1]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[3]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[4]  F. Chausse,et al.  Vehicle localization on a digital map using particles filtering , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[5]  Han-Shue Tan,et al.  Design and field testing of a Cooperative Adaptive Cruise Control system , 2010, Proceedings of the 2010 American Control Conference.

[6]  S. Tsugawa,et al.  Inter-vehicle communications and their applications to intelligent vehicles: an overview , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[7]  Sebastian Thrun,et al.  Online simultaneous localization and mapping with detection and tracking of moving objects: theory and results from a ground vehicle in crowded urban areas , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[8]  José Santa,et al.  A Usage Oriented Analysis of Vehicular Networks: from Technologies to Applications , 2009, J. Commun..

[9]  Evangelos E. Milios,et al.  Robot Pose Estimation in Unknown Environments by Matching 2D Range Scans , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Yacine Khaleda,et al.  A Usage Oriented Analysis of Vehicular Networks: from Technologies to Applications , 2009 .

[11]  Rajesh Rajamani,et al.  Vehicle dynamics and control , 2005 .

[12]  A. Herbin,et al.  Robust on-vehicle real-time visual detection of American and European speed limit signs, with a modular Traffic Signs Recognition system , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[13]  Abdelaziz Bensrhair,et al.  Fast And Accurate Stereo Vision-Based Estimation Of 3D Position And Axial Motion Of Road Obstacles , 2004, Int. J. Image Graph..

[14]  Fawzi Nashashibi,et al.  Traffic light recognition using image processing compared to learning processes , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Fawzi Nashashibi,et al.  Centralized fusion for fast people detection in dense environment , 2009, 2009 IEEE International Conference on Robotics and Automation.

[16]  Fei-Yue Wang,et al.  Cooperative Driving at Blind Crossings Using Intervehicle Communication , 2006, IEEE Transactions on Vehicular Technology.

[17]  Raja Sengupta,et al.  Kalman Filter-Based Integration of DGPS and Vehicle Sensors for Localization , 2005, IEEE Transactions on Control Systems Technology.