A system design for automotive augmented reality using stereo night vision

The use of Head-Up Displays (HUD) in automobiles to visualize various types of driving information on the windshield has rapidly increased in recent years. However, these HUDs display the graphics on only a specific area of the windshield. This paper introduces a new generation of automotive augmented reality systems for driver assistance at night which detects the 3D positions of potential collision partners as well as the driver's eyes to display the warning information at the exact position according to driver's viewing direction on the full-windshield (FWD). Furthermore, a generic method for unified calibration of various components of this system is proposed. The introduced concepts are validated on a prototype with an external stereo night vision system for obstacle detection, an interior mono night vision system for eye tracking as well as different projection units.

[1]  A. Broggi,et al.  Pedestrian Detection using Infrared images and Histograms of Oriented Gradients , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[2]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[4]  O. O’Reilly.  Intermediate Dynamics for Engineers: A Unified Treatment of Newton-Euler and Lagrangian Mechanics , 2008 .

[5]  R. W. Evans,et al.  Head-up displays in motor cars , 1989 .

[6]  Yuichi Ohta,et al.  VISUAL NAVIGATION SYSTEM ON WINDSHIELD HEAD-UP DISPLAY , 2006 .

[7]  Christian Sandor,et al.  Experimental evaluation of an augmented reality visualization for directing a car driver's attention , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[8]  K. Funabiki,et al.  Attention allocation in Tunnel-in-the-Sky on HUD and HDD for visual flight , 2007, 2007 IEEE/AIAA 26th Digital Avionics Systems Conference.

[9]  Hubert Adamietz,et al.  Integration of night-vision and head-up display in vehicles , 2005 .

[10]  Chris A. Glasbey,et al.  An Analysis of Histogram-Based Thresholding Algorithms , 1993, CVGIP Graph. Model. Image Process..

[11]  A. Broggi,et al.  Infrared stereo vision-based pedestrian detection , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[12]  Thao Dang,et al.  Self-calibration for Active Automotive Stereo Vision , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[13]  Wen Wu,et al.  A prototype of landmark-based car navigation using a full-windshield head-up display system , 2009, AMC '09.

[14]  Donyau Chiang,et al.  Head-up display using an inclined Al2O3 column array. , 2014, Applied optics.

[15]  S. Nedevschi,et al.  Camera Calibration Method for Far Range Stereovision Sensors Used in Vehicles , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[16]  Markus Lienkamp,et al.  Measurement of Electrodermal Activity to Evaluate the Impact of Environmental Complexity on Driver Workload , 2013 .

[17]  Yupin Luo,et al.  Real-Time Pedestrian Detection and Tracking at Nighttime for Driver-Assistance Systems , 2009, IEEE Transactions on Intelligent Transportation Systems.