CADAS: A multimodal advanced driver assistance system for normal urban streets based on road context understanding

Comprehensive situational awareness is paramount to the effectiveness of higher-level functions of the advanced driver assistance systems (ADAS) used in daily urban traffic, in which, the host vehicle have to interact with other cars. This paper addresses a multimodal advanced driver assistance system, which we call CADAS (Contextual ADAS), designed for expanding the usability of current ADAS functions, including LKA, ACC, and PCS, to normal urban streets, particularly for non-marking roads. In the proposed system, the relational contexts between the host vehicle, the road and other vehicles are employed for both the low level object detection improvement and the high level scene understanding and decision making. Experimental results in various typical but challenging scenarios show the effectiveness of the proposed system.

[1]  Bernt Schiele,et al.  Monocular 3D Scene Modeling and Inference: Understanding Multi-Object Traffic Scenes , 2010, ECCV.

[2]  Sebastian Thrun,et al.  A probabilistic framework for car detection in images using context and scale , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Luc Van Gool,et al.  Segmentation-Based Urban Traffic Scene Understanding , 2009, BMVC.

[4]  Luis Magdalena,et al.  VIRTUOUS: vision-based road transportation for unmanned operation on urban-like scenarios , 2004, IEEE Transactions on Intelligent Transportation Systems.

[5]  Sebastian Thrun,et al.  Reverse Optical Flow for Self-Supervised Adaptive Autonomous Robot Navigation , 2007, International Journal of Computer Vision.

[6]  Jay A. Farrell,et al.  High-precision lane-level road map building for vehicle navigation , 2010, IEEE/ION Position, Location and Navigation Symposium.

[7]  Jan-Michael Frahm,et al.  Piecewise planar and non-planar stereo for urban scene reconstruction , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Belinda Lee,et al.  United Nations Decade of Action for Road Safety , 2011 .

[9]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[11]  Luis Salgado,et al.  Real-Time Vanishing Point Estimation in Road Sequences Using Adaptive Steerable Filter Banks , 2007, ACIVS.

[12]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Seiichi Mita,et al.  Robust Road Detection and Tracking in Challenging Scenarios Based on Markov Random Fields With Unsupervised Learning , 2012, IEEE Transactions on Intelligent Transportation Systems.

[14]  H. Hirschmüller.  Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.