Free Space Detection: A Corner Stone of Automated Driving

Increasingly complex automated driving functions require ever more accurate environment models. If relevant information is missing, automated vehicle control may induce safety risks. In this paper, we describe a joint development of BMW and Continental used to ensure the safety of advanced driver assistance systems. We demonstrate free space detection (FSD) carried out on a stereo vision system and show how it contributes to a number of use cases in high-level driver assistance functionality. One major challenge is the diversity of requirements by various functions and we show how confidence estimation is key to serving them in parallel. Moreover, we demonstrate a novel semi-automatic validation procedure for the generation of ground truth data in order to assess FSD performance in real-world driving scenarios.

[1]  Christian Unger,et al.  Contributions to stereo vision , 2013 .

[2]  Wojciech Derendarz,et al.  Occupancy grid computation from dense stereo and sparse structure and motion points for automotive applications , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[3]  Fadi Dornaika,et al.  A New Framework for Stereo Sensor Pose Through Road Segmentation and Registration , 2011, IEEE Transactions on Intelligent Transportation Systems.

[4]  Sergiu Nedevschi,et al.  Processing Dense Stereo Data Using Elevation Maps: Road Surface, Traffic Isle, and Obstacle Detection , 2010, IEEE Transactions on Vehicular Technology.

[5]  Thambipillai Srikanthan,et al.  Nonparametric Technique Based High-Speed Road Surface Detection , 2015, IEEE Transactions on Intelligent Transportation Systems.

[6]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Qingquan Li,et al.  A Sensor-Fusion Drivable-Region and Lane-Detection System for Autonomous Vehicle Navigation in Challenging Road Scenarios , 2014, IEEE Transactions on Vehicular Technology.

[8]  Ayoub Al-Hamadi,et al.  Stereo-Camera-Based Urban Environment Perception Using Occupancy Grid and Object Tracking , 2012, IEEE Transactions on Intelligent Transportation Systems.

[9]  Thomas B. Schön,et al.  Estimation of the Free Space in Front of a Moving Vehicle , 2009 .

[10]  Dzmitry Tsishkou,et al.  Vision-based Safe Maneuvers with Detection of 10cm Height Obstacles , 2010 .

[11]  Stefan Hegemann,et al.  Environment Modelling for Future ADAS Functions , 2012 .

[12]  A. A. S. Souza,et al.  2.5-Dimensional Grid Mapping from Stereo Vision for Robotic Navigation , 2012, 2012 Brazilian Robotics Symposium and Latin American Robotics Symposium.

[13]  Ho Gi Jung,et al.  Noise-resilient road surface and free space estimation using dense stereo , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[14]  Volker Willert,et al.  Robust free space detection in occupancy grid maps by methods of image analysis and dynamic B-spline contour tracking , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[15]  Benoit Vanholme,et al.  A legal safety concept for highly automated driving on highways , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[16]  Slobodan Ilic,et al.  Scene understanding from a moving camera for object detection and free space estimation , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[17]  Daniel Cremers,et al.  B-Spline Modeling of Road Surfaces With an Application to Free-Space Estimation , 2009, IEEE Transactions on Intelligent Transportation Systems.

[18]  Ignacio Parra,et al.  Free space and speed humps detection using lidar and vision for urban autonomous navigation , 2012, 2012 IEEE Intelligent Vehicles Symposium.