Improving Ego-Lane Detection by Incorporating Source Reliability

This paper presents a framework for robust lane detection towards automated driving using multiple sensors. Since every single source (e.g., camera, digital map, etc.) can fail in certain situations, several independent sources need to be combined. Moreover, the reliability of each source strongly depends on environmental conditions, e.g., existence or visibility of lane markings. Thus, we introduce a concept of estimating and incorporating reliability into the fusion. First, a new sensor-independent error metric is applied to assess the quality of the estimated ego-lanes based on the angle deviation. Secondly, we deploy a boosting algorithm to select the highly discriminant features among the extracted information. Based on the selected features, we apply different classifiers to learn the reliabilities of the sources. Thirdly, we use Dempster-Shafer evidence theory to stabilize the estimated reliabilities over time. Using a big collection of real data recordings from different situations, the experimental results support our concept.

[1]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[2]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[3]  Stefan Gehrig,et al.  Dead reckoning and cartography using stereo vision for an autonomous car , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[4]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[5]  Rudolf Kruse,et al.  A survey of performance measures to evaluate ego-lane estimation and a novel sensor-independent measure along with its applications , 2017, 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[6]  Hermann Winner,et al.  The Release of Autonomous Vehicles , 2016 .

[7]  Klaus C. J. Dietmayer,et al.  Road course estimation in occupancy grids , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[8]  Lloyd A. Smith,et al.  Feature Selection for Machine Learning: Comparing a Correlation-Based Filter Approach to the Wrapper , 1999, FLAIRS.

[9]  Ángel F. García-Fernández,et al.  Bayesian Road Estimation Using Onboard Sensors , 2014, IEEE Transactions on Intelligent Transportation Systems.

[10]  Klaus C. J. Dietmayer,et al.  Towards autonomous self-assessment of digital maps , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[11]  Christoph Stiller,et al.  Efficient Road Scene Understanding for Intelligent Vehicles Using Compositional Hierarchical Models , 2015, IEEE Transactions on Intelligent Transportation Systems.

[12]  Jürgen Dickmann,et al.  Evaluation of different approaches for road course estimation using imaging radar , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Alberto Elfes,et al.  Environment-aware sensor fusion for obstacle detection , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[14]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[15]  Alain Appriou Situation assessment based on spatially ambiguous multisensor measurements , 2001, Int. J. Intell. Syst..

[16]  Hiroshi Motoda,et al.  Computational Methods of Feature Selection , 2022 .

[17]  Andreas Kroll Computational Intelligence: Probleme, Methoden und technische Anwendungen , 2016 .

[18]  Max Kuhn,et al.  Remedies for Severe Class Imbalance , 2013 .

[19]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[20]  Christoph Stiller,et al.  Efficient scene understanding for intelligent vehicles using a part-based road representation , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[21]  Pierre Borne,et al.  Context-dependent trust in data fusion within the possibility theory , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[22]  Yong Deng,et al.  Evaluating Sensor Reliability in Classification Problems Based on Evidence Theory , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Ljubo Vlacic,et al.  A Fault Tolerant Perception system for autonomous vehicles , 2016, 2016 35th Chinese Control Conference (CCC).

[24]  Qinghua Hu,et al.  Dynamic classifier ensemble using classification confidence , 2013, Neurocomputing.

[25]  F. Gustafsson,et al.  Obtaining reference road geometry parameters from recorded sensor data , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[26]  Huan Liu,et al.  Feature selection for classification: A review , 2014 .

[27]  Dmitry B. Goldgof,et al.  Performance Evaluation of Object Detection and Tracking in Video , 2006, ACCV.

[28]  Rudolf Kruse,et al.  Learning of lane information reliability for intelligent vehicles , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[29]  Rudolf Kruse,et al.  Online reliability assessment and reliability-aware fusion for Ego-Lane detection using influence diagram and Bayes filter , 2017, 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[30]  Liang Xiao,et al.  CRF based road detection with multi-sensor fusion , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[31]  Rudolf Kruse,et al.  Fusion: General concepts and characteristics , 2001, Int. J. Intell. Syst..

[32]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[33]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[34]  Frank Klawonn,et al.  Computational Intelligence: A Methodological Introduction , 2015, Texts in Computer Science.

[35]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[36]  Pei Wang Confidence as Higher-Order Uncertainty , 2001, ISIPTA.

[37]  Allaa R. Hilal Context-aware source reliability estimation for multi-sensor management , 2017, 2017 Annual IEEE International Systems Conference (SysCon).

[38]  J.-F. Grandin,et al.  Robust data fusion , 2000, Proceedings of the Third International Conference on Information Fusion.

[39]  Jens Spehr,et al.  Fused Raised Pavement Marker Detection Using 2D-Lidar and Mono Camera , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.