Online reliability assessment and reliability-aware fusion for Ego-Lane detection using influence diagram and Bayes filter

Within the context of road estimation, the present paper addresses the problem of the fusion of several sources with different reliabilities. Thereby, reliability represents a higher-level uncertainty. This problem arises in automated driving and ADAS due to changing environmental conditions, e.g., road type or visibility of lane markings. Thus, we present an online sensor reliability assessment and reliability-aware fusion to cope with this challenge. First, we apply a boosting algorithm to select the highly discriminant features among the extracted information. Using them we apply different classifiers to learn the reliabilities, such as Bayesian Network and Random Forest classifiers. To stabilize the estimated reliabilities over time, we deploy approaches such as Dempster-Shafer evidence theory and Influence Diagram combined with a Bayes Filter. Using a big collection of real data recordings, the experimental results support our proposed approach.

[1]  Alain Appriou.  Situation assessment based on spatially ambiguous multisensor measurements , 2001, Int. J. Intell. Syst..

[2]  Yong Deng,et al.  Evaluating Sensor Reliability in Classification Problems Based on Evidence Theory , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Christopher Bayer,et al.  Multi-lane perception using feature fusion based on GraphSLAM , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Rudolf Kruse,et al.  A survey of performance measures to evaluate ego-lane estimation and a novel sensor-independent measure along with its applications , 2017, 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[5]  Galina L. Rogova,et al.  Reliability In Information Fusion : Literature Survey , 2004 .

[6]  Ljubo Vlacic,et al.  A Fault Tolerant Perception system for autonomous vehicles , 2016, 2016 35th Chinese Control Conference (CCC).

[7]  Ángel F. García-Fernández,et al.  Bayesian Road Estimation Using Onboard Sensors , 2014, IEEE Transactions on Intelligent Transportation Systems.

[8]  Pierre Borne,et al.  Context-dependent trust in data fusion within the possibility theory , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[9]  Huan Liu,et al.  Feature selection for classification: A review , 2014 .

[10]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[11]  Jens Spehr,et al.  Fused Raised Pavement Marker Detection Using 2D-Lidar and Mono Camera , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[12]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[13]  Rudolf Kruse,et al.  Fusion: General concepts and characteristics , 2001, Int. J. Intell. Syst..

[14]  Hiroshi Motoda,et al.  Computational Methods of Feature Selection , 2022 .

[15]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[16]  Liang Xiao,et al.  CRF based road detection with multi-sensor fusion , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[17]  Christoph Stiller,et al.  Efficient scene understanding for intelligent vehicles using a part-based road representation , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[18]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[19]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[20]  Robert Lagerström,et al.  Enterprise architecture analysis with extended influence diagrams , 2007, Inf. Syst. Frontiers.

[21]  Alberto Elfes,et al.  Environment-aware sensor fusion for obstacle detection , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[22]  Yun Peng,et al.  A Bayesian network based framework for multi-criteria decision making , 2004 .

[23]  Yoshiko Kojima,et al.  CADAS: A multimodal advanced driver assistance system for normal urban streets based on road context understanding , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[24]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[25]  Frank Klawonn,et al.  Computational Intelligence: A Methodological Introduction , 2015, Texts in Computer Science.

[26]  Lloyd A. Smith,et al.  Feature Selection for Machine Learning: Comparing a Correlation-Based Filter Approach to the Wrapper , 1999, FLAIRS.

[27]  Klaus C. J. Dietmayer,et al.  Towards autonomous self-assessment of digital maps , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[28]  R. Bosch.  Lane data fusion for driver assistance systems , 2004 .

[29]  Haim Gaifman,et al.  A Theory of Higher Order Probabilities , 1986, TARK.

[30]  Pei Wang.  Confidence as Higher-Order Uncertainty , 2001, ISIPTA.

[31]  Allaa R. Hilal.  Context-aware source reliability estimation for multi-sensor management , 2017, 2017 Annual IEEE International Systems Conference (SysCon).

[32]  J.-F. Grandin,et al.  Robust data fusion , 2000, Proceedings of the Third International Conference on Information Fusion.

[33]  Max Kuhn,et al.  Remedies for Severe Class Imbalance , 2013 .

[34]  Yan Wang,et al.  Fusing image, GPS and GIS for road tracking using multiple condensation particle filters , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[35]  Kruse Rudolf,et al.  Learning of lane information reliability for intelligent vehicles , 2016 .

[36]  Qinghua Hu,et al.  Dynamic classifier ensemble using classification confidence , 2013, Neurocomputing.

[37]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.