Multi-source Fusion Using Neural Networks and Genetic Algorithms Towards Ego-Lane Estimation

An important task of automated driving is to keep the vehicle in the host lane. For a robust lane estimation, the information of multiple data sources needs to be combined to overcome the drawbacks of each individual sensor [1]. For that reason, this paper proposes a new mediated perception approach towards lane keeping function. Additionally to artificial neural networks (ANNs) used by Nguyen et al. [2], genetic programming (GP) is applied to estimate the parameters of an approximation of a clothoid, which is used to represent the ego-lane. Therefor, a set of lane marking detections, information about the ego-vehicle and the leading vehicle and information about the current location are used as input for the estimators. Compared to the reference, the resulting ANN and GP estimators mostly achieve an angle deviation of smaller than 2° at a distance of 30 m. Hereby, both approaches achieve an overall availability of around 90%. Surprisingly, GP surpasses all compared approaches based on lane markings or a deep learning approach, which directly estimates the ego-lane from camera images, with an overall availability of 0.91. For that reason, ANNs and GPs can be applied to solve the lane keeping task so that future research can lead to further increases of the availability.

[1]  Jiman Kim,et al.  End-To-End Ego Lane Estimation Based on Sequential Transfer Learning for Self-Driving Cars , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Dean Pomerleau,et al.  Efficient Training of Artificial Neural Networks for Autonomous Navigation , 1991, Neural Computation.

[4]  Rudolf Kruse,et al.  A General Reliability-Aware Fusion Concept Using DST and Supervised Learning with Its Applications in Multi-Source Road Estimation , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[5]  Jianxiong Xiao,et al.  DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Rudolf Kruse,et al.  A survey of performance measures to evaluate ego-lane estimation and a novel sensor-independent measure along with its applications , 2017, 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[7]  Bogdan Stanciulescu,et al.  Real-time method for general road segmentation , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[8]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[9]  Rudolf Kruse,et al.  Reliability-Aware and Robust Multi-sensor Fusion Toward Ego-Lane Estimation Using Artificial Neural Networks , 2019, Information Quality in Information Fusion and Decision Making.

[10]  Qingquan Li,et al.  A Sensor-Fusion Drivable-Region and Lane-Detection System for Autonomous Vehicle Navigation in Challenging Road Scenarios , 2014, IEEE Transactions on Vehicular Technology.

[11]  Rudolf Kruse,et al.  Learning of lane information reliability for intelligent vehicles , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[12]  Rajesh Kumar,et al.  Obstacle detection and classification using deep learning for tracking in high-speed autonomous driving , 2017, 2017 IEEE Region 10 Symposium (TENSYMP).

[13]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  John R. Koza,et al.  Hierarchical Genetic Algorithms Operating on Populations of Computer Programs , 1989, IJCAI.

[15]  Hayder Radha,et al.  Deep learning algorithm for autonomous driving using GoogLeNet , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[16]  Rudolf Kruse,et al.  Online reliability assessment and reliability-aware fusion for Ego-Lane detection using influence diagram and Bayes filter , 2017, 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[17]  Shigeru Katagiri,et al.  Automobile driving support system evolved by Genetic Programming , 2016, 2016 IEEE Region 10 Conference (TENCON).

[18]  Xinming Huang,et al.  End-to-end learning for lane keeping of self-driving cars , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[19]  Rudolf Kruse,et al.  Improving Ego-Lane Detection by Incorporating Source Reliability , 2017, MFI 2017.

[20]  Hongdong Li,et al.  Moving object detection and segmentation in urban environments from a moving platform , 2017, Image Vis. Comput..