Lateral State Estimation of Preceding Target Vehicle Based on Multiple Neural Network Ensemble

Preceding target vehicle (PTV) motion recognition play a pivotal role in autonomous vehicles. Motion states such as yaw rate, longitudinal and lateral velocity are critical for ego vehicle decision-making and control. However, lateral states of a PTV can hardly be measured directly by common onboard sensors and the PTV lateral state estimation has been seldom addressed in existing literatures. In this paper, a novel estimation scheme based on multiple neural network ensemble is proposed for PTV lateral state estimation. First, PTV lateral kinematics is presented based on vehicle-road relationship and a novel PTV lateral motion model is constructed to interpret the PTV lateral motion. Then, neural network observer with the PTV lateral kinematics as prior knowledge is designed and training data are collected in simulation environment. The neural network observer is trained using Levenberg-Marquardt backpropagation with Bayesian regularization (LMBR) to improve the generalization capability. Finally, to further improve the performance of the neural network estimation method, multiple neural network observers are integrated by weighted averaging strategy. The effectiveness of proposed approach is verified through hardware-in-the-Ioop (HiL) experiments conducted in designed verification scenarios, and compared with model-based method and other three learning methods. The experiment results reveal that the proposed method outperforms other typical methods and achieves accurate estimation of the PTV lateral states.

[1]  Martin M. Lipschutz Schaum's outline of theory and problems of differential geometry : including 500 solved problems completely solved in detail / Martin M. Lipschutz , 1969 .

[2]  Lei Wan,et al.  Serret-Frenet frame based on path following control for underactuated unmanned surface vehicles with dynamic uncertainties , 2015 .

[3]  Ahmed S. Eltrass,et al.  An improved approach for multi-target detection and tracking in automotive radar systems , 2016, 2016 International Conference on Electromagnetics in Advanced Applications (ICEAA).

[4]  Wei Zhan,et al.  Probabilistic Prediction of Vehicle Semantic Intention and Motion , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[5]  Gerd Wanielik,et al.  Comparison and evaluation of advanced motion models for vehicle tracking , 2008, 2008 11th International Conference on Information Fusion.

[6]  Weilong Song,et al.  Intention-Aware Autonomous Driving Decision-Making in an Uncontrolled Intersection , 2016 .

[7]  Sean N. Brennan,et al.  Lateral Vehicle State and Environment Estimation Using Temporally Previewed Mapped Lane Features , 2015, IEEE Transactions on Intelligent Transportation Systems.

[8]  João Gama,et al.  Ensemble learning for data stream analysis: A survey , 2017, Inf. Fusion.

[9]  Amir F. Atiya,et al.  Application of the recurrent multilayer perceptron in modeling complex process dynamics , 1994, IEEE Trans. Neural Networks.

[10]  Murat Kayri,et al.  Predictive Abilities of Bayesian Regularization and Levenberg–Marquardt Algorithms in Artificial Neural Networks: A Comparative Empirical Study on Social Data , 2016 .

[11]  Dongpu Cao,et al.  Levenberg–Marquardt Backpropagation Training of Multilayer Neural Networks for State Estimation of a Safety-Critical Cyber-Physical System , 2018, IEEE Transactions on Industrial Informatics.

[12]  Chung Choo Chung,et al.  Robust Multirate Control Scheme With Predictive Virtual Lanes for Lane-Keeping System of Autonomous Highway Driving , 2015, IEEE Transactions on Vehicular Technology.

[13]  T.,et al.  Training Feedforward Networks with the Marquardt Algorithm , 2004 .

[14]  Martin T. Hagan,et al.  Gauss-Newton approximation to Bayesian learning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[15]  Claudio Mulatti,et al.  Advanced driver assistance systems: Using multimodal redundant warnings to enhance road safety. , 2017, Applied ergonomics.

[16]  Werner Huber,et al.  Experience, Results and Lessons Learned from Automated Driving on Germany's Highways , 2015, IEEE Intelligent Transportation Systems Magazine.

[17]  Saiful Amri Mazlan,et al.  Model-Based Detection and Tracking of Single Moving Object Using Laser Range Finder , 2014, 2014 5th International Conference on Intelligent Systems, Modelling and Simulation.

[18]  Chengliang Yin,et al.  Host–Target Vehicle Model-Based Lateral State Estimation for Preceding Target Vehicles Considering Measurement Delay , 2018, IEEE Transactions on Industrial Informatics.