Data-Driven Lateral Fault-tolerance Control of Autonomous Vehicle System Using Reinforcement Learning*

In this paper, a data driven lateral fault-tolerant control (LFTC) method is proposed for four wheels drive vehicles, which considering both vehicle velocity and trajectory tracking performance. The novel design of the lateral control employs with zero-sum game and adaptive dynamics programming technique to solve the Riccati equation without requiring the knowledge of system, only using online data. The LFTC consists of the data driven off-policy and adaptive control. The adaptive parameters adjusted online to compensate the actuator faults automatically. The tracking system is asymptotically stable with the disturbance attenuation level γ. Finally, simulation is provided to show the effectiveness of the proposed method.

[1]  Srinivas Peeta,et al.  Integral-Sliding-Mode Braking Control for a Connected Vehicle Platoon: Theory and Application , 2019, IEEE Transactions on Industrial Electronics.

[2]  Yungang Liu,et al.  Barbalat Lemma and its application in analysis of system stability , 2007 .

[3]  Tie Zhang,et al.  Continuous output‐feedback finite‐time control for a class of second‐order nonlinear systems with disturbances , 2016 .

[4]  Yugong Luo,et al.  An Adaptive Hierarchical Trajectory Following Control Approach of Autonomous Four-Wheel Independent Drive Electric Vehicles , 2018, IEEE Transactions on Intelligent Transportation Systems.

[5]  Luigi Palopoli,et al.  Trajectory planning for car-like vehicles: A modular approach , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[6]  Hui Zhang,et al.  Robust Weighted Gain-Scheduling $H_{\infty }$ Vehicle Lateral Motion Control With Considerations of Steering System Backlash-Type Hysteresis , 2014, IEEE Transactions on Control Systems Technology.

[7]  Yingfeng Cai,et al.  Passive fault-tolerant path following control of autonomous distributed drive electric vehicle considering steering system fault , 2019 .

[8]  Zhong-Ping Jiang,et al.  Output-feedback adaptive optimal control of interconnected systems based on robust adaptive dynamic programming , 2016, Autom..

[9]  Zhong-Ping Jiang,et al.  Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics , 2012, Autom..

[10]  Tsutomu Tashiro.  Vehicle steering control with MPC for target trajectory tracking of autonomous reverse parking , 2013, 2013 IEEE International Conference on Control Applications (CCA).

[11]  K. D. Do,et al.  Formation Tracking Control of Unicycle-Type Mobile Robots With Limited Sensing Ranges , 2008, IEEE Transactions on Control Systems Technology.

[12]  Rongrong Wang,et al.  Differential Steering Based Yaw Stabilization Using ISMC for Independently Actuated Electric Vehicles , 2018, IEEE Transactions on Intelligent Transportation Systems.

[13]  Jingqing Han,et al.  From PID to Active Disturbance Rejection Control , 2009, IEEE Trans. Ind. Electron..

[14]  Marin Kobilarov,et al.  Neural network modeling for steering control of an autonomous vehicle , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Maarouf Saad,et al.  Formation path following control of unicycle-type mobile robots , 2008, 2008 IEEE International Conference on Robotics and Automation.

[16]  Huaguang Zhang,et al.  Adaptive Dynamic Programming: An Introduction , 2009, IEEE Computational Intelligence Magazine.

[17]  Mehran Sabahi,et al.  A modified integral sliding mode control to lateral stabilisation of 4-wheel independent drive electric vehicles , 2014 .

[18]  Bart De Schutter,et al.  Reinforcement Learning and Dynamic Programming Using Function Approximators , 2010 .

[19]  Frank L. Lewis,et al.  Linear Quadratic Tracking Control of Partially-Unknown Continuous-Time Systems Using Reinforcement Learning , 2014, IEEE Transactions on Automatic Control.

[20]  Abhinav Gupta,et al.  Robust Adversarial Reinforcement Learning , 2017, ICML.

[21]  Chouki Sentouh,et al.  Driver-Automation Cooperative Approach for Shared Steering Control Under Multiple System Constraints: Design and Experiments , 2017, IEEE Transactions on Industrial Electronics.

[22]  Jochen Gallep,et al.  Model Predictive Lateral Vehicle Guidance Using a Position Controlled EPS System , 2017 .

[23]  Daxue Liu,et al.  Self-Learning Cruise Control Using Kernel-Based Least Squares Policy Iteration , 2014, IEEE Transactions on Control Systems Technology.

[24]  Maarouf Saad,et al.  Formation path following control of unicycle-type mobile robots , 2010, Robotics Auton. Syst..

[25]  Hai Yu,et al.  Active Fault-Tolerant Control for Electric Vehicles With Independently Driven Rear In-Wheel Motors Against Certain Actuator Faults , 2016, IEEE Transactions on Control Systems Technology.

[26]  Yuanqing Xia,et al.  Lateral Path Tracking Control of Autonomous Land Vehicle Based on ADRC and Differential Flatness , 2016, IEEE Transactions on Industrial Electronics.

[27]  Frank L. Lewis,et al.  $ {H}_{ {\infty }}$ Tracking Control of Completely Unknown Continuous-Time Systems via Off-Policy Reinforcement Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Sebastian Thrun,et al.  Path Planning for Autonomous Vehicles in Unknown Semi-structured Environments , 2010, Int. J. Robotics Res..