Adaptive Optimal Control of Heterogeneous CACC System With Uncertain Dynamics

Cooperative adaptive cruise control (CACC), as an extension of adaptive cruise control, connects multiple vehicles in a platoon via wireless communication. In practice, different vehicles may have different dynamic parameters and their exact values are unknown/uncertain to designers. In this brief, we propose a new control structure that uses an estimate of dynamic parameters to transform the heterogeneous CACC problem into the regulation problem of error dynamics for each vehicle in the platoon. An adaptive optimal control is proposed to learn the optimal feedback based on online data. The position transfer function between adjacent vehicles is further analyzed in the frequency domain. By sum of squares programming, the minimum headway values that ensure the vehicle string stability are found. Experiments on numerical and complex systems validate our method.

[1]  Yu Jiang,et al.  Robust Adaptive Dynamic Programming and Feedback Stabilization of Nonlinear Systems , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Didier Henrion,et al.  GloptiPoly: Global optimization over polynomials with Matlab and SeDuMi , 2003, TOMS.

[3]  Frank L. Lewis,et al.  Reinforcement Learning and Approximate Dynamic Programming for Feedback Control , 2012 .

[4]  Pablo A. Parrilo,et al.  SOSTOOLS Version 3.00 Sum of Squares Optimization Toolbox for MATLAB , 2013, ArXiv.

[5]  Bart van Arem,et al.  The Impact of Cooperative Adaptive Cruise Control on Traffic-Flow Characteristics , 2006, IEEE Transactions on Intelligent Transportation Systems.

[6]  Nathan van de Wouw,et al.  Lp String Stability of Cascaded Systems: Application to Vehicle Platooning , 2014, IEEE Transactions on Control Systems Technology.

[7]  Qichao Zhang,et al.  Policy Iteration for $H_\infty $ Optimal Control of Polynomial Nonlinear Systems via Sum of Squares Programming , 2018, IEEE Transactions on Cybernetics.

[8]  Maarten Steinbuch,et al.  String-Stable CACC Design and Experimental Validation: A Frequency-Domain Approach , 2010, IEEE Transactions on Vehicular Technology.

[9]  Daxue Liu,et al.  Self-Learning Cruise Control Using Kernel-Based Least Squares Policy Iteration , 2014, IEEE Transactions on Control Systems Technology.

[10]  Haibo He,et al.  Event-Triggered Optimal Control for Partially Unknown Constrained-Input Systems via Adaptive Dynamic Programming , 2017, IEEE Transactions on Industrial Electronics.

[11]  D. Kleinman On an iterative technique for Riccati equation computations , 1968 .

[12]  Gábor Orosz,et al.  Hierarchical Design of Connected Cruise Control in the Presence of Information Delays and Uncertain Vehicle Dynamics , 2018, IEEE Transactions on Control Systems Technology.

[13]  Dongbin Zhao,et al.  Comprehensive comparison of online ADP algorithms for continuous-time optimal control , 2017, Artificial Intelligence Review.

[14]  Hong-Fei Sun,et al.  Robust control synthesis of polynomial nonlinear systems using sum of squares technique , 2013 .

[15]  Vicente Milanés Montero,et al.  Cooperative Adaptive Cruise Control in Real Traffic Situations , 2014, IEEE Transactions on Intelligent Transportation Systems.

[16]  Dongbin Zhao,et al.  Iterative Adaptive Dynamic Programming for Solving Unknown Nonlinear Zero-Sum Game Based on Online Data , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Geert J. Heijenk,et al.  Connect & Drive: design and evaluation of cooperative adaptive cruise control for congestion reduction , 2011 .

[18]  Bart van Arem,et al.  Effects of Cooperative Adaptive Cruise Control on traffic flow stability , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[19]  Feng Gao,et al.  A comprehensive review of the development of adaptive cruise control systems , 2010 .

[20]  Vicente Milanés Montero,et al.  Experimental Application of Hybrid Fractional-Order Adaptive Cruise Control at Low Speed , 2014, IEEE Transactions on Control Systems Technology.

[21]  Nathan van de Wouw,et al.  Cooperative Adaptive Cruise Control: Network-Aware Analysis of String Stability , 2014, IEEE Transactions on Intelligent Transportation Systems.

[22]  Dongbin Zhao,et al.  Full-range adaptive cruise control based on supervised adaptive dynamic programming , 2014, Neurocomputing.

[23]  Mashrur Chowdhury,et al.  A Review of Communication, Driver Characteristics, and Controls Aspects of Cooperative Adaptive Cruise Control (CACC) , 2016, IEEE Transactions on Intelligent Transportation Systems.

[24]  Zhong-Ping Jiang,et al.  Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics , 2012, Autom..

[25]  P. Parrilo Structured semidefinite programs and semialgebraic geometry methods in robustness and optimization , 2000 .

[26]  M. Athans,et al.  On the optimal error regulation of a string of moving vehicles , 1966 .

[27]  Zhong-Ping Jiang,et al.  Data-Driven Adaptive Optimal Control of Connected Vehicles , 2017, IEEE Transactions on Intelligent Transportation Systems.

[28]  Qichao Zhang,et al.  Model-Free Optimal Control Based Intelligent Cruise Control with Hardware-in-the-Loop Demonstration [Research Frontier] , 2017, IEEE Computational Intelligence Magazine.

[29]  Gábor Orosz,et al.  Motif-Based Design for Connected Vehicle Systems in Presence of Heterogeneous Connectivity Structures and Time Delays , 2016, IEEE Transactions on Intelligent Transportation Systems.