Adaptive Optimal Distributed Control of Linear Interconnected Systems

In this paper, we present a distributed adaptive optimal control scheme for uncertain interconnected linear dynamical system using state and output feedback. The control policies at each of the distributed controllers are synthesized using a multi-player optimization problem via nonzero sum differential game theory. A novel adaptive observer, co-located with the distributed controller at each subsystem, is employed to reconstruct the augmented system internal states of the interconnected system. To accommodate the system uncertainties, an adaptive estimation scheme is proposed and the Nash equilibrium solution to the optimization problem is learned at each controller using the temporal difference error. The proposed distributed control scheme is employed in numerical simulations to regulate a network of ten interconnected linear systems and the results are presented to demonstrate the efficacy of the design.

[1]  Chao Li,et al.  Neural-network-based decentralized control of continuous-time nonlinear interconnected systems with unknown dynamics , 2015, Neurocomputing.

[2]  Y. Ho,et al.  Nonzero-sum differential games , 1969 .

[3]  Eduardo D. Sontag,et al.  Synchronization of Interconnected Systems With Applications to Biochemical Networks: An Input-Output Approach , 2009, IEEE Transactions on Automatic Control.

[4]  Avimanyu Sahoo,et al.  Approximate Optimal Distributed Control of Nonlinear Interconnected Systems Using Event-Triggered Nonzero-Sum Games , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Kok Kiong Tan,et al.  Nonlinear adaptive control of interconnected systems using neural networks , 2006, IEEE Transactions on Neural Networks.

[6]  Ali Heydari,et al.  Finite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive Critics , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Victor M. Becerra,et al.  Optimal control , 2008, Scholarpedia.

[8]  Derong Liu,et al.  Neural-Network-Based Distributed Adaptive Robust Control for a Class of Nonlinear Multiagent Systems With Time Delays and External Noises , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Frank L. Lewis,et al.  Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton-Jacobi equations , 2011, Autom..

[10]  Marcus Johnson,et al.  Approximate $N$ -Player Nonzero-Sum Game Solution for an Uncertain Continuous Nonlinear System , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Sarangapani Jagannathan,et al.  Event-Triggered Distributed Approximate Optimal State and Output Control of Affine Nonlinear Interconnected Systems , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[12]  S. Jagannathan,et al.  Neural Network-Based Optimal Control of Mobile Robot Formations With Reduced Information Exchange , 2013, IEEE Transactions on Control Systems Technology.

[13]  Frank L. Lewis,et al.  Game Theory-Based Control System Algorithms with Real-Time Reinforcement Learning: How to Solve Multiplayer Games Online , 2017, IEEE Control Systems.

[14]  Warren E. Dixon,et al.  Concurrent learning-based approximate feedback-Nash equilibrium solution of N-player nonzero-sum differential games , 2013, IEEE/CAA Journal of Automatica Sinica.

[15]  Manoj Kumar,et al.  Reinforcement learning based controller synthesis for flexible aircraft wings , 2014, IEEE/CAA Journal of Automatica Sinica.

[16]  Kumpati S. Narendra,et al.  Decentralised adaptive control with partial communication , 2006 .

[17]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[18]  Frank L. Lewis,et al.  Optimal and Autonomous Control Using Reinforcement Learning: A Survey , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Shahab Mehraeen,et al.  Novel Decentralized Control of Power Systems With Penetration of Renewable Energy Sources in Small-Scale Power Systems , 2014, IEEE Transactions on Energy Conversion.