ADP-Based Intelligent Decentralized Control for Multi-Agent Systems Moving in Obstacle Environment

This paper focuses on the decentralized control problem of multi-agent systems with multiple control objectives, including target tracking, velocity synchronization, collision avoidance, and obstacle avoidance. To enable the real-time application and optimization, a control scheme is constructed based on the idea of adaptive dynamic programming (ADP). The cost function is defined according to the control objectives and approximated by a critic neural network. An action neural network is applied to approximate the optimal controller, which is achieved by minimizing the cost function. Based on the deduced weight updating laws, the proposed control scheme can learn online with good adaptability to unknown environment. Finally, a simulation of seven agents moving in two-obstacle environment is conducted to show the validity of the intelligent controller.

[1]  Yuanqing Xia,et al.  Finite-time fault-tolerant coordination control for multiple Euler-Lagrange systems in obstacle environments , 2017, J. Frankl. Inst..

[2]  Haibo He,et al.  Adaptive near-optimal controllers for non-linear decentralised feedback stabilisation problems , 2017 .

[3]  Youmin Zhang,et al.  Decentralized leader-follower formation control with obstacle avoidance of multiple unicycle mobile robots , 2015, 2015 IEEE 28th Canadian Conference on Electrical and Computer Engineering (CCECE).

[4]  Yu-Ping Tian,et al.  Formation tracking and attitude synchronization control of underactuated ships along closed orbits , 2015 .

[5]  Xuejing Lan,et al.  Adaptive-Neural-Network-Based Shape Control for a Swarm of Robots , 2018, Complex..

[6]  Yen-Sheng Chen,et al.  Intelligent obstacle avoidance control strategy for wheeled mobile robot , 2009, 2009 ICCAS-SICE.

[7]  Shengli Xie,et al.  Fair Energy Scheduling for Vehicle-to-Grid Networks Using Adaptive Dynamic Programming , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Qing-Long Han,et al.  Distributed Formation Control of Networked Multi-Agent Systems Using a Dynamic Event-Triggered Communication Mechanism , 2017, IEEE Transactions on Industrial Electronics.

[9]  Dario Amaya,et al.  Approach of Kinematic Control for a Nonholonomic Wheeled Robot using Artificial Neural Networks and Genetic Algorithms , 2017, 2017 International Conference and Workshop on Bioinspired Intelligence (IWOBI).

[10]  Guang-Hong Yang,et al.  Robust adaptive hierarchical insensitive tracking control of a class of leader-follower agents , 2017, Inf. Sci..

[11]  Jianqiao Yu,et al.  Optimal formation control with limited communication for multi-unmanned aerial vehicle in an obstacle-laden environment , 2017 .

[12]  Chien Chern Cheah,et al.  Region-based shape control for a swarm of robots , 2009, Autom..

[13]  Xiong Luo,et al.  Web Service QoS Prediction Based on Adaptive Dynamic Programming Using Fuzzy Neural Networks for Cloud Services , 2015, IEEE Access.

[14]  Javier Alonso-Mora,et al.  Multi-robot formation control and object transport in dynamic environments via constrained optimization , 2017, Int. J. Robotics Res..

[15]  Yongcan Cao,et al.  Distributed Coordination of Multi-agent Networks: Emergent Problems, Models, and Issues , 2010 .

[16]  Paul J. Werbos,et al.  Foreword: ADP - The Key Direction for Future Research in Intelligent Control and Understanding Brain Intelligence , 2008, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Yongji Wang,et al.  Rapid trajectory planning of a reusable launch vehicle for airdrop with geographic constraints , 2019 .

[18]  Derong Liu,et al.  Adaptive Dynamic Programming for Optimal Tracking Control of Unknown Nonlinear Systems With Application to Coal Gasification , 2014, IEEE Transactions on Automation Science and Engineering.

[19]  Derong Liu,et al.  Multibattery Optimal Coordination Control for Home Energy Management Systems via Distributed Iterative Adaptive Dynamic Programming , 2015, IEEE Transactions on Industrial Electronics.

[20]  Donghan Kim,et al.  Navigation method for wheeled mobile robot using streamline of complex potential flow , 2008, 2008 International Conference on Control, Automation and Systems.

[21]  Wei Xing Zheng,et al.  Adaptive Fault-Tolerant Consensus for a Class of Uncertain Nonlinear Second-Order Multi-Agent Systems With Circuit Implementation , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[22]  Haibo He,et al.  Adaptive Critic Nonlinear Robust Control: A Survey , 2017, IEEE Transactions on Cybernetics.

[23]  Jitao Sun,et al.  Distributed optimal control for multi-agent systems with obstacle avoidance , 2016, Neurocomputing.

[24]  Derong Liu,et al.  Decentralized Stabilization for a Class of Continuous-Time Nonlinear Interconnected Systems Using Online Learning Optimal Control Approach , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Yun-Shan Wei,et al.  Adaptive 3D Distance-Based Formation Control of Multiagent Systems with Unknown Leader Velocity and Coplanar Initial Positions , 2018, Complex..

[26]  Yutian Liu,et al.  Obstacle avoidance method based on the movement trend of dynamic obstacles , 2018, 2018 3rd International Conference on Control and Robotics Engineering (ICCRE).

[27]  Donghua Zhou,et al.  Event-triggered resilient filtering with measurement quantization and random sensor failures: Monotonicity and convergence , 2018, Autom..

[28]  Ricardo Carelli,et al.  Dynamic obstacle avoidance based on time-variation of a potential field for robots formation , 2017, 2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM).

[29]  Eunmi Oh,et al.  An Integral Framework of Task Assignment and Path Planning for Multiple Unmanned Aerial Vehicles in Dynamic Environments , 2013, J. Intell. Robotic Syst..

[30]  Wei Li,et al.  Adaptive Artificial Potential Field Approach for Obstacle Avoidance Path Planning , 2014, 2014 Seventh International Symposium on Computational Intelligence and Design.

[31]  Anuradha M. Annaswamy,et al.  Adaptive configuration control of multiple UAVs , 2013 .

[32]  Xiafu Peng,et al.  Velocity-Change-Space-based dynamic motion planning for mobile robots navigation , 2014, Neurocomputing.

[33]  Yongji Wang,et al.  Cooperative control of multi-missile systems , 2015 .