Intelligent Multiagent Coordination Based on Reinforcement Hierarchical Neuro-fuzzy Models

This paper presents the research and development of two hybrid neuro-fuzzy models for the hierarchical coordination of multiple intelligent agents. The main objective of the models is to have multiple agents interact intelligently with each other in complex systems. We developed two new models of coordination for intelligent multiagent systems, which integrates the Reinforcement Learning Hierarchical Neuro-Fuzzy model with two proposed coordination mechanisms: the MultiAgent Reinforcement Learning Hierarchical Neuro-Fuzzy with a market-driven coordination mechanism (MA-RL-HNFP-MD) and the MultiAgent Reinforcement Learning Hierarchical Neuro-Fuzzy with graph coordination (MA-RL-HNFP-CG). In order to evaluate the proposed models and verify the contribution of the proposed coordination mechanisms, two multiagent benchmark applications were developed: the pursuit game and the robot soccer simulation. The results obtained demonstrated that the proposed coordination mechanisms greatly improve the performance of the multiagent system when compared with other strategies.

[1]  Dídac Busquets,et al.  A Multiagent System for Coordinating Ambulances for Emergency Medical Services , 2008, IEEE Intelligent Systems.

[2]  Kotaro Hirasawa,et al.  A study of evolutionary multiagent models based on symbiosis , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Javier Bajo,et al.  Hybrid Neural Intelligent System to Predict Business Failure in Small-to-Medium-Size Enterprises , 2011, Int. J. Neural Syst..

[4]  Dimitris C. Theodoridis,et al.  Indirect Adaptive Control of nonlinear Systems Based on Bilinear Neuro-Fuzzy Approximation , 2013, Int. J. Neural Syst..

[5]  VASSILIS S. KODOGIANNIS,et al.  A Clustering-Based Fuzzy Wavelet Neural Network Model for Short-Term Load Forecasting , 2013, Int. J. Neural Syst..

[6]  Wenwu Yu,et al.  An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination , 2012, IEEE Transactions on Industrial Informatics.

[7]  Danny Weyns,et al.  Self-Adaptation Using Multiagent Systems , 2010, IEEE Software.

[8]  Petar M. Djuric,et al.  Distributed Bayesian learning in multiagent systems: Improving our understanding of its capabilities and limitations , 2012, IEEE Signal Processing Magazine.

[9]  Abdulsalam Yassine,et al.  A novel multi-agent system utilizing quantum-inspired evolution for demand side management in the future smart grid , 2013, Integr. Comput. Aided Eng..

[10]  Maurizio Mancini,et al.  Expressive Copying Behavior for Social Agents: A Perceptual Analysis , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[11]  Kwang Mong Sim,et al.  Grid Commerce, Market-Driven G-Negotiation, and Grid Resource Management , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Nikos A. Vlassis,et al.  Collaborative Multiagent Reinforcement Learning by Payoff Propagation , 2006, J. Mach. Learn. Res..

[13]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[14]  Jaideep Roy.  When aspiring and Rational Agents strive to Coordinate , 2007, IGTR.

[15]  Junping Du,et al.  Multi-agent iterative learning control with communication topologies dynamically changing in two directions , 2013 .

[16]  Ron Sun,et al.  Learning to cooperate in solving the traveling salesman problem , 2005, Int. J. Neural Syst..

[17]  Debasish Ghose,et al.  Self Assessment-Based Decision Making for Multiagent Cooperative Search , 2011, IEEE Transactions on Automation Science and Engineering.

[18]  Reid G. Simmons,et al.  Coordinated Multiagent Teams and Sliding Autonomy for Large-Scale Assembly , 2006, Proceedings of the IEEE.