Multi-Agent Pursuit-Evasion Game Based on Organizational Architecture

Multi-agent coordination mechanisms are frequently used in pursuit-evasion games with the aim of enabling the coalitions of the pursuers and unifying their individual skills to deal with the complex tasks encountered. In this paper, we propose a coalition formation algorithm based on organizational principles and applied to the pursuit-evasion problem. In order to allow the alliances of the pursuers in different pursuit groups, we have used the concepts forming an organizational modeling framework known as YAMAM (Yet Another Multi Agent Model). Specifically, we have used the concepts Agent, Role, Task, and Skill, proposed in this model to develop a coalition formation algorithm to allow the optimal task sharing. To control the pursuers' path planning in the environment as well as their internal development during the pursuit, we have used a Reinforcement learning method (Q-learning). Computer simulations reflect the impact of the proposed techniques.

[1]  Edmund H. Durfee,et al.  Scaling Up Agent Coordination Strategies , 2001, Computer.

[2]  Mohammed El Habib Souidi,et al.  A New Decentralized Approach of Multiagent Cooperative Pursuit Based on the Iterated Elimination of Dominated Strategies Model , 2016 .

[3]  Guo Li,et al.  Coalition formation algorithm based on organization and Markov decision process for multi-player pursuit evasion , 2015, Multiagent Grid Syst..

[4]  Lei Ding,et al.  Pursuers-Coalition Construction Algorithm in Multi-robot Pursuit-Evasion Game , 2013 .

[5]  José Barbosa,et al.  Dynamic self-organization in holonic multi-agent manufacturing systems: The ADACOR evolution , 2015, Comput. Ind..

[6]  Jun Li,et al.  A New Approach of Multi-Robot Cooperative Pursuit Based on Association Rule Data Mining , 2009, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.

[7]  Sidney Nascimento Givigi,et al.  Multiple-model Q-learning for stochastic reinforcement delays , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[8]  Xin-Ping Guan,et al.  A cooperative pursuit-evasion game in wireless sensor and actor networks , 2013, J. Parallel Distributed Comput..

[9]  Nicola Basilico,et al.  A game theoretical approach to finding optimal strategies for pursuit evasion in grid environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Subhash Suri,et al.  k-Capture in multiagent pursuit evasion, or the lion and the hyenas , 2014, Theor. Comput. Sci..

[11]  Toshihiko Watanabe,et al.  A study on multi-agent reinforcement learning problem based on hierarchical modular fuzzy model , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[12]  Jacques Ferber,et al.  From Agents to Organizations: An Organizational View of Multi-agent Systems , 2003, AOSE.

[13]  Ramdane Maamri,et al.  FuzzyOrganization of Self-Adaptive Agents Based On Software Components , 2014, Int. J. Intell. Inf. Technol..

[14]  Victor R. Lesser,et al.  Organization-based cooperative coalition formation , 2004, Proceedings. IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2004. (IAT 2004)..

[15]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[16]  Baher Abdulhai,et al.  Reinforcement learning: Introduction to theory and potential for transport applications , 2003 .

[17]  Jianguo Jiang,et al.  Multi-task Coalition Parallel Formation Strategy Based on Reinforcement Learning , 2008 .

[18]  Ana L. C. Bazzan,et al.  Learning in groups of traffic signals , 2010, Eng. Appl. Artif. Intell..

[19]  Takuya Okawa,et al.  A study on hierarchical modular reinforcement learning for multi-agent pursuit problem based on relative coordinate states , 2009, 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation - (CIRA).

[20]  Il Hong Suh,et al.  Fast reinforcement learning using stochastic shortest paths for a mobile robot , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Guo Li,et al.  Multi-agent cooperation pursuit based on an extension of AALAADIN organisational model , 2016, J. Exp. Theor. Artif. Intell..

[22]  Akanksha Singh,et al.  Self-Organizing Agent Coalitions in Distributed Multi-agent Systems , 2010, 2010 International Conference on Computational Intelligence and Communication Networks.

[23]  Geoffrey A. Hollinger,et al.  A graph search algorithm for indoor pursuit/evasion , 2009, Math. Comput. Model..

[24]  Guo Li,et al.  Mobile agents path planning based on an extension of Bug-Algorithms and applied to the pursuit-evasion game , 2017, Web Intell..

[25]  Xia Liu,et al.  Mas-Based Pursuit-Evasion Algorithm Under Unknown Environment , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[26]  Ramdane Maamri,et al.  An Approach Based on Software Components and Mobile Agents for Developing Distributed Applications with Verification of Validity Criterion , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.