Self-organization in an agent network: A mechanism and a potential application

Self-organization provides a suitable paradigm for developing self-managed complex computing systems, e.g., decision support systems. Towards this end, in this paper, a composite self-organization mechanism in an agent network is proposed. To intuitively elucidate this mechanism, a task allocation environment is simulated. Based on self-organization principles, this mechanism enables agents to dynamically adapt relations with other agents, i.e., to change the underlying network structure, so as to achieve efficient task allocation. The proposed mechanism utilizes a trust model to assist agents in reasoning with whom to adapt relations and employs a multi-agent Q-learning algorithm for agents to learn how to adapt relations. Moreover, in this mechanism, it is considered that the agents are connected by weighted relations, instead of crisp relations. The proposed mechanism is evaluated through a comparison with a centralized mechanism and the K-Adapt mechanism in both closed and open agent networks. Experimental results demonstrate the adequate performance of the proposed mechanism in terms of the entire network profit and time consumption. Additionally, a potential application scenario of this mechanism is also given, which exhibits the potential applicability of this mechanism in some real world cases.

[1]  Hendrik Van Brussel,et al.  Emergent Forecasting Using a Stigmergy Approach in Manufacturing Coordination and Control , 2004, Engineering Self-Organising Systems.

[2]  Mark Hoogendoorn,et al.  Adaptation of Organizational Models for Multi-Agent Systems Based on Max Flow Networks , 2007, IJCAI.

[3]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[4]  Alexander V. Smirnov,et al.  Hybrid Technology for Self-Organization of Resources of Pervasive Environment for Operational Decision Support , 2010, Int. J. Artif. Intell. Tools.

[5]  T. De Wolf,et al.  Towards autonomic computing: agent-based modelling, dynamical systems analysis, and decentralised control , 2003, IEEE International Conference on Industrial Informatics, 2003. INDIN 2003. Proceedings..

[6]  Florentin Smarandache,et al.  Advances and Applications of DSmT for Information Fusion , 2004 .

[7]  Deborah Estrin,et al.  Geography-informed energy conservation for Ad Hoc routing , 2001, MobiCom '01.

[8]  Marie desJardins,et al.  Agent-organized networks for dynamic team formation , 2005, AAMAS '05.

[9]  J. Rodríguez-Aguilar,et al.  Self-configuration in Autonomic Electronic Institutions , 2006 .

[10]  Bart Selman,et al.  Agent Amplified Communication , 1996, AAAI/IAAI, Vol. 1.

[11]  Gregory J. Pottie,et al.  Protocols for self-organization of a wireless sensor network , 2000, IEEE Wirel. Commun..

[12]  Paul Scerri,et al.  Agent Organized Networks Redux , 2008, AAAI.

[13]  Franco Zambonelli,et al.  Self-Organizing Spatial Shapes in Mobile Particles: The TOTA Approach , 2004, Engineering Self-Organising Systems.

[14]  Danny Weyns,et al.  A role based model for adaptive agents , 2004 .

[15]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[16]  Marie-Pierre Gleizes,et al.  Self-Organisation and Emergence in MAS: An Overview , 2006, Informatica.

[17]  Victor R. Lesser,et al.  Multiagent reinforcement learning and self-organization in a network of agents , 2007, AAMAS '07.

[18]  Golan Lampi,et al.  Self-Organizing Maps in Decision Support: a Decision Support System Prototype , 2009 .

[19]  Victor R. Lesser,et al.  Using self-diagnosis to adapt organizational structures , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[20]  Jin Wang,et al.  A new evidential trust model for open communities , 2009, Comput. Stand. Interfaces.

[21]  Ruxandra Misdolea,et al.  Decision Support System and Customer Relationship Management as Components of the Cybernetic System Enterprise , 2010 .

[22]  Kristina Lerman,et al.  Resource allocation in the grid using reinforcement learning , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[23]  Doina Precup,et al.  Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning , 1999, Artif. Intell..

[24]  Javier Vázquez-Salceda,et al.  Organizing Multiagent Systems , 2005, Autonomous Agents and Multi-Agent Systems.

[25]  Michael Luck,et al.  Changing neighbours: improving tag-based cooperation , 2010, AAMAS.

[26]  Ramachandra Kota,et al.  Decentralized approaches for self-adaptation in agent organizations , 2012, TAAS.

[27]  Ren Shouju,et al.  Self-organization based DSS framework , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[28]  Nicholas R. Jennings,et al.  Certified reputation: how an agent can trust a stranger , 2006, AAMAS '06.

[29]  Nicholas R. Jennings,et al.  TRAVOS: Trust and Reputation in the Context of Inaccurate Information Sources , 2006, Autonomous Agents and Multi-Agent Systems.

[30]  Wendi B. Heinzelman,et al.  Adaptive protocols for information dissemination in wireless sensor networks , 1999, MobiCom.

[31]  Keith S. Decker,et al.  Organizational self-design in semi-dynamic environments , 2006, AAMAS '06.

[32]  A. Karnik,et al.  Distributed Optimal Self-Organization in Ad Hoc Wireless Sensor Networks , 2007, IEEE/ACM Transactions on Networking.

[33]  Ryszard Kowalczyk,et al.  Dynamic analysis of multiagent Q-learning with ε-greedy exploration , 2009, ICML '09.

[34]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[35]  Olivier Boissier,et al.  Using the Moise+ for a Cooperative Framework of MAS Reorganisation , 2004, SBIA.

[36]  Ramachandra Kota,et al.  Self-organising agent organisations , 2009, AAMAS.

[37]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[38]  Sascha Ossowski,et al.  Role evolution in Open Multi-Agent Systems as an information source for trust , 2010, AAMAS.

[39]  Yang Xu,et al.  An integrated token-based algorithm for scalable coordination , 2005, AAMAS '05.

[40]  Vincent Hilaire,et al.  Applications of Self-Organising Multi-Agent Systems: An Initial Framework for Comparison , 2006, Informatica.

[41]  Luc Bongaerts,et al.  Integration of scheduling and control in holonic manufacturing systems , 1998 .

[42]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[43]  Wendi Heinzelman,et al.  Energy-efficient communication protocol for wireless microsensor networks , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[44]  KarageorgosAnthony,et al.  Self-organization in multi-agent systems , 2005 .

[45]  Victor R. Lesser,et al.  Automated organization design for multi-agent systems , 2008, Autonomous Agents and Multi-Agent Systems.

[46]  Marie-Pierre Gleizes,et al.  Self-organization in multi-agent systems , 2005, The Knowledge Engineering Review.

[47]  Mohamed F. Younis,et al.  A survey on routing protocols for wireless sensor networks , 2005, Ad Hoc Networks.