Self-Organization for Search in Peer-to-Peer Networks: The Exploitation-Exploration Dilemma

This paper presents the design and evaluation of an ant-based approach to query routing in peer-to-peer networks. After pointing out how to employ the ant metaphor in peer-to-peer networks, we conduct a thorough evaluation of the impact of different settings for the configurable parameters present in ant algorithms on the performance values. In particular, the focus is on the effects of setting the ratio between (1) ants exploiting the option currently known as the best one and (2) ants exploring the search space with the aim of finding improved options. We show that the exploitation-exploration dilemma can be avoided by an adequate design of the exploring option

[1]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[2]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[3]  Hein Meling,et al.  Anthill: a framework for the development of agent-based peer-to-peer systems , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[4]  Gerti Kappel,et al.  Using taxonomies for content-based routing with ants , 2007, Comput. Networks.

[5]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[6]  HolmqvistMikael.  Experiential Learning Processes of Exploitation and Exploration Within and Between Organizations , 2004 .

[7]  Matei Ripeanu,et al.  Peer-to-peer architecture case study: Gnutella network , 2001, Proceedings First International Conference on Peer-to-Peer Computing.

[8]  E. Michlmayr.  Specification of the SemAnt Algorithm ∗ , 2006 .

[9]  Zahia Guessoum,et al.  The Exploration-Exploitation Dilemma for Adaptive Agents , 2005 .

[10]  Hermann de Meer,et al.  Self-Organizing Systems, First International Workshop, IWSOS 2006, and Third International Workshop on New Trends in Network Architectures and Services, EuroNGI 2006, Passau, Germany, September 18-20, 2006, Proceedings , 2006, IWSOS/EuroNGI.

[11]  Tom Holvoet,et al.  A Pheromone-Based Coordination Mechanism Applied in Peer-to-Peer , 2003, AP2PC.

[12]  Edith Cohen,et al.  Search and replication in unstructured peer-to-peer networks , 2002, ICS '02.

[13]  Luca Maria Gambardella,et al.  AntHocNet: An Ant-Based Hybrid Routing Algorithm for Mobile Ad Hoc Networks , 2004, PPSN.

[14]  Mikael Holmqvist,et al.  Experiential Learning Processes of Exploitation and Exploration Within and Between Organisations : An Empirical Study of Product Development, Department of Business Studies , 2003 .

[15]  Roberto Montemanni,et al.  Design patterns from biology for distributed computing , 2006, TAAS.

[16]  Marco Dorigo,et al.  AntNet: Distributed Stigmergetic Control for Communications Networks , 1998, J. Artif. Intell. Res..

[17]  Elke Michlmayr.  Ant Algorithms for Search in Unstructured Peer-to-Peer Networks , 2006, 22nd International Conference on Data Engineering Workshops (ICDEW'06).

[18]  S. Graf,et al.  Applying Ant-based Multi-Agent Systems to Query Routing in Distributed Environments , 2006, 2006 3rd International IEEE Conference Intelligent Systems.

[19]  Hein Meling,et al.  Messor: Load-Balancing through a Swarm of Autonomous Agents , 2002, AP2PC.

[20]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[21]  Tom Holvoet,et al.  A pheromone-based coordination mechanism applied in P2P , 2003 .

[22]  Jon M. Kleinberg,et al.  Navigation in a small world , 2000, Nature.

[23]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[24]  Pattie Maes,et al.  Explore/Exploit Strategies in Autonomy , 1996 .

[25]  Takashige Hoshiai,et al.  Decentralized Meta-Data Strategies: Effective Peer-to-Peer Search , 2003 .

[26]  Eytan Ruppin,et al.  Evolution of Reinforcement Learning in Uncertain Environments , 2001 .

[27]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[28]  Arne Handt.  Proposal for Self-organizing Information Distribution in Peer-to-Peer Networks , 2006, IWSOS/EuroNGI.

[29]  Sven Koenig.  'From Animals to Animats 5': Proceedings of the Fifth International Conference on Simulation of Adaptive Behavior , 2000, Artificial Life.

[30]  Isaac Meilijson,et al.  Evolution of Reinforcement Learning in Uncertain Environments: A Simple Explanation for Complex Foraging Behaviors , 2002, Adapt. Behav..

[31]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..