A Framework and Model for Soft Routing: The Markovian Termite and Other Curious Creatures

A theoretical framework and model is presented to study the self-organized behavior of probabilistic routing protocols for computer networks. Such soft routing protocols have attracted attention for delivering packets reliably, robustly, and efficiently. The framework supports several features necessary for emergent routing behavior, including feedback loops and indirect communication between peers. Efficient global operating parameters can be estimated without resorting to expensive monte-carlo simulation of the whole system. Key model parameters are routing sensitivity and routing threshold, or noise, which control the “randomness” of packet routes between source and destination, and a metric estimator. Global network characteristics are estimated, including steady state routing probabilities, average path length, and path robustness. The framework is based on a markov chain analysis. Individual network nodes are represented as states. Standard techniques are used to find primary statistics of the steady state global routing pattern, given a set of link costs. The use of packets to collect information about, or “sample,” the network for new path information is also reviewed. How the network sample rate influences performance is investigated.

[1]  Nobuo Nakajima,et al.  Ad-hoc On Demand Distance Vector (AODV) Performance Enhancement with Active Route Time-Out parameter , 2008 .

[2]  Stephen B. Wicker,et al.  ASYMPTOTIC PHEROMONE BEHAVIOR IN SWARM INTELLIGENT MANETS An Analytical Analysis of Routing Behavior , 2004 .

[3]  Stephen B. Wicker,et al.  Termite: a swarm intelligent routing algorithm for mobile wireless ad-hoc networks , 2005 .

[4]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[5]  Horst F. Wedde,et al.  The wisdom of the hive applied to mobile ad-hoc networks , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[6]  Luca Maria Gambardella,et al.  Using Ant Agents to Combine Reactive and Proactive Strategies for Routing in Mobile Ad-hoc Networks , 2005, Int. J. Comput. Intell. Appl..

[7]  Charles E. Perkins,et al.  Ad-hoc on-demand distance vector routing , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[8]  Martin Heusse,et al.  Adaptive Agent-Driven Routing and Load Balancing in Communication Networks , 1998, Adv. Complex Syst..

[9]  Marco Dorigo,et al.  Mobile agents for adaptive routing , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[10]  Jim Dowling,et al.  Using feedback in collaborative reinforcement learning to adaptively optimize MANET routing , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[11]  Imed Bouazizi,et al.  ANT-ROUTING-ALGORITHM ( ARA ) FOR MOBILE MULTI-HOP AD-HOC NETWORKS – NEW FEATURES AND RESULTS , 2003 .

[12]  Devika Subramanian,et al.  Ants and Reinforcement Learning: A Case Study in Routing in Dynamic Networks , 1997, IJCAI.

[13]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[14]  Torsten Braun,et al.  Ants-Based Routing in Large Scale Mobile Ad-Hoc Networks , 2003, KiVS Kurzbeiträge.

[15]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[16]  Sundaram Rajagopalan Chien-Chung Shen A Routing Suite for Mobile Ad hoc Networks using Swarm Intelligence ∗ , 2004 .

[17]  Janet Bruten,et al.  Ant-like agents for load balancing in telecommunications networks , 1997, AGENTS '97.

[18]  Marco Dorigo,et al.  Ant Colony Optimization and Stochastic Gradient Descent , 2002, Artificial Life.

[19]  John S. Baras,et al.  A Probabilistic Emergent Routing Algorithm for Mobile Ad Hoc Networks , 2003 .

[20]  Michael L. Littman,et al.  Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach , 1993, NIPS.

[21]  Luca Maria Gambardella,et al.  Ant Algorithms for Discrete Optimization , 1999, Artificial Life.

[22]  Kwang Mong Sim,et al.  Ant colony optimization for routing and load-balancing: survey and new directions , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[23]  Charles E. Perkins,et al.  Ad hoc On-Demand Distance Vector (AODV) Routing , 2001, RFC.

[24]  Keith L. Clark,et al.  On Optimal Parameters for Ant Colony Optimization Algorithms , 2005, IC-AI.

[25]  Léon J. M. Rothkrantz,et al.  Ant-Based Load Balancing in Telecommunications Networks , 1996, Adapt. Behav..

[26]  Stephen B. Wicker,et al.  Asymptotic Pheromone Behavior in Swarm Intelligent Manets , 2004, MWCN.