Design and performance analysis of an inductive QoS routing algorithm

Routing mechanism is key to the success of large-scale, distributed communication and heterogeneous networks. Consequently, computing constrained shortest paths is fundamental to some important network functions such as QoS routing and traffic engineering. The problem of QoS routing with multiple additive constraints is known to be NP-complete but researchers have been designing heuristics and approximation algorithms for multi-constrained paths algorithms to propose pseudo-polynomial time algorithms. This paper introduces a polynomial time approximation quality of service (QoS) routing algorithm and constructs dynamic state-dependent routing policies. The proposed algorithm uses an inductive approach based on trial/error paradigm combined with swarm adaptive approaches to optimize lexicographically various QoS criteria. The originality of our approach is based on the fact that our system is capable to take into account the dynamics of the network where no model of the network dynamics is assumed initially. Our approach samples, estimates, and builds the model of pertinent aspects of the environment which is very important in heterogeneous networks. The algorithm uses a model that combines both a stochastic planned pre-navigation for the exploration phase and a deterministic approach for the backward phase. Multiple paths are searched in parallel to find the K best qualified ones. To improve the overall network performance, a load adaptive balancing policy is defined and depends on a dynamic traffic path probability distribution function. We conducted a performance analysis of the proposed QoS routing algorithm using OPNET based on a platform simulated network. The obtained results demonstrate substantial performance improvements as well as the benefits of learning approaches over networks with dynamically changing traffic.

[1]  Piet Van Mieghem,et al.  Conditions that impact the complexity of QoS routing , 2005, IEEE/ACM Transactions on Networking.

[2]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[3]  Said Hoceini,et al.  Adaptive quality of service-based routing approaches: development of neuro-dynamic state-dependent reinforcement learning algorithms: Research Articles , 2007 .

[4]  Piet Van Mieghem,et al.  Performance evaluation of constraint-based path selection algorithms , 2004, IEEE Network.

[5]  Said Hoceini,et al.  Adaptive quality of service-based routing approaches: development of neuro-dynamic state-dependent reinforcement learning algorithms , 2007, Int. J. Commun. Syst..

[6]  Abdelhamid Mellouk Quality of Service Mechanisms in Next Generation Heterogeneous Networks , 2008 .

[7]  David Eppstein,et al.  Finding the k Shortest Paths , 1999, SIAM J. Comput..

[8]  Sartaj Sahni,et al.  Approximation algorithms for multiconstrained quality-of-service routing , 2006, IEEE Transactions on Computers.

[9]  M. I. Henig Vector-Valued Dynamic Programming , 1983 .

[10]  Sartaj Sahni,et al.  An online heuristic for maximum lifetime routing in wireless sensor networks , 2006, IEEE Transactions on Computers.

[11]  Olivier Bonaventure,et al.  Open issues in interdomain routing: a survey , 2005, IEEE Network.

[12]  Jeffrey M. Jaffe,et al.  Algorithms for finding paths with multiple constraints , 1984, Networks.

[13]  Erol Gelenbe,et al.  Networking with Cognitive Packets , 2002, ICANN.

[14]  Jordi Domingo-Pascual,et al.  Research challenges in QoS routing , 2006, Comput. Commun..

[15]  Sartaj Sahni,et al.  Data Structures, Algorithms, and Applications in C++ , 1997 .

[16]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[17]  Michael L. Littman,et al.  Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach , 1993, NIPS.

[18]  Marco Dorigo,et al.  Ant colony optimization , 2006, IEEE Computational Intelligence Magazine.

[19]  Steve Uhlig,et al.  Modeling the routing of an autonomous system with C-BGP , 2005, IEEE Network.

[20]  Marwan Krunz,et al.  A randomized algorithm for finding a path subject to multiple QoS requirements , 2001, Comput. Networks.