Deflection Routing in Complex Networks

Deflection routing is a viable contention resolution scheme in buffer-less network architectures where contention is the main source of information loss. In recent years, various reinforcement learning-based deflection routing algorithms have been proposed. However, performance of these algorithms has not been evaluated in larger networks that resemble the autonomous system-level view of the Internet. In this Chapter, we compare performance of three reinforcement learning-based deflection routing algorithms by using the National Science Foundation network topology and topologies generated using Waxman and Barabasi-Albert algorithms. We examine the scalability of these deflection routing algorithms by increasing the network size while keeping the network load constant.

[1]  Anthony S. Acampora,et al.  Multihop lightwave networks: a comparison of store-and-forward and hot-potato routing , 1991, IEEE INFCOM '91. The conference on Computer Communications. Tenth Annual Joint Comference of the IEEE Computer and Communications Societies Proceedings.

[2]  H. M. H. Shalaby,et al.  MAC-Layer Performance Enhancement Using Control Packet Buffering in Optical Burst-Switched Networks , 2012, Journal of Lightwave Technology.

[3]  Ellen W. Zegura,et al.  A quantitative comparison of graph-based models for Internet topology , 1997, TNET.

[4]  Harry G. Perros,et al.  On the departure process of burst aggregation algorithms in optical burst switching , 2009, Comput. Networks.

[5]  Gabriel Junyent,et al.  Using updated neighbor state information for efficient contention avoidance in OBS networks , 2010, Comput. Commun..

[6]  M.A. Bassiouni,et al.  Improving Fairness With Novel Adaptive Routing in Optical Burst-Switched Networks , 2009, Journal of Lightwave Technology.

[7]  Chunming Qiao,et al.  Traffic statistics and performance evaluation in optical burst switched networks , 2004 .

[8]  Michalis Faloutsos,et al.  Power laws and the AS-level internet topology , 2003, TNET.

[9]  Moshe Zukerman,et al.  Internet traffic modeling and future technology implications , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[10]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[11]  Moshe Zukerman,et al.  Performance evaluation of a queue fed by a Poisson Pareto burst process , 2002, Comput. Networks.

[12]  Guanrong Chen,et al.  Theory and applications of complex networks: Advances and challenges , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[13]  Ann Nowé,et al.  Q-learning for adaptive load based routing , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[14]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[15]  Albert G. Greenberg,et al.  Deflection routing in hypercube networks , 1992, IEEE Trans. Commun..

[16]  Ljiljana Trajkovic,et al.  Spectral analysis of Internet topology graphs , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[17]  Flaminio Borgonovo,et al.  Unslotted deflection routing in all-optical networks , 1993, Proceedings of GLOBECOM '93. IEEE Global Telecommunications Conference.

[18]  Xiaohong Jiang,et al.  Efficient Designs of Optical LIFO Buffer with Switches and Fiber Delay Lines , 2011, IEEE Transactions on Communications.

[19]  P. Baran,et al.  On Distributed Communications Networks , 1964 .

[20]  L Trajkovic,et al.  Analysis of Internet Topologies , 2010, IEEE Circuits and Systems Magazine.

[21]  Ljiljana Trajkovic,et al.  Analysis of Internet topologies: A historical view , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[22]  Leonid Peshkin,et al.  Reinforcement learning for adaptive routing , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[23]  Halima Elbiaze,et al.  Adaptive threshold-based decision for efficient hybrid deflection and retransmission scheme in OBS networks , 2009, 2009 International Conference on Optical Network Design and Modeling.

[24]  Ljiljana Trajkovic,et al.  Intelligent Deflection Routing in Buffer-Less Networks , 2015, IEEE Transactions on Cybernetics.

[25]  Hai Le Vu,et al.  Modelling and performance evaluation of optical burst switched networks with deflection routing and wavelength reservation , 2004, IEEE INFOCOM 2004.

[26]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[27]  Abdelhakim Hafid,et al.  Topology-aware wavelength partitioning for DWDM OBS networks: A novel approach for absolute QoS provisioning , 2010, Comput. Networks.

[28]  Flaminio Borgonovo.  Deflection routing , 1995 .

[29]  Guanrong Chen,et al.  A reinforcement learning-based algorithm for deflection routing in optical burst-switched networks , 2013, 2013 IEEE 14th International Conference on Information Reuse & Integration (IRI).

[30]  Wen-Xu Wang,et al.  Integrating local static and dynamic information for routing traffic. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Guanrong Chen,et al.  RED-f routing protocol for complex networks , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[32]  M. Zukerman,et al.  A New Method for Blocking Probability Evaluation in OBS/OPS Networks With Deflection Routing , 2009, Journal of Lightwave Technology.

[33]  Mikel Izal,et al.  On the influence of self-similarity on optical burst switching traffic , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[34]  Chunming Qiao,et al.  Optical burst switching (OBS) - a new paradigm for an Optical Internet^{1} , 1999, J. High Speed Networks.

[35]  Abdelhakim Hafid,et al.  Novel reinforcement learning-based approaches to reduce loss probability in buffer-less OBS networks , 2009, Comput. Networks.

[36]  Hai Le Vu,et al.  Stabilizing deflection routing in optical burst switched networks , 2007, IEEE Journal on Selected Areas in Communications.

[37]  BERNARD M. WAXMAN,et al.  Routing of multipoint connections , 1988, IEEE J. Sel. Areas Commun..

[38]  C. Siva Ram Murthy,et al.  A Reinforcement Learning Framework for Path Selection and Wavelength Selection in Optical Burst Switched Networks , 2007, IEEE Journal on Selected Areas in Communications.

[39]  Chunming Qiao,et al.  Comparative study of contention resolution policies in optical burst-switched WDM networks , 2000, SPIE Optics East.

[40]  Michalis Faloutsos,et al.  On power-law relationships of the Internet topology , 1999, SIGCOMM '99.

[41]  Yijun Xiong,et al.  Control architecture in optical burst-switched WDM networks , 2000, IEEE Journal on Selected Areas in Communications.

[42]  M. Zukerman,et al.  Bounds of the overflow priority classification for blocking probability approximation in OBS networks , 2013, IEEE/OSA Journal of Optical Communications and Networking.

[43]  B. Bollobás.  The evolution of random graphs , 1984 .

[44]  Wei Dai,et al.  A maximum-efficiency-first multi-path route selection strategy for optical burst switching networks , 2014 .

[45]  Ljiljana Trajkovic,et al.  A Predictive Q-Learning Algorithm for Deflection Routing in Buffer-less Networks , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[46]  Christophe Diot,et al.  An approach to alleviate link overload as observed on an IP backbone , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[47]  George N. Rouskas,et al.  JumpStart: a just-in-time signaling architecture for WDM burst-switched networks , 2002 .

[48]  Michael L. Littman,et al.  Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach , 1993, NIPS.

[49]  Bin Zhang,et al.  A Novel Contention Resolution Scheme of Hybrid Shared Wavelength Conversion for Optical Packet Switching , 2012, Journal of Lightwave Technology.

[50]  Nicholas F. Maxemchuk,et al.  Comparison of deflection and store-and-forward techniques in the Manhattan Street and Shuffle-Exchange Networks , 1989, IEEE INFOCOM '89, Proceedings of the Eighth Annual Joint Conference of the IEEE Computer and Communications Societies.

[51]  Johanne Cohen,et al.  Unslotted deflection routing: a practical and efficient protocol for multihop optical networks , 2001, TNET.

[52]  Dit-Yan Yeung,et al.  Predictive Q-Routing: A Memory-based Reinforcement Learning Approach to Adaptive Traffic Control , 1995, NIPS.

[53]  Chunming Qiao,et al.  Optical burst switching: a new area in optical networking research , 2004, IEEE Netw..

[54]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[55]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[56]  Harry G. Perros,et al.  Connection-Oriented Networks: SONET/SDH, ATM, MPLS and Optical Networks , 2005 .

[57]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[58]  David Wetherall,et al.  Source selectable path diversity via routing deflections , 2006, SIGCOMM 2006.

[59]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[60]  Hai Le Vu,et al.  OBS contention resolution performance , 2007, Perform. Evaluation.

[61]  George N. Rouskas,et al.  Techniques for optical packet switching and optical burst switching , 2001, IEEE Commun. Mag..

[62]  Walter Willinger,et al.  The origin of power laws in Internet topologies revisited , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[63]  V.M. Vokkarane,et al.  QoS-Based Manycasting Over Optical Burst-Switched (OBS) Networks , 2010, IEEE/ACM Transactions on Networking.

[64]  Stefano Bregni,et al.  Buffering-deflection tradeoffs in optical burst switching , 2010, Photonic Network Communications.

[65]  Guanrong Chen,et al.  Jittering performance of random deflection routing in packet networks , 2013, Commun. Nonlinear Sci. Numer. Simul..

[66]  Kenneth L. Calvert,et al.  Modeling Internet topology , 1997, IEEE Commun. Mag..