A Reinforcement Learning-Based Deflection Routing Scheme for Buffer-Less OBS Networks

Optical burst switching (OBS) is a promising switching paradigm for the next generation Internet. A buffer-less OBS network can be implemented simply and cost-effectively without the need for either wavelength converters or optical buffers which are, currently, neither cost-effective nor technologically mature. However, this type of OBS networks suffers from relatively high loss probability caused by wavelength contentions at core nodes. This issue could prevent or, at least, delay the adoption of OBS networks as a solution for the next generation optical Internet. Deflection routing is one of the contention resolution approaches that have been proposed to tackle this problem. In addition to be cost-effective, it is also efficient in reducing loss probability, especially with low and moderate traffic loads. In this paper, we propose an adaptive reinforcement learning-based deflection routing scheme (RLDRS) which focuses on the route selection issue by choosing the optimal alternative output port in terms of both loss probability and delay when deflection is performed. Moreover, RLDRS limits the number of authorized deflections of each burst in order to reduce the additional traffic caused by deflection routing and to prohibit excessive deflections. Simulation results show that RLDRS reduces effectively loss probability and outperforms shortest path deflection routing (SPDR).

[1]  Moshe Zukerman,et al.  Prioritized Deflection Routing in Optical Burst Switching Networks , 2005, IEICE Trans. Commun..

[2]  Hai Le Vu,et al.  Modelling and performance evaluation of optical burst switched networks with deflection routing and wavelength reservation , 2004, IEEE INFOCOM 2004.

[3]  SuKyoung Lee,et al.  Dynamic Deflection Routing with Virtual Wavelength Assignment in Optical Burst-Switched Networks , 2004, Photonic Network Communications.

[4]  Te-Lung Liu,et al.  On deflection routing in optical burst-switched networks , 2005, J. High Speed Networks.

[5]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[6]  Hideaki Tanaka,et al.  Deflection Routing for Optical Bursts Considering Possibility of Contention at Downstream Nodes , 2005, IEICE Trans. Commun..

[7]  Krishna M. Sivalingam,et al.  Performance evaluation of TCP over optical burst-switched (OBS) WDM networks , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[8]  Nen-Fu Huang,et al.  Performance analysis of deflection routing in optical burst-switched networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[9]  Chunming Qiao,et al.  Assembling TCP/IP packets in optical burst switched networks , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[10]  Xi Wang,et al.  Burst optical deflection routing protocol for wavelength routing WDM networks , 2000, Other Conferences.

[11]  QiaoChunming,et al.  Optical burst switching (OBS) - a new paradigm for an optical Internet , 1999 .

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Chunming Qiao,et al.  Performance analysis of optical burst switched node with deflection routing , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[14]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[15]  Sungchang Kim,et al.  Contention resolution for optical burst switching networks using alternative routing , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[16]  SuKyoung Lee,et al.  Contention-based limited deflection routing protocol in optical burst-switched networks , 2005, IEEE Journal on Selected Areas in Communications.