Machine-learning-based prediction for resource (Re)allocation in optical data center networks

Traffic prediction and utilization of past information are essential requirements for intelligent and efficient management of resources, especially in optical data center networks (ODCNs), which serve diverse applications. In this paper, we consider the problem of traffic aggregation in ODCNs by leveraging the predictable or exact knowledge of application-specific information and requirements, such as holding time, bandwidth, traffic history, and latency. As ODCNs serve diverse flows (e.g., long/ elephant and short/mice), we utilize machine learning (ML) for prediction of time-varying traffic and connection blocking inODCNs.Furthermore,withthe predictedmean service time, passed time is utilized to estimate the mean residual life (MRL) of an active flow (connection). The MRL information is used for dynamic traffic aggregation while allocating resources to a new connection request. Additionally, blocking rate is predicted for a future time interval based on the predicted traffic and past blocking information, which is used to trigger a spectrumreallocation process (also called defragmentation) to reduce spectrum fragmentation resulting from the dynamic connection setup and tearing-down scenarios. Simulation results showthatML-based prediction and initial setup times (history) of traffic flows can be used to further improve connection blocking and resource utilization in space-division multiplexed ODCNs.

[1]  Gabriel Junyent,et al.  Using spectrum fragmentation to better allocate time-varying connections in elastic optical networks , 2014, IEEE/OSA Journal of Optical Communications and Networking.

[2]  George N. Rouskas,et al.  Lightpath Management in SDN-Based Elastic Optical Networks With Power Consumption Considerations , 2017, Journal of Lightwave Technology.

[3]  Biswanath Mukherjee,et al.  Holding-Time-Aware Dynamic Traffic Grooming , 2008, IEEE Journal on Selected Areas in Communications.

[4]  Yi Lin,et al.  Time-aware software defined networking (Ta-SDN) for flexi-grid optical networks supporting data center application , 2013, 2013 IEEE Globecom Workshops (GC Wkshps).

[5]  Yawei Yin,et al.  Dynamic on-demand defragmentation in flexible bandwidth elastic optical networks. , 2012, Optics express.

[6]  Kai Wang,et al.  An Efficient Routing and Spectrum Assignment Algorithm Using Prediction for Elastic Optical Networks , 2016, 2016 International Conference on Information System and Artificial Intelligence (ISAI).

[7]  Alex C. Snoeren,et al.  Inside the Social Network's (Datacenter) Network , 2015, Comput. Commun. Rev..

[8]  Albert G. Greenberg,et al.  The nature of data center traffic: measurements & analysis , 2009, IMC '09.

[9]  Sherif Ishak,et al.  A Hidden Markov Model for short term prediction of traffic conditions on freeways , 2014 .

[10]  Frank Proschan,et al.  Mean Residual Life: Theory and Applications , 1988 .

[11]  Hong Liu,et al.  Predicting Inter-Data-Center Network Traffic Using Elephant Flow and Sublink Information , 2016, IEEE Transactions on Network and Service Management.

[12]  Changsheng You,et al.  Dynamic and Adaptive Bandwidth Defragmentation in Spectrum-Sliced Elastic Optical Networks With Time-Varying Traffic , 2014, Journal of Lightwave Technology.

[13]  Yuefeng Ji,et al.  Time-Spectrum Consecutiveness Based Scheduling With Advance Reservation in Elastic Optical Networks , 2015, IEEE Communications Letters.

[14]  K. K. Aggarwal,et al.  Mean residual life function for normal, gamma and lognormal densities , 1983 .

[15]  Toru Katagiri,et al.  Wavelength defragmentation for seamless service migration , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[16]  Mohit Chamania,et al.  Artificial Intelligence (AI) Methods in Optical Networks: A Comprehensive Survey , 2018, Opt. Switch. Netw..

[17]  Víctor López,et al.  Elastic Spectrum Allocation for Time-Varying Traffic in FlexGrid Optical Networks , 2013, IEEE Journal on Selected Areas in Communications.

[18]  Eiji Oki,et al.  Route partitioning scheme for elastic optical networks with hitless defragmentation , 2016, IEEE/OSA Journal of Optical Communications and Networking.

[19]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[20]  Chunming Qiao,et al.  Spectrum allocation in spectrum-sliced elastic optical path networks using traffic prediction , 2015, Photonic Network Communications.

[21]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[22]  Admela Jukan,et al.  Efficient spectrum defragmentation with holding-time awareness in elastic optical networks , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[23]  Zhi-Li Zhang,et al.  A first look at inter-data center traffic characteristics via Yahoo! datasets , 2011, 2011 Proceedings IEEE INFOCOM.

[24]  Admela Jukan,et al.  Analytical performance modeling of spectrum defragmentation in elastic optical link networks , 2017, Opt. Switch. Netw..

[25]  Admela Jukan,et al.  Holding-time information (HTI): When to use it? , 2017, 2017 Optical Fiber Communications Conference and Exhibition (OFC).

[26]  Yuefeng Ji,et al.  Experimental demonstration of time-aware software defined networking for OpenFlow-based intra-datacenter optical interconnection networks , 2014 .

[27]  Lei Guo,et al.  Time-dependent load-balancing service degradation in optical data center networks , 2017, Photonic Network Communications.