Long-Term Traffic Scheduling Based on Stacked Bidirectional Recurrent Neural Networks in Inter-Datacenter Optical Networks

With the rapid evolution of high-speed mobile communications, cloud computing, and other high-bitrate datacenter-supported services, efficient and flexible traffic scheduling has become one of the fundamental tasks of inter-datacenter optical networks (IDCONs). Traffic scheduling algorithms based on long-term traffic prediction, which have intelligent and global resource allocation ability, have been proved to perform well in IDCONs. However, the low accuracy of existing long-term traffic prediction methods, which is caused by the accumulated errors produced in the recursive multi-step prediction process, directly restricts the efficiency of traffic scheduling. In this paper, we consider the problem of highly efficient traffic scheduling in IDCONs by leveraging one step long-term traffic prediction to reduce the prediction errors. We first design a multiple time interval feature-learning network (MTIFLN) to handle the challenging task of one step long-term traffic prediction. By integrating five bidirectional RNNs (B-RNNs) to one single framework, the MTIFLN has a strong ability to extract the long-term traffic features at different time intervals. Moreover, the stacked architecture of MTIFLN helps to reduce the prediction errors through multi-resampling process. A traffic prediction-based resource allocation (TP-RA) algorithm is proposed together with a global factor to evaluate the efficiency of traffic prediction and achieve effective traffic scheduling based on both traffic prediction results and network resource utilization. Simulation results indicate that with our proposal, the MTIFLN can accurately predict the traffic for more than 24 hours in one step, and the TP-RA algorithm enables IDCONs to make more efficient use of network resources.

[1]  Yi Lin,et al.  Cross Stratum Optimization Architecture for Optical as a Service , 2018 .

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Yinhai Wang,et al.  Deep Stacked Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction , 2017 .

[5]  Zuqing Zhu,et al.  When Deep Learning Meets Inter-Datacenter Optical Network Management: Advantages and Vulnerabilities , 2018, Journal of Lightwave Technology.

[6]  Jingbo Xia,et al.  Network traffic forecasting by support vector machines based on empirical mode decomposition denoising , 2012, 2012 2nd International Conference on Consumer Electronics, Communications and Networks (CECNet).

[7]  Abien Fred Agarap A Neural Network Architecture Combining Gated Recurrent Unit (GRU) and Support Vector Machine (SVM) for Intrusion Detection in Network Traffic Data , 2017, ICMLC.

[8]  Yao Li,et al.  Deep Neural Network Based Dynamic Resource Reallocation of BBU Pools in 5G C-RAN ROADM Networks , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[9]  Jie Zhang,et al.  Leveraging Deep Learning to Achieve Efficient Resource Allocation with Traffic Evaluation in Datacenter Optical Networks , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[10]  Thierry Blu,et al.  Linear interpolation revitalized , 2004, IEEE Transactions on Image Processing.

[11]  Hui Yang,et al.  Resource Assignment Based on Dynamic Fuzzy Clustering in Elastic Optical Networks With Multi-Core Fibers , 2019, IEEE Transactions on Communications.

[12]  Mohit Chamania,et al.  Artificial Intelligence (AI) Methods in Optical Networks: A Comprehensive Survey , 2018, Opt. Switch. Netw..

[13]  José Antonio Lozano,et al.  Sensitivity Analysis of k-Fold Cross Validation in Prediction Error Estimation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Yongli Zhao,et al.  Multi-stratum resources optimization for cloud-based radio over optical fiber networks , 2016, 2016 IEEE International Conference on Communications (ICC).

[15]  Guy Pujolle,et al.  A Long Short-Term Memory Recurrent Neural Network Framework for Network Traffic Matrix Prediction , 2017, ArXiv.

[16]  Marco Ruffini,et al.  An Overview on Application of Machine Learning Techniques in Optical Networks , 2018, IEEE Communications Surveys & Tutorials.

[17]  Jamil Salem Barbar,et al.  Computer network traffic prediction: a comparison between traditional and deep learning neural networks , 2015, Int. J. Big Data Intell..

[18]  Yonggang Wen,et al.  A Survey on Data Center Networking (DCN): Infrastructure and Operations , 2017, IEEE Communications Surveys & Tutorials.

[19]  Yongli Zhao,et al.  Performance evaluation of multi-stratum resources integrated resilience for software defined inter-data center interconnect. , 2015, Optics express.

[20]  Admela Jukan,et al.  Machine-learning-based prediction for resource (Re)allocation in optical data center networks , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[21]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[22]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Yuefeng Ji,et al.  C-RoFN: multi-stratum resources optimization for cloud-based radio over optical fiber networks , 2016, IEEE Communications Magazine.

[24]  Yi Lin,et al.  Bandwidth Compression Protection Against Collapse in Fog-Based Wireless and Optical Networks , 2018, IEEE Access.

[25]  Guido Maier,et al.  Deep Learning-Based Traffic Prediction for Network Optimization , 2018, 2018 20th International Conference on Transparent Optical Networks (ICTON).

[26]  Yuefeng Ji,et al.  Experimental demonstration of multi-dimensional resources integration for service provisioning in cloud radio over fiber network , 2016, Scientific Reports.

[27]  Chen Yunping,et al.  An ANN and wavelet transformation based method for short term load forecast , 1998, Proceedings of EMPD '98. 1998 International Conference on Energy Management and Power Delivery (Cat. No.98EX137).

[28]  Yi Lin,et al.  SUDOI: software defined networking for ubiquitous data center optical interconnection , 2016, IEEE Communications Magazine.

[29]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[30]  J. Rexford,et al.  Scalable Multi-Class Traffic Management in Data Center Backbone Networks , 2013, IEEE Journal on Selected Areas in Communications.

[31]  Razvan Pascanu,et al.  Theano: new features and speed improvements , 2012, ArXiv.