Kalman Filtering-based Traffic Prediction for Software Defined Intra-data Center Networks

Global data center IP traffic is expected to reach 20.6 zettabytes (ZB) by the end of 2021. Intra-data center networks (Intra-DCN) will account for 71.5% of the data center traffic flow and will be the largest portion of the traffic. The understanding of traffic distribution in Intra-DCN is still sketchy. It causes significant amount of bandwidth to go unutilized, and creates avoidable choke points. Conventional transport protocols such as Optical Packet Switching (OPS) and Optical Burst Switching (OBS) allow a one-sided view of the traffic flow in the network. This therefore causes disjointed and uncoordinated decision-making at each node. For effective resource planning, there is the need to consider joining the distributed with centralized management which anticipates the system’s needs and regulates the entire network. Methods derived from Kalman filters have proved effective in planning road networks. Considering the network available bandwidth as data transport highways, we propose an intelligent enhanced SDN concept applied to OBS architecture. A management plane (MP) is added to conventional control (CP) and data planes (DP). The MP assembles the traffic spatio-temporal parameters from ingress nodes, uses Kalman filtering prediction-based algorithm to estimate traffic demand. Prior to packets arrival at edges nodes, it regularly forwards updates of resources allocation to CPs. Simulations were done on a hybrid scheme (1+1) and on the centralized OBS. The results demonstrated that the proposition decreases the packet loss ratio. It also improves network latency and throughput—up to 84 and 51%, respectively, versus the traditional scheme.

[1]  Wei Zhang,et al.  Spectrum Sharing for Drone Networks , 2017, IEEE Journal on Selected Areas in Communications.

[2]  Nicholas Bambos,et al.  Scheduling bursts in time-domain wavelength interleaved networks , 2003, IEEE J. Sel. Areas Commun..

[3]  Jan H. van Schuppen,et al.  Prediction of Traffic Flow at the Boundary of a Motorway Network , 2014, IEEE Transactions on Intelligent Transportation Systems.

[4]  Houman Rastegarfar,et al.  Scheduling and control in hybrid data centers , 2017, 2017 IEEE Photonics Society Summer Topical Meeting Series (SUM).

[5]  Iraj Saniee,et al.  A new perspective on burst-switched optical networks , 2013, Bell Labs Technical Journal.

[6]  Ming Zhang,et al.  The Case for Fine-Grained Traffic Engineering in Data Centers , 2010, INM/WREN.

[7]  Chunming Qiao,et al.  Optical burst switching: a new area in optical networking research , 2004, IEEE Network.

[8]  Ioannis Tomkos,et al.  Optical interconnection networks in data centers: recent trends and future challenges , 2013, IEEE Communications Magazine.

[9]  E. J. Lefferts,et al.  Kalman Filtering for Spacecraft Attitude Estimation , 1982 .

[10]  Steven Hand,et al.  Self-adaptive and self-configured CPU resource provisioning for virtualized servers using Kalman filters , 2009, ICAC '09.

[11]  Hong Liu,et al.  Predicting Inter-Data-Center Network Traffic Using Elephant Flow and Sublink Information , 2016, IEEE Transactions on Network and Service Management.

[12]  Q. Zhang,et al.  Optical packet and burst switched networks: a review , 2009, IET Commun..

[13]  Yijun Xiong,et al.  Control architecture in optical burst-switched WDM networks , 2000, IEEE Journal on Selected Areas in Communications.

[14]  Darko Zibar,et al.  Machine Learning Techniques in Optical Communication , 2015, Journal of Lightwave Technology.

[15]  Jinho Choi,et al.  Low-Complexity Multiuser Detection in Millimeter-Wave Systems Based on Opportunistic Hybrid Beamforming , 2018, IEEE Transactions on Vehicular Technology.

[16]  Xiaoyuan Cao,et al.  TWIN as a future-proof optical transport technology for next generation metro networks , 2016, 2016 IEEE 17th International Conference on High Performance Switching and Routing (HPSR).

[17]  Zhiping Zhou,et al.  The Wuhan National Laboratory for Optoelectronics , 2007, 2007 International Nano-Optoelectronics Workshop.

[18]  Lawrence Kreeger,et al.  Virtual eXtensible Local Area Network (VXLAN): A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks , 2014, RFC.

[19]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[20]  Madeleine Glick,et al.  TCP flow classification and bandwidth aggregation in optically interconnected data center networks , 2016, IEEE/OSA Journal of Optical Communications and Networking.

[21]  Erik Elmroth,et al.  Location-aware load prediction in Edge Data Centers , 2017, 2017 Second International Conference on Fog and Mobile Edge Computing (FMEC).

[22]  Weiming Zhang,et al.  Interactive Temporal Recurrent Convolution Network for Traffic Prediction in Data Centers , 2018, IEEE Access.

[23]  Edward Y. Chang,et al.  Adaptive stream resource management using Kalman Filters , 2004, SIGMOD '04.

[24]  Mohit Chamania,et al.  Artificial Intelligence (AI) Methods in Optical Networks: A Comprehensive Survey , 2018, Opt. Switch. Netw..

[25]  Yufei Yuan,et al.  Efficient Traffic State Estimation and Prediction Based on the Ensemble Kalman Filter with a Fast Implementation and Localized Deterministic Scheme , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[26]  Jonathan S. Turner,et al.  Terabit burst switching , 1999, J. High Speed Networks.

[27]  Yijun Xiong,et al.  Design and analysis of optical burst-switched networks , 1999, Optics East.

[28]  QiaoChunming,et al.  Optical burst switching (OBS) - a new paradigm for an optical Internet , 1999 .

[29]  Guanrong Chen,et al.  Kalman Filtering with Real-time Applications , 1987 .

[30]  Dimitra Simeonidou,et al.  The application of optical packet switching in future communication networks , 2001, IEEE Commun. Mag..

[31]  Guido Maier,et al.  Matheuristic with machine-learning-based prediction for software-defined mobile metro-core networks , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[32]  Zeeshan Hameed Mir,et al.  An adaptive Kalman filter based traffic prediction algorithm for urban road network , 2016, 2016 12th International Conference on Innovations in Information Technology (IIT).

[33]  Rami G. Melhem,et al.  On the Feasibility of Optical Circuit Switching for High Performance Computing Systems , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[34]  Gordon Bell,et al.  Beyond the Data Deluge , 2009, Science.

[35]  Indra Widjaja Performance analysis of burst admission-control protocols , 1995 .

[36]  M. Medard,et al.  Design and Analysis of Optical Flow-Switched Networks , 2009, IEEE/OSA Journal of Optical Communications and Networking.

[37]  Chunming Qiao,et al.  Just-Enough-Time (JET): a high speed protocol for bursty traffic in optical networks , 1997, 1997 Digest of the IEEE/LEOS Summer Topical Meeting: Vertical-Cavity Lasers/Technologies for a Global Information Infrastructure/WDM Components Technology/Advanced Semiconductor Lasers and Application.

[38]  J.Y. Wei,et al.  Just-in-time signaling for WDM optical burst switching networks , 2000, Journal of Lightwave Technology.

[39]  Philip Nan Ji Hybrid Optical-Electrical Data Center Networks , 2016 .

[40]  Tram Truong Huu,et al.  Dynamic Flow Scheduling With Uncertain Flow Duration in Optical Data Centers , 2017, IEEE Access.

[41]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[42]  Chunming Qiao,et al.  Efficient burst scheduling algorithms in optical burst-switched networks using geometric techniques , 2004, IEEE Journal on Selected Areas in Communications.

[43]  Ming Zhang,et al.  Understanding data center traffic characteristics , 2010, CCRV.