Facing Network Management Challenges with Functional Data Analysis: Techniques & Opportunities

Current fixed and mobile networks’ behavior is rapidly changing, which calls for flexible monitoring approaches to avoid loosing track with such a fast evolutionary pace. Due to the many challenges that this scenario is posing to network managers, we propose the exploration of Functional Data Analysis (FDA) techniques as a mean to easily deal with network management and analysis issues. Specifically, we describe and evaluate several FDA methods with applications to network measurement preprocessing and clustering, bandwidth allocation, and anomaly and outlier detection. Our work focuses on how these FDA-based tools serve to improve the outcomes of traffic data mining and analysis, providing easy-to-understand and comprehensive outputs for network managers. We present the results that we have obtained from real case studies in the Spanish Academic network using throughput time series, comparing them with other alternatives of the state of the art. With this com- parative, we have qualitatively and quantitatively evaluated the advantages of FDA-methods in the networking area.

[1]  Manuel Febrero-Bande,et al.  Statistical Computing in Functional Data Analysis: The R Package fda.usc , 2012 .

[2]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[3]  Bhaskar Krishnamachari,et al.  Dynamic Base Station Switching-On/Off Strategies for Green Cellular Networks , 2013, IEEE Transactions on Wireless Communications.

[4]  Evangelos P. Markatos,et al.  Scap: stream-oriented network traffic capture and analysis for high-speed networks , 2013, Internet Measurement Conference.

[5]  Javier Aracil,et al.  Multi‐granular, multi‐purpose and multi‐Gb/s monitoring on off‐the‐shelf systems , 2014, Int. J. Netw. Manag..

[6]  M. Hubert,et al.  Multivariate Functional Halfspace Depth , 2012 .

[7]  Ricardo Fraiman,et al.  Robust estimation and classification for functional data via projection-based depth notions , 2007, Comput. Stat..

[8]  Albert B. Jeng,et al.  Android Malware Detection via a Latent Network Behavior Analysis , 2012, 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications.

[9]  Oscar Gonzalez de Dios,et al.  ABNO: a feasible SDN approach for multivendor IP and optical networks [Invited] , 2015, IEEE/OSA Journal of Optical Communications and Networking.

[10]  Konstantina Papagiannaki,et al.  Structural analysis of network traffic flows , 2004, SIGMETRICS '04/Performance '04.

[11]  Juan Romo,et al.  A half-region depth for functional data , 2011, Comput. Stat. Data Anal..

[12]  Javier Aracil,et al.  Characterization of the busy-hour traffic of IP networks based on their intrinsic features , 2011, Comput. Networks.

[13]  José Luis García-Dorado,et al.  Dictyogram: A statistical approach for the definition and visualization of network flow categories , 2015, 2015 11th International Conference on Network and Service Management (CNSM).

[14]  Aiko Pras,et al.  Linking network usage patterns to traffic Gaussianity fit , 2014, 2014 IFIP Networking Conference.

[15]  Lisandro Zambenedetti Granville,et al.  Data Center Network Virtualization: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[16]  A. Cuevas.  A partial overview of the theory of statistics with functional data , 2014 .

[17]  J. Romo,et al.  On the Concept of Depth for Functional Data , 2009 .

[18]  Aiko Pras,et al.  Measurement-based network link dimensioning , 2015, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[19]  Jorge E. López de Vergara,et al.  Functional Data Analysis: A step forward in Network Management , 2015, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[20]  Javier Aracil,et al.  A queueing equivalent thresholding method for thinning traffic captures , 2008, NOMS 2008 - 2008 IEEE Network Operations and Management Symposium.

[21]  R. Serfling,et al.  General notions of statistical depth function , 2000 .

[22]  Juan Romo,et al.  Shape outlier detection and visualization for functional data: the outliergram. , 2013, Biostatistics.

[23]  George Bebis,et al.  A survey of network flow applications , 2013, J. Netw. Comput. Appl..

[24]  Judith Kelner,et al.  Deep packet inspection tools and techniques in commodity platforms: Challenges and trends , 2012, J. Netw. Comput. Appl..

[25]  Jeffrey G. Andrews,et al.  What Will 5G Be? , 2014, IEEE Journal on Selected Areas in Communications.

[26]  Michael H. Lambert.  A Model for Common Operational Statistics , 1995, RFC.

[27]  M. Febrero,et al.  Outlier detection in functional data by depth measures, with application to identify abnormal NOx levels , 2008 .

[28]  Julien Jacques,et al.  Functional data clustering: a survey , 2013, Advances in Data Analysis and Classification.

[29]  Wenceslao González-Manteiga,et al.  Statistics for Functional Data , 2007, Comput. Stat. Data Anal..

[30]  Haiyang Wang,et al.  Lightweight and Informative Traffic Metrics for Data Center Monitoring , 2011, Journal of Network and Systems Management.

[31]  Saverio Niccolini,et al.  Stream-monitoring with blockmon: convergence of network measurements and data analytics platforms , 2013, CCRV.

[32]  David J. Parish,et al.  A Live System for Wavelet Compression of High Speed Computer Network Measurements , 2007, PAM.

[33]  Ali A. Ghorbani,et al.  Detecting P2P botnets through network behavior analysis and machine learning , 2011, 2011 Ninth Annual International Conference on Privacy, Security and Trust.

[34]  Federico Rotolo,et al.  parfm: Parametric Frailty Models in R , 2012 .

[35]  Yannis A. Dimitriadis,et al.  Anomaly Detection in Network Traffic Based on Statistical Inference and \alpha-Stable Modeling , 2011, IEEE Transactions on Dependable and Secure Computing.

[36]  J. P. Fernandez-Palacios,et al.  ABNO: A feasible SDN approach for multi-vendor IP and optical networks , 2014, OFC 2014.

[37]  Vaibhav Bajpai,et al.  A Survey on Internet Performance Measurement Platforms and Related Standardization Efforts , 2015, IEEE Communications Surveys & Tutorials.

[38]  P. Rousseeuw,et al.  Displaying a clustering with CLUSPLOT , 1999 .

[39]  Spencer Graves,et al.  Functional Data Analysis with R and MATLAB , 2009 .

[40]  Wei Li,et al.  Self-Organizing Scheme Based on NFV and SDN Architecture for Future Heterogeneous Networks , 2015, Mob. Networks Appl..

[41]  Mia Hubert,et al.  Multivariate and functional classification using depth and distance , 2017, Adv. Data Anal. Classif..

[42]  Javier Aracil,et al.  Detection of traffic changes in large-scale backbone networks: The case of the Spanish academic network , 2012, Comput. Networks.

[43]  Bruno Bogaz Zarpelão,et al.  Construction of baselines for VoIP traffic management on open MANs , 2013, Int. J. Netw. Manag..