AUGURY: A Time Series Based Application for the Analysis and Forecasting of System and Network Performance Metrics

This paper presents AUGURY, an application for the analysis of monitoring data from computers, servers or cloud infrastructures. The analysis is based on the extraction of patterns and trends from historical data, using elements of time-series analysis. The purpose of AUGURY is to aid a server administrator by forecasting the behaviour and resource usage of specific applications and in presenting a status report in a concise manner. AUGURY provides tools for identifying network traffic congestion and peak usage times, and for making memory usage projections. The application data processing specialises in two tasks: the parametrisation of the memory usage of individual applications and the extraction of the seasonal component from network traffic data. AUGURY uses a different underlying assumption for each of these two tasks. With respect to the memory usage, a limited number of single-valued parameters are assumed to be sufficient to parameterize any application being hosted on the server. Regarding the network traffic data, long-term patterns, such as hourly or daily exist and are being induced by work-time schedules and automatised administrative jobs. In this paper, the implementation of each of the two tasks is presented, tested using locally-generated data, and applied to data from weather forecasting applications hosted on a web server. This data is used to demonstrate the insight that AUGURY can add to the monitoring of server and cloud infrastructures.

[1]  R. K. Agrawal,et al.  An Introductory Study on Time Series Modeling and Forecasting , 2013, ArXiv.

[2]  Pedro Sousa,et al.  Multi‐scale Internet traffic forecasting using neural networks and time series methods , 2010, Expert Syst. J. Knowl. Eng..

[3]  Chonggun Kim,et al.  A Prediction Method of Network Traffic Using Time Series Models , 2006, ICCSA.

[4]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[5]  Irma J. Terpenning,et al.  STL : A Seasonal-Trend Decomposition Procedure Based on Loess , 1990 .

[6]  C. Chatfield,et al.  Fourier Analysis of Time Series: An Introduction , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Renate Sitte,et al.  Analysis of the predictive ability of time delay neural networks applied to the S&P 500 time series , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[8]  M. A. Wincek.  Applied Statistical Time Series Analysis , 1990 .

[9]  Michael T. Krieger,et al.  PvD: A Lightweight Distributed Monitoring Architecture for Cloud Infrastructures , 2015, 2015 IEEE Fourth Symposium on Network Cloud Computing and Applications (NCCA).

[10]  Alex Sim,et al.  Estimating and Forecasting Network Traffic Performance Based on Statistical Patterns Observed in SNMP Data , 2013, MLDM.

[11]  Julius Shiskin,et al.  The X-11 variant of the census method II seasonal adjustment program , 1965 .

[12]  Sophia Daskalaki,et al.  Combining Time Series Forecasting Methods for Internet Traffic , 2015 .

[13]  Manish Joshi,et al.  A Review of Network Traffic Analysis and Prediction Techniques , 2015, ArXiv.

[14]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[15]  Stephen G. Hall,et al.  ARIMA Models and the Box-Jenkins Methodology , 2016 .

[16]  W. Fuller,et al.  Distribution of the Estimators for Autoregressive Time Series with a Unit Root , 1979 .