Comparing forecasting approaches for Internet traffic

Internet traffic is modeled using time series and neural network approaches.FARIMA and ANNs are combined in two different ways for better predictions.A framework for comparison of the different approaches is introduced.Forecasting with a model selected based on non-linearity test is a successful strategy.Alternatively, hybridization between MLP and FARIMA is found to be equally effective. In this paper, we experiment with several different forecasting approaches for Internet traffic and a scheme for their evaluation. First the existence of properties such as Short or Long Range Dependence and non-linearity is explored in order to take advantage of such information and offer a couple of alternatives as forecasting models. The proposed models include FARIMA with Normal and Student's t innovations and two different architectures of Artificial Neural Networks, the Multilayer Perceptron and Radial basis function. Next, we construct a model selection scheme based on the White's Neural Network test for non-linearity or alternatively combine FARIMA and Neural Networks into hybrid forecasting models. The comparison of all suggested approaches is performed using their average position and standard deviation of position when applied to several known datasets of Internet traffic and when the accuracy of forecasts is measured with three different measures. Based on such a data analysis it is shown that hybridization and the selection of a model according to a non-linearity test are more successful as forecasting approaches over all individual models, as well as over other well-known methods such as Holt-Winters, ARIMA/GARCH and FARIMA/GARCH. This result indicates that forecasting approaches which take non-linearity into account lead to better overall forecasts for Internet traffic.

[1]  Tadao Saito,et al.  ARIMA model's superiority over f-ARIMA model , 2000, WCC 2000 - ICCT 2000. 2000 International Conference on Communication Technology Proceedings (Cat. No.00EX420).

[2]  Fallaw Sowell Maximum likelihood estimation of stationary univariate fractionally integrated time series models , 1992 .

[3]  Kurt Hornik,et al.  Time Series Analysis and Computational Finance , 2015 .

[4]  V. Alarcon-Aquino,et al.  Multiresolution FIR neural-network-based learning algorithm applied to network traffic prediction , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  José Manuel Benítez,et al.  Neural Networks in R Using the Stuttgart Neural Network Simulator: RSNNS , 2012 .

[6]  J. Geweke,et al.  THE ESTIMATION AND APPLICATION OF LONG MEMORY TIME SERIES MODELS , 1983 .

[7]  Georg Dorffner,et al.  Neural Networks for Time Series Processing , 1996 .

[8]  H. E. Hurst,et al.  Long-Term Storage Capacity of Reservoirs , 1951 .

[9]  Ana González Marcos,et al.  AMORE: A MORE flexible neural network package , 2014 .

[10]  D. G. Wakde,et al.  On the prediction of packet process in network traffic using FARIMA time-series model , 2013 .

[11]  Friedhelm Schwenker,et al.  Three learning phases for radial-basis-function networks , 2001, Neural Networks.

[12]  Li-li Ma,et al.  RBF Network-Based Chaotic Time Series Prediction and It's Application in Foreign Exchange Market , 2007 .

[13]  J. R. M. Hosking,et al.  FRACTIONAL DIFFERENCING MODELING IN HYDROLOGY , 1985 .

[14]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[15]  G. Rutka,et al.  Some Aspects of Traffic Analysis used for Internet Traffic Prediction , 2009 .

[16]  B. Mandelbrot Statistical Methodology for Nonperiodic Cycles: From the Covariance To R/S Analysis , 1972 .

[17]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[18]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[19]  Walter Willinger,et al.  Long-range dependence in variable-bit-rate video traffic , 1995, IEEE Trans. Commun..

[20]  Bo Zhou,et al.  Network Traffic Modeling and Prediction with ARIMA / GARCH , 2005 .

[21]  J. Faraway,et al.  Time series forecasting with neural networks: a comparative study using the air line data , 2008 .

[22]  H. White,et al.  An additional hidden unit test for neglected nonlinearity in multilayer feedforward networks , 1989, International 1989 Joint Conference on Neural Networks.

[23]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[24]  Clive W. J. Granger,et al.  Testing for neglected nonlinearity in time series models: A comparison of neural network methods and alternative tests , 1993 .

[25]  F. Takens Detecting strange attractors in turbulence , 1981 .

[26]  Vassilios C. Moussas,et al.  NETWORK TRAFFIC MODELING AND PREDICTION USING MULTIPLICATIVE SEASONAL ARIMA MODELS , 2005 .

[27]  Pedro Sousa,et al.  Multi‐scale Internet traffic forecasting using neural networks and time series methods , 2010, Expert Syst. J. Knowl. Eng..

[28]  Wei Qiao,et al.  Short-term solar power prediction using an RBF neural network , 2011, 2011 IEEE Power and Energy Society General Meeting.

[29]  Erol Egrioglu,et al.  Improvement in Forecasting Accuracy Using the Hybrid Model of ARFIMA and Feed Forward Neural Network , 2012 .

[30]  Gowrishankar,et al.  A Time Series Modeling and Prediction of Wireless Network Traffic , 2009, Int. J. Interact. Mob. Technol..

[31]  Youjip Won,et al.  GOP ARIMA: Modeling the nonstationarity of VBR processes , 2005, Multimedia Systems.

[32]  G. Chiruvolu,et al.  An approach towards resource management and transportation of VBR video traffic , 1997, Proceedings of ICC'97 - International Conference on Communications.

[33]  Tae-Hwy Lee Neural Network Test and Nonparametric Kernel Test for Neglected Nonlinearity in Regression Models , 2000 .

[34]  Stefano Giordano,et al.  Analysis of f-ARIMA processes in the modelling of broadband traffic , 2001, ICC 2001. IEEE International Conference on Communications. Conference Record (Cat. No.01CH37240).

[35]  Martin Reisslein,et al.  MPEG-4 and H.263 video traces for network performance evaluation , 2001, IEEE Netw..

[36]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[37]  Oliver W. W. Yang,et al.  Traffic prediction using FARIMA models , 1999, 1999 IEEE International Conference on Communications (Cat. No. 99CH36311).

[38]  Edgar E. Peters Fractal Market Analysis: Applying Chaos Theory to Investment and Economics , 1994 .

[39]  Roland R. Draxler,et al.  Root mean square error (RMSE) or mean absolute error (MAE) , 2014 .

[40]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[41]  Maciej Szmit,et al.  Usage of RBF Networks in prediction of network traffic , 2013, FedCSIS.

[42]  Neil Davey,et al.  Traffic trends analysis using neural networks , 1997 .

[43]  Philip Hans Franses,et al.  Non-Linear Time Series Models in Empirical Finance , 2000 .

[44]  C. Granger,et al.  AN INTRODUCTION TO LONG‐MEMORY TIME SERIES MODELS AND FRACTIONAL DIFFERENCING , 1980 .

[45]  B. Mandelbrot,et al.  Fractional Brownian Motions, Fractional Noises and Applications , 1968 .

[46]  Chris Chatfield,et al.  Time series forecasting with neural networks , 1998, Neural Networks for Signal Processing VIII. Proceedings of the 1998 IEEE Signal Processing Society Workshop (Cat. No.98TH8378).

[47]  Neil Davey,et al.  Time Series Prediction and Neural Networks , 2001, J. Intell. Robotic Syst..

[48]  Mohamed Faten Zhani,et al.  Analysis and Prediction of Real Network Traffic , 2009, J. Networks.

[49]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[50]  H. Abarbanel,et al.  Local false nearest neighbors and dynamical dimensions from observed chaotic data. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[51]  Symeon Papavassiliou,et al.  Detecting Network Attacks in the Internet via Statistical Network Traffic Normality Prediction , 2004, Journal of Network and Systems Management.

[52]  A. N. Sharkovskiĭ Dynamic systems and turbulence , 1989 .

[53]  J. Keith Ord,et al.  Automatic neural network modeling for univariate time series , 2000 .

[54]  Cong Wang,et al.  An Internet Traffic Forecasting Model Adopting Radical Based on Function Neural Network Optimized by Genetic Algorithm , 2008, First International Workshop on Knowledge Discovery and Data Mining (WKDD 2008).

[55]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[56]  Paweł Dymora,et al.  Computer network traffic analysis with the use of statistical self-similarity factor , 2013 .

[57]  R. Mañé,et al.  On the dimension of the compact invariant sets of certain non-linear maps , 1981 .