A Hybrid Neuro-Wavelet Predictor for QoS Control and Stability

For distributed systems to properly react to peaks of requests, their adaptation activities would benefit from the estimation of the amount of requests. This paper proposes a solution to produce a short-term forecast based on data characterising user behaviour of online services. We use wavelet analysis, providing compression and denoising on the observed time series of the amount of past user requests; and a recurrent neural network trained with observed data and designed so as to provide well-timed estimations of future requests. The said ensemble has the ability to predict the amount of future user requests with a root mean squared error below 0.06%. Thanks to prediction, advance resource provision can be performed for the duration of a request peak and for just the right amount of resources, hence avoiding over-provisioning and associated costs. Moreover, reliable provision lets users enjoy a level of availability of services unaffected by load variations.

[1]  Les E. Atlas,et al.  Recurrent neural networks and robust time series prediction , 1994, IEEE Trans. Neural Networks.

[2]  Wim Sweldens,et al.  The lifting scheme: a construction of second generation wavelets , 1998 .

[3]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[4]  Stphane Mallat,et al.  A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way , 2008 .

[5]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[6]  G. Capizzi,et al.  Optimal management of various renewable energy sources by a new forecasting method , 2012, International Symposium on Power Electronics Power Electronics, Electrical Drives, Automation and Motion.

[7]  Mir Ali Seyyedi,et al.  Qos monitoring for web services by Time Series Forecasting , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[8]  Chung G. Kang,et al.  Implicit scheduling algorithm for dynamic slot assignment in wireless ATM networks , 1998 .

[9]  Giuseppe Pappalardo,et al.  Supporting resource reservation and allocation for unaware applications in Grid systems , 2006, Concurr. Comput. Pract. Exp..

[10]  Moisés Goldszmidt,et al.  Short term performance forecasting in enterprise systems , 2005, KDD '05.

[11]  Giacomo Capizzi,et al.  An hybrid neuro-wavelet approach for long-term prediction of solar wind , 2010, Proceedings of the International Astronomical Union.

[12]  Giuseppe Pappalardo,et al.  Supporting resource reservation and allocation for unaware applications in Grid systems: Research Articles , 2006 .

[13]  Madan M. Gupta,et al.  Static and Dynamic Neural Networks: From Fundamentals to Advanced Theory , 2003 .

[14]  Giuseppe Pappalardo,et al.  Tackling consistency issues for runtime updating distributed systems , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[15]  F Bonanno,et al.  A wavelet based prediction of wind and solar energy for Long-Term simulation of integrated generation systems , 2010, SPEEDAM 2010.

[16]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[17]  Michael D. Smith,et al.  Using Path Profiles to Predict HTTP Requests , 1998, Comput. Networks.

[18]  Kevin Lee,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012, Future Gener. Comput. Syst..

[19]  K. Shin,et al.  Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach , 2002, IEEE Trans. Parallel Distributed Syst..

[20]  Yanghee Choi,et al.  Bandwidth adaption algorithms with multi-objectives for adaptive multimedia services in wireless/mobile networks , 1999, WOWMOM '99.

[21]  M. Schwartz,et al.  Reservation strategies for multi-media traffic in a wireless environment , 1995, 1995 IEEE 45th Vehicular Technology Conference. Countdown to the Wireless Twenty-First Century.

[22]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[23]  Ibrahim W. Habib,et al.  Adaptive allocation of resources and call admission control for wireless ATM using genetic algorithms , 2000, IEEE Journal on Selected Areas in Communications.

[24]  A. E. Vries,et al.  Separation of 14C16O and 12C18O by thermal diffusion , 1956 .

[25]  Peter A. Dinda,et al.  Host load prediction using linear models , 2000, Cluster Computing.

[26]  Giacomo Capizzi,et al.  An Innovative Hybrid Neuro-wavelet Method for Reconstruction of Missing Data in Astronomical Photometric Surveys , 2012, ICAISC.

[27]  Giuseppe Pappalardo,et al.  Providing QoS strategies and cloud‐integration to web servers by means of aspects , 2015, Concurr. Comput. Pract. Exp..

[28]  Ronald J. Williams,et al.  Experimental Analysis of the Real-time Recurrent Learning Algorithm , 1989 .

[29]  Alan S. Lapedes,et al.  A self-optimizing, nonsymmetrical neural net for content addressable memory and pattern recognition , 1986 .

[30]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[31]  Chang Wook Ahn,et al.  QoS provisioning dynamic connection-admission control for multimedia wireless networks using a Hopfield neural network , 2004, IEEE Transactions on Vehicular Technology.

[32]  Giuseppe Pappalardo,et al.  Kaqudai: A Dependable Web Infrastructure Made Out of Existing Components , 2013, 2013 Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[33]  Corrado Santoro,et al.  A grid-based infrastructure to support multimedia content distribution , 2007, UPGRADE '07.

[34]  Giacomo Capizzi,et al.  Innovative Second-Generation Wavelets Construction With Recurrent Neural Networks for Solar Radiation Forecasting , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[35]  C. K. Yuen,et al.  Theory and Application of Digital Signal Processing , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[36]  Giacomo Capizzi,et al.  Exploiting solar wind time series correlation with magnetospheric response by using an hybrid neuro-wavelet approach , 2010, Proceedings of the International Astronomical Union.

[37]  Wim Sweldens,et al.  Lifting scheme: a new philosophy in biorthogonal wavelet constructions , 1995, Optics + Photonics.