Using NARX Neural Network Based Load Prediction to Improve Scheduling Decision in Grid Environments

In grid environment, applications are in active competition with unknown background workloads introduced by other users. To achieve good performance, performance models are used to predict the possible status of the resources, and to make decisions of the selection of a performance-efficient application execution strategy. In this paper, we present a scheduling decision method that utilizes the NARX neural network based load prediction to define data mappings appropriate for dynamic resources. This method uses the information of the predicted CPU load interval and variance of future resource capabilities to obtain the CPU load decision, which can be used to guide the scheduling decision. As to the predictor used here, the NARX neural network based predictor learns the model of the system from the external input information and the system itself. It inherits the mapping capability of feed forward networks and, at the same time, captures the dynamic features of load information. In this work, our predictor shows good performance for time series prediction.

[1]  Yao Liang,et al.  Real-Time VBR Video Traffic Prediction for Dynamic Bandwidth Allocation , 2004, IEEE Trans. Syst. Man Cybern. Part C.

[2]  Lingyun Yang,et al.  Conservative Scheduling: Using Predicted Variance to Improve Scheduling Decisions in Dynamic Environments , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[3]  J.M. Schopf,et al.  Stochastic Scheduling , 1999, ACM/IEEE SC 1999 Conference (SC'99).

[4]  Chuang Liu,et al.  Design and evaluation of a resource selection framework for Grid applications , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[5]  Peter A. Dinda,et al.  The statistical properties of host load , 1999, Sci. Program..

[6]  Les E. Atlas,et al.  Recurrent Networks and NARMA Modeling , 1991, NIPS.

[7]  Ming Wu,et al.  A neural network based predictive mechanism for available bandwidth , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[8]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[9]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[10]  Peter A. Dinda,et al.  A prediction-based real-time scheduling advisor , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[11]  Atsushi Hiramatsu Integration of ATM Call Admission Control and Link Capacity Control by Distributed Neural Networks , 1991, IEEE J. Sel. Areas Commun..

[12]  Stephen A. Billings,et al.  Non-linear system identification using neural networks , 1990 .

[13]  Rajkumar Buyya,et al.  Constructing A Grid Simulation with Differentiated Network Service Using GridSim , 2005, International Conference on Internet Computing.