Adjusted fair scheduling and non-linear workload prediction for QoS guarantees in grid computing

In this paper, we propose an efficient non-linear task workload prediction mechanism incorporated with a fair scheduling algorithm for task allocation and resource management in Grid computing. Workload prediction is accomplished in a Grid middleware approach using a non-linear model expressed as a series of finite known functional components using concepts of functional analysis. The coefficient of functional components are obtained using a training set of appropriate samples, the pairs of which are estimated based on a runtime estimation model relied on a least squares approximation scheme. The advantages of the proposed non-linear task workload prediction scheme is that (i) it is not constrained by analysis of source code (analytical methods), which is practically impossible to be implemented in complicated real-life applications or (ii) it does not exploit the variations of the workload statistics as the statistical approaches does. The predicted task workload is then exploited by a novel scheduling algorithm, enabling a fair Quality of Service oriented resource management so that some tasks are not favored against others. The algorithm is based on estimating the adjusted fair completion times of the tasks for task order selection and on an earliest completion time strategy for the grid resource assignment. Experimental results and comparisons with traditional scheduling approaches as implemented in the framework of European Union funded research projects GRIA and GRIDLAB grid infrastructures have revealed the outperformance of the proposed method.

[1]  Arif Ghafoor,et al.  PAWS: a performance evaluation tool for parallel computing systems , 1991, Computer.

[2]  John Shalf,et al.  Enabling Applications on the Grid: A Gridlab Overview , 2003, Int. J. High Perform. Comput. Appl..

[3]  Alan Watt,et al.  Advanced animation and rendering techniques - theory and practice , 1992 .

[4]  Jon B. Weissman,et al.  A genetic algorithm based approach for scheduling decomposable data grid applications , 2004, International Conference on Parallel Processing, 2004. ICPP 2004..

[5]  David A. Patterson,et al.  Computer Architecture - A Quantitative Approach, 5th Edition , 1996 .

[6]  Keqin Li,et al.  Experimental performance evaluation of job scheduling and processor allocation algorithms for grid computing on metacomputers , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[7]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[8]  Abhay Parekh,et al.  A generalized processor sharing approach to flow control in integrated services networks: the single-node case , 1993, TNET.

[9]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[10]  Miron Livny,et al.  Condor and the Grid , 2003 .

[11]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[12]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[13]  Francine Berman,et al.  Grid Computing: Making the Global Infrastructure a Reality , 2003 .

[14]  Robert Cole,et al.  Computer Communications , 1982, Springer New York.

[15]  David A. Patterson,et al.  Computer Architecture: A Quantitative Approach , 1969 .

[16]  Subhash Saini,et al.  Local grid scheduling techniques using performance prediction , 2003 .

[17]  Francine Berman,et al.  The GrADS Project: Software Support for High-Level Grid Application Development , 2001, Int. J. High Perform. Comput. Appl..

[18]  Lee C. Potter,et al.  Statistical prediction of task execution times through analytic benchmarking for scheduling in a heterogeneous environment , 1999, Proceedings. Eighth Heterogeneous Computing Workshop (HCW'99).

[19]  Jennifer M. Schopf,et al.  Ten Actions When Grid Scheduling , 2004 .

[20]  Konstantinos Dolkas,et al.  A combined fuzzy-neural network model for non-linear prediction of 3-D rendering workload in Grid computing , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Kaizar Amin,et al.  Analysis and Provision of QoS for Distributed Grid Applications , 2004, Journal of Grid Computing.

[22]  David Haussler,et al.  What Size Net Gives Valid Generalization? , 1989, Neural Computation.

[23]  Arif Ghafoor,et al.  Estimating execution time for parallel tasks in heterogeneous processing (HP) environment , 1994, Proceedings Heterogeneous Computing Workshop.

[24]  Desmond P. Taylor,et al.  A Generalized Processor Sharing Approach to Flow Control in Integrated Services Networks: The SingleNode Case , 2007 .

[25]  Alan Watt,et al.  Advanced animation and rendering techniques , 1992 .

[26]  E. Kreyszig Introductory Functional Analysis With Applications , 1978 .

[27]  Arutyun Avetisyan,et al.  Comparison of scheduling heuristics for grid resource broker , 2004, Proceedings of the Fifth Mexican International Conference in Computer Science, 2004. ENC 2004..

[28]  Vipin Kumar,et al.  Information power grid: The new frontier in parallel computing? , 1999, IEEE Concurr..

[29]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[30]  Jarek Nabrzyski,et al.  Grid resource management: state of the art and future trends , 2004 .

[31]  Thomas R. Gross,et al.  Global address space, non-uniform bandwidth: a memory system performance characterization of parallel systems , 1997, Proceedings Third International Symposium on High-Performance Computer Architecture.

[32]  Daniel A. Reed,et al.  Performance Contracts: Predicting and Monitoring Grid Application Behavior , 2001, GRID.

[33]  Peter A. Dinda Online prediction of the running time of tasks , 2001, SIGMETRICS '01.

[34]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[35]  Omri Serlin,et al.  Multiprogramming for hybrid computation , 1899, AFIPS '67 (Fall).

[36]  Scott Shenker,et al.  Analysis and simulation of a fair queueing algorithm , 1989, SIGCOMM 1989.