MJSA: Markov job scheduler based on availability in desktop grid computing environment

In a desktop grid computing environment, voluntary desktops (i.e., resource providers) are free to leave and join independently in the middle of execution. To develop a reliable desktop grid computing system, a scheduling scheme must consider the dynamic nature (i.e., volatility) of volunteers. Existing desktop grid computing systems, however, do not consider volatility in their scheduling procedures. As a result, job execution is often suspended, resulting in delayed completion time and degraded performance and reliability. To solve these limitations, we propose the Markov Job Scheduler based on Availability (MJSA) supporting three advanced scheduling schemes: OPTIMIST, PESSIMIST, and REALIST. These scheduling schemes are based on stochastic modeling of desktop availability. In the OPTIMIST scheme, in which time constraints are relaxed, the MJSA provides reliable resource selection at low cost. In the PESSIMIST scheme, where time constraints are rigid, the MJSA enables stable makespan in strictly time. Finally, in the REALIST scheme, where time constraints are only partially relaxed, the MJSA provides enhanced cost efficiency. In conclusion, the MJSA improves performance and reliability by adapting the appropriate scheduling scheme when selecting volunteers according to the needs of applications.

[1]  Jacky C. Chu,et al.  Availability and locality measurements of peer-to-peer file systems , 2002, SPIE ITCom.

[2]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[3]  A. L. Ananda,et al.  GUCHA: INTERNET-BASED PARALLEL COMPUTING USING JAVA , 2000 .

[4]  Gilles Fedak,et al.  XtremWeb: a generic global computing system , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[5]  J.M. Schopf,et al.  Stochastic Scheduling , 1999, ACM/IEEE SC 1999 Conference (SC'99).

[6]  Andrew A. Chien,et al.  Resource Management for Rapid Application Turnaround on Enterprise Desktop Grids , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[7]  Zvi M. Kedem,et al.  Charlotte: Metacomputing on the Web , 1999, Future Gener. Comput. Syst..

[8]  Satoshi Hirano,et al.  Bayanihan: building and studying web-based volunteer computing systems using Java , 1999, Future Gener. Comput. Syst..

[9]  Peter R. Cappello,et al.  Javelin: Parallel computing on the internet , 1999, Future Gener. Comput. Syst..

[10]  Peter R. Cappello,et al.  Advanced eager scheduling for Java‐based adaptive parallel computing , 2002, JGI '02.

[11]  Francine Berman,et al.  Grid Computing: Making the Global Infrastructure a Reality , 2003 .

[12]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[13]  Richard Wolski,et al.  Modeling Machine Availability in Enterprise and Wide-Area Distributed Computing Environments , 2005, Euro-Par.

[14]  Andrew A. Chien,et al.  Henri Casanova , 2022 .

[15]  Noam Nisan,et al.  The popcorn project: distributed computation over the internet in java , 1997 .

[16]  Chong-Sun Hwang,et al.  Scheduling Scheme based on Dedication Rate in Volunteer Computing Environment , 2005, The 4th International Symposium on Parallel and Distributed Computing (ISPDC'05).

[17]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[18]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[19]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[20]  John P. Morrison,et al.  WebCom: A Web Based Volunteer Computer , 2004, The Journal of Supercomputing.

[21]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[22]  Miron Livny,et al.  The Available Capacity of a Privately Owned Workstation Environmont , 1991, Perform. Evaluation.