Supporting e-Science Applications through the On-Demand Execution of Opportunistic and Customizable Virtual Clusters

of a virtual opportunistic grid infrastructure that allows taking advantage of the idle processing capabilities currently available in the computer labs of a university campus, ensuring local users to have priority in accessing the computational resources, while simultaneously, a virtual cluster takes the resources unused by them. A virtualization strategy is proposed to allow the deployment of opportunistic virtual clusters which integration provides a scalable grid solution capable of supplying the high performance computing (HPC) needs required for the development of e-Science projects. The proposed solution was implemented and tested through the execution of opportunistic virtual clusters with customized application environments for projects of different scientific disciplines, evidencing high efficiency in result generation.

[1]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[2]  Francisco Brasileiro,et al.  Grid Computing for Bag of Tasks Applications , 2003 .

[3]  Mario Villamizar,et al.  Mesoscale Modeling of the Bacillus Thuringiensis Sporulation Network Based on Stochastic Kinetics and Its Application for in Silico Scale-Down , 2009, 2009 International Workshop on High Performance Computational Systems Biology.

[4]  Mohammad Hossein Ahmadi,et al.  Distributed resource scheduling in grid computing using fuzzy approach , 2007 .

[5]  Franck Cappello,et al.  Grid'5000: a large scale and highly reconfigurable grid experimental testbed , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[6]  Gilles Fedak,et al.  The Computational and Storage Potential of Volunteer Computing , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[7]  Marco Cristancho,et al.  Computational Biology in Colombia , 2009, PLoS Comput. Biol..

[8]  Nazareno Andrade,et al.  Automatic grid assembly by promoting collaboration in peer-to-peer grids , 2007, J. Parallel Distributed Comput..

[9]  A. J. Yuste,et al.  A balanced scheduler for grid computing , 2008 .

[10]  Andres Bernal,et al.  pALS: An object-oriented framework for developing parallel cooperative metaheuristics , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[11]  David Finkel,et al.  Characterizing resource availability for volunteer computing and its impact on task distribution methods , 2007, ICSE 2007.

[12]  Francisco José da Silva e Silva,et al.  Migration transparency in a mobile agent based computational grid , 2005 .

[13]  Satoshi Matsuoka,et al.  Model-based Resource Selection for Efficient Virtual Cluster Deployment , 2007, Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing (VTDC '07).

[14]  John F. Shoch,et al.  The “worm” programs—early experience with a distributed computation , 1982, CACM.

[15]  Kirk L. Kroeker,et al.  The evolution of virtualization , 2009, CACM.

[16]  Ian T. Foster,et al.  Condor-G: A Computation Management Agent for Multi-Institutional Grids , 2004, Cluster Computing.

[17]  Santosh K. Shrivastava,et al.  A System for Fault-Tolerance Execution of Data and Compute Intensive Programs over a Network of Workstations , 1996, Euro-Par, Vol. I.

[18]  Dana Petcu,et al.  Distributed Jess on a Condor pool , 2005 .

[19]  David P. Anderson,et al.  BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[20]  David Abramson,et al.  A Computational Economy for Grid Computing and its Implementation in the Nimrod-G Resource Brok , 2001, Future Gener. Comput. Syst..

[21]  Arthur W Toga,et al.  The LONI Pipeline Processing Environment , 2003, NeuroImage.

[22]  Fabio Kon,et al.  InteGrade: object‐oriented Grid middleware leveraging the idle computing power of desktop machines , 2004, Concurr. Pract. Exp..

[23]  John Paul Walters,et al.  A Comparison of Virtualization Technologies for HPC , 2008, 22nd International Conference on Advanced Information Networking and Applications (aina 2008).

[24]  Harold Castro,et al.  JG2A: A Grid-enabled object-oriented framework for developing genetic algorithms , 2009, 2009 Systems and Information Engineering Design Symposium.

[25]  Arthur W. Toga,et al.  Effi cient , distributed and interactive neuroimaging data analysis using the LONI Pipeline , 2009 .

[26]  Alejandro Rojas,et al.  Characterization of Phytophthora infestans populations in Colombia: first report of the A2 mating type. , 2009, Phytopathology.

[27]  Richard Wolski,et al.  Analyzing Market-Based Resource Allocation Strategies for the Computational Grid , 2001, Int. J. High Perform. Comput. Appl..

[28]  Borja Sotomayor,et al.  Virtual Clusters for Grid Communities , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).