PIVOT: An adaptive information discovery framework for computational grids

In a traditional computational grid environment, the owners of resources usually provide information about their resources extracted by pre-configured information services or web services. However, such information is not sufficient for the scheduler in the high-performance distributed computing. To solve this problem, we propose a scalable grid information service framework, named PIVOT (adaPtive Information discoVery framewOrk for compuTational grid). By using deadline-constrained flooding collector dissemination and P2P-like information collection schemes, PIVOT provides an active mechanism to collect application-specific resource information. In particular, PIVOT provides a resource information service for application-specific schedulers. The best-effort performance on overhead traffic and communication latency during information discovery is guaranteed by two new distributed cooperative algorithms. The experimental results in the simulations and real computational grid platform demonstrate that PIVOT has a high level of adaptability for application-specific resource information discovery, and also improves the accuracy of resource allocation and the efficiency of executing parallel tasks in traditional information services.

[1]  Werner Nutt,et al.  R-GMA: An Information Integration System for Grid Monitoring , 2003, OTM.

[2]  Wolfgang Gentzsch,et al.  Sun Grid Engine: towards creating a compute power grid , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[3]  Harvey B. Newman,et al.  High speed data gathering, distribution and analysis for physics discoveries at the large Hadron collider , 2006, SC.

[4]  Venky Krishnan,et al.  Carmen: A Dynamic Service Discovery Architecture , 2002 .

[5]  Xingshe Zhou,et al.  ADEM: Automating deployment and management of application software on the Open Science Grid , 2009, 2009 10th IEEE/ACM International Conference on Grid Computing.

[6]  Ian T. Foster,et al.  Condor-G: A Computation Management Agent for Multi-Institutional Grids , 2004, Cluster Computing.

[7]  Yao Zheng,et al.  MASSIVE: a multidisciplinary applications-oriented simulation and visualization environment , 2004, IEEE International Conference onServices Computing, 2004. (SCC 2004). Proceedings. 2004.

[8]  David Abramson,et al.  The PRAGMA Testbed - Building a Multi-Application International Grid , 2006 .

[9]  Domenico Talia,et al.  Web Services for Peer-to-Peer Resource Discovery on the Grid , 2004, DELOS.

[10]  Serena Pastore,et al.  The service discovery methods issue: A web services UDDI specification framework integrated in a grid environment , 2008, J. Netw. Comput. Appl..

[11]  Mathilde Romberg,et al.  The UNICORE Grid infrastructure , 2002, Sci. Program..

[12]  R. Clough,et al.  Dynamics Of Structures , 1975 .

[13]  Nigel P. Weatherill,et al.  GECEM: Grid-Enabled Computational Electromagnetics , 2003 .

[14]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[15]  Ibrahim Matta,et al.  BRITE: an approach to universal topology generation , 2001, MASCOTS 2001, Proceedings Ninth International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[16]  Maria Ganzha,et al.  Combining information from multiple search engines - Preliminary comparison , 2010, Inf. Sci..

[17]  Anders Wäänänen,et al.  Data management services of NorduGrid , 2005 .

[18]  David W. Walker,et al.  GECEM: A portal-based Grid application for computational electromagnetics , 2008, Future Gener. Comput. Syst..

[19]  Yunhao Liu,et al.  RCT: A distributed tree for supporting efficient range and multi-attribute queries in grid computing , 2008, Future Gener. Comput. Syst..

[20]  Nancy Wilkins-Diehr,et al.  TeraGrid's integrated information service , 2009, GCE '09.

[21]  Haiying Shen A P2P-based intelligent resource discovery mechanism in Internet-based distributed systems , 2009, J. Parallel Distributed Comput..

[22]  Yunhao Liu,et al.  ROST: Remote and hot service deployment with trustworthiness in CROWN Grid , 2007, Future Gener. Comput. Syst..

[23]  Satoshi Matsuoka,et al.  Design and Implementation of NAREGI SuperScheduler Based on the OGSA Architecture , 2006, Journal of Computer Science and Technology.

[24]  Fabrizio Silvestri,et al.  A Grid Information Service Based on Peer-to-Peer , 2005, Euro-Par.

[25]  Andrew S. Grimshaw,et al.  The Legion vision of a worldwide virtual computer , 1997, Commun. ACM.

[26]  David R. Karger,et al.  Chord: a scalable peer-to-peer lookup protocol for internet applications , 2003, TNET.

[27]  Wentong Cai,et al.  A secure information service for monitoring large scale grids , 2007, Parallel Comput..

[28]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[29]  George Eleftherakis,et al.  Evaluation of a selective distributed discovery strategy in a fully decentralized biologically inspired environment , 2010, Inf. Sci..

[30]  Guanghua Song,et al.  A Deadline and Budget Constrained Cost-Time Optimization Algorithm for Scheduling Dependent Tasks in Grid Computing , 2003, GCC.

[31]  Georgios Paltoglou,et al.  Collection-integral source selection for uncooperative distributed information retrieval environments , 2010, Inf. Sci..

[32]  Fabrizio Gagliardi,et al.  Building an infrastructure for scientific Grid computing: status and goals of the EGEE project , 2005, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[33]  Salvatore Orlando,et al.  Peer-to-peer systems for discovering resources in a dynamic grid , 2007, Parallel Comput..

[34]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[35]  Ellen W. Zegura,et al.  A quantitative comparison of graph-based models for Internet topology , 1997, TNET.

[36]  Kai Hwang,et al.  Distributed Aggregation Algorithms with Load-Balancing for Scalable Grid Resource Monitoring , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.