Leveraging the Power of the Grid with Opal

Grid systems provide mechanisms for single sign-on, and uniform APIs for job submission and data transfer, in order to allow the coupling of distributed resources in a seamless manner. However, new users face a daunting barrier of entry due to the high cost of deployment and maintenance. They are often required to learn complex concepts relative to Grid infrastructures (credential management, scheduling systems, data staging, etc). To most scientific users, running their applications with minimal changes and yet getting results faster is highly desirable, without having to know much about how the resources are used. Hence, a higher level of abstraction must be provided for the underlying infrastructure to be used effectively. For this purpose, we have developed the Opal toolkit for exposing applications on Grid resources as simple Web services. Opal provides a basic set of Application Programming Interfaces (APIs) that allows users to execute their deployed applications, query job status, and retrieve results. Opal also provides a mechanism to define command-line arguments and automatically generates user interfaces for the Web services dynamically. In addition, Opal services can be hooked up to a Metascheduler such as CSF4 to leverage a distributed set of resources, and accessed via a multitude of interfaces such as Web browsers, rich desktop environments, workflow tools, and command-line clients. DOI: 10.4018/978-1-4666-0879-5.ch8.10

[1]  Jason Novotny,et al.  GridSphere: a portal framework for building collaborations , 2004, Concurr. Pract. Exp..

[2]  Na Helian,et al.  Personal Storage Grid Architecture: Consuming Cloud Data Space Resources , 2010, Int. J. Grid High Perform. Comput..

[3]  Karan Bhatia,et al.  SOAs for Scientific Applications: Experiences and Challenges , 2007, Third IEEE International Conference on e-Science and Grid Computing (e-Science 2007).

[4]  Tim O'Reilly,et al.  What is Web 2.0: Design Patterns and Business Models for the Next Generation of Software , 2007 .

[5]  Gerhard Klebe,et al.  PDB2PQR: expanding and upgrading automated preparation of biomolecular structures for molecular simulations , 2007, Nucleic Acids Res..

[6]  Catherine Letondal,et al.  A Web interface generator for molecular biology programs in Unix , 2001, Bioinform..

[7]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[8]  L. Smarr,et al.  Metacomputing : Siggraph'92 Showcase , 1992 .

[9]  Alexander Kolker Queuing Theory and Discrete Events Simulation for Health Care: From Basic Processes to Complex Systems with Interdependencies , 2010 .

[10]  Zoltán Horváth,et al.  Speculative Scheduling of Parameter Sweep Applications Using Job Behavior Descriptions , 2009, Int. J. Grid High Perform. Comput..

[11]  Ian T. Foster,et al.  Grid Services for Distributed System Integration , 2002, Computer.

[12]  D. Andreotti,et al.  Simulated Events Production on the Grid for the BaBar Experiment , 2009 .

[13]  Raymond R. Hill,et al.  Agent-Based Modeling: A Historical Perspective and a Review of Validation and Verification Efforts , 2010 .

[14]  Mark S. Gordon,et al.  General atomic and molecular electronic structure system , 1993, J. Comput. Chem..

[15]  Gregor von Laszewski,et al.  A Java commodity grid kit , 2001, Concurr. Comput. Pract. Exp..

[16]  Kohei Ichikawa,et al.  Building cyberinfrastructure for bioinformatics using service oriented architecture , 2006 .

[17]  Brijesh Kumar Chaurasia,et al.  Mechanism for Privacy Preservation in VANETS , 2010, Int. J. Grid High Perform. Comput..

[18]  Ian T. Foster,et al.  A community authorization service for group collaboration , 2002, Proceedings Third International Workshop on Policies for Distributed Systems and Networks.

[19]  Joel H. Saltz,et al.  Model Formulation: caGrid 1.0: An Enterprise Grid Infrastructure for Biomedical Research , 2008, J. Am. Medical Informatics Assoc..

[20]  Mario Piattini,et al.  Obtaining Security Requirements for a Mobile Grid System , 2009, Int. J. Grid High Perform. Comput..

[21]  Ekaterina Kldiashvili Grid Technologies for E-Health: Applications for Telemedicine Services and Delivery , 2010 .

[22]  Federico D. Sacerdoti,et al.  Rolls: modifying a standard system installer to support user-customizable cluster frontend appliances , 2004, 2004 IEEE International Conference on Cluster Computing (IEEE Cat. No.04EX935).

[23]  Nong Xiao,et al.  A Push-Based Prefetching for Remote Caching RAM Grid , 2009, Int. J. Grid High Perform. Comput..

[24]  Evon M. O. Abu-Taieh,et al.  Handbook of Research on Discrete Event Simulation Environments: Technologies and Applications , 2009 .

[25]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[26]  K K Baldridge,et al.  QMView: a computational chemistry three-dimensional visualization tool at the interface between molecules and mankind. , 1995, Journal of molecular graphics.

[27]  Jan Broeckhove,et al.  Grid-Based Nuclear Physics Applications , 2009 .

[28]  Anne E. Trefethen,et al.  Cyberinfrastructure for e-Science , 2005, Science.

[29]  Yi Huang,et al.  Building web services for scientific grid applications , 2006, IBM J. Res. Dev..

[30]  I. Foster,et al.  Service-Oriented Science , 2005, Science.

[31]  Emmanuel Udoh,et al.  Cloud, Grid and High Performance Computing: Emerging Applications , 2011 .

[32]  Nathan A. Baker,et al.  Electrostatics of nanosystems: Application to microtubules and the ribosome , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Kohei Ichikawa,et al.  OPAL OP: AN EXTENSIBLE GRID-ENABLING WRAPPING TOOL FOR LEGACY APPLICATIONS , 2007, Grid 2007.

[34]  Shih-Hao Hung,et al.  Migrating Android Applications to the Cloud , 2011, Int. J. Grid High Perform. Comput..

[35]  Cees T. A. M. de Laat,et al.  A Trusted Data Storage Infrastructure for Grid-Based Medical Applications , 2008, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID).

[36]  Ian T. Foster,et al.  A security architecture for computational grids , 1998, CCS '98.

[37]  Ciprian Dobre,et al.  Large-Scale Distributed Computing and Applications: Models and Trends , 2010 .

[38]  David Abramson,et al.  Nimrod: a tool for performing parametrised simulations using distributed workstations , 1995, Proceedings of the Fourth IEEE International Symposium on High Performance Distributed Computing.

[39]  Michel F. Sanner,et al.  Integrating Computation and Visualization for Biomolecular Analysis: An Example Using Python and AVS , 1998, Pacific Symposium on Biocomputing.

[40]  Eduardo Huedo,et al.  A framework for adaptive execution in grids , 2004, Softw. Pract. Exp..

[41]  Kim K. Baldridge,et al.  Opal: SimpleWeb Services Wrappers for Scientific Applications , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[42]  Frank Z. Wang,et al.  Handbook of Research on Grid Technologies and Utility Computing: Concepts for Managing Large-Scale Applications , 2009 .

[43]  Mark James,et al.  Biomedical Informatics Research Network: Building a National Collaboratory to Hasten the Derivation of New Understanding and Treatment of Disease , 2005, HealthGrid.

[44]  Xiaohui Wei,et al.  My WorkSphere: Integrative work environment for grid-unaware biomedical researchers and applications , 2006 .

[45]  Xiaohui Wei,et al.  Providing Dynamic Virtualized Access to Grid Resources via the Web 2.0 Paradigm , 2007, GCE 2007.