Flexible composition and execution of large scale applications on distributed e-infrastructures

Computer simulation is finding a role in an increasing number of scientific disciplines, concomitant with the rise in available computing power. Marshalling this power facilitates new, more effective and different research than has been hitherto possible. Realizing this inevitably requires access to computational power beyond the desktop, making use of clusters, supercomputers, data repositories, networks and distributed aggregations of these resources. The use of diverse e-infrastructure brings with it the ability to perform distributed multiscale simulations. Accessing one such resource entails a number of usability and security problems; when multiple geographically distributed resources are involved, the difficulty is compounded. In this paper we present a solution, the Application Hosting Environment,3 which provides a Software as a Service layer on top of distributed e-infrastructure resources. We describe the performance and usability enhancements present in AHE version 3, and show how these have led to a high performance, easy to use gateway for computational scientists working in diverse application domains, from computational physics and chemistry, materials science to biology and biomedicine.

[1]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[2]  Alfio Quarteroni,et al.  A vision and strategy for the virtual physiological human in 2010 and beyond , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[3]  Jim Basney,et al.  Mechanisms for increasing the usability of grid security , 2005, Int. J. Hum. Comput. Stud..

[4]  Andrew Richards,et al.  Shibboleth Access for Resources on the National Grid Service (SARoNGS) , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[5]  Peter V Coveney,et al.  On the usability of grid middleware and security mechanisms , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[6]  Peter V. Coveney,et al.  Large-scale molecular dynamics study of montmorillonite clay : Emergence of undulatory fluctuations and determination of material properties , 2007 .

[7]  Peter V. Coveney,et al.  Automated Molecular Simulation Based Binding Affinity Calculator for Ligand-Bound HIV-1 Proteases , 2008, J. Chem. Inf. Model..

[8]  Peter V. Coveney,et al.  Distributed Infrastructure for Multiscale Computing , 2012, 2012 IEEE/ACM 16th International Symposium on Distributed Simulation and Real Time Applications.

[9]  Peter V. Coveney,et al.  Distributed multiscale simulations of clay-polymer nanocomposites , 2012 .

[10]  Ivan Beschastnikh,et al.  SPRUCE: A System for Supporting Urgent High-Performance Computing , 2006, Grid-Based Problem Solving Environments.

[11]  Marian Bubak,et al.  Invocation of operations from script-based Grid applications , 2010, Future Gener. Comput. Syst..

[12]  Ákos Frohner,et al.  VOMS, an Authorization System for Virtual Organizations , 2003, European Across Grids Conference.

[13]  Peter V. Coveney,et al.  Towards tractable toolkits for the grid: a plea for lightweight , 2004 .

[14]  Peter V Coveney,et al.  Audited credential delegation: a usable security solution for the virtual physiological human toolkit , 2011, Interface Focus.

[15]  Steven Tuecke,et al.  An online credential repository for the Grid: MyProxy , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[16]  J. Dongarra,et al.  The Impact of Multicore on Computational Science Software , 2007 .

[17]  Ali E. Abdallah,et al.  Formal Modelling of a Usable Identity Management Solution for Virtual Organisations , 2010, FAVO.

[18]  Peter V. Coveney,et al.  Virtualizing access to scientific applications with the Application Hosting Environment , 2009, Comput. Phys. Commun..

[19]  Peter V Coveney,et al.  Scientific Grid computing , 2005, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[20]  Adrian J. Shepherd,et al.  A computational Grid framework for immunological applications , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[21]  Etienne J. Khayat,et al.  Formal Z Specifications of Several Flat Role-Based Access Control Models , 2006, 2006 30th Annual IEEE/NASA Software Engineering Workshop.

[22]  Alexander G. Fletcher,et al.  Chaste: A test-driven approach to software development for biological modelling , 2009, Comput. Phys. Commun..

[23]  Shantenu Jha,et al.  NEKTAR, SPICE and Vortonics: using federated grids for large scale scientific applications , 2006, 2006 IEEE Challenges of Large Applications in Distributed Environments.

[24]  Peter V. Coveney,et al.  The application hosting environment: Lightweight middleware for grid-based computational science , 2007, Comput. Phys. Commun..

[25]  Richard O. Sinnott,et al.  Shibboleth-based Access to and Usage of Grid Resources , 2006, 2006 7th IEEE/ACM International Conference on Grid Computing.

[26]  László Gulyás,et al.  Complex System Simulations with QosCosGrid , 2009, ICCS.

[27]  S M Pickles,et al.  A practical toolkit for computational steering , 2005, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[28]  Roy Fielding,et al.  Architectural Styles and the Design of Network-based Software Architectures"; Doctoral dissertation , 2000 .