Earth system modelling with Windows Workflow Foundation

The GENIE project has built a Grid-enabled Earth system modelling framework that facilitates the integration, execution and management of component models for the study of the Earth system over millennial timescales. The existing framework supports collaborative study of GENIE models across heterogeneous compute grids through scripted workflows in the Matlab environment. While the scripting approach achieves simplicity and flexibility, it suffers from an essentially passive approach to work unit management and from a heavy reliance on a central database to provide fault tolerance. The Windows Workflow Foundation (WF) technology provides a rich set of features to support the authoring and execution of workflows, tracking services that enable the monitoring of a running workflow, and state persistence services that allow workflows to be recovered and resumed upon failure. We demonstrate how the Windows Workflow Foundation has been applied to build a complementary simulation management system which provides rapid composition, event driven logic and reliable hosting of the scientific workflows while interfacing to existing infrastructure. We also describe how the adoption of WF enables the application of a number of associated technologies to provide better interoperability and accessibility for the simulation system. These improvements are demonstrated through a parametric study of the bi-stability of the oceanic thermohaline circulation in a GENIE model where the effects of a new carbon cycle are studied.

[1]  Jun Feng,et al.  Toward seamless grid data access: design and implementation of GridFTP on .NET , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[2]  Edward A. Lee,et al.  CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE Concurrency Computat.: Pract. Exper. 2000; 00:1–7 Prepared using cpeauth.cls [Version: 2002/09/19 v2.02] Taverna: Lessons in creating , 2022 .

[3]  Edward A. Lee,et al.  Scientific workflow management and the Kepler system , 2006, Concurr. Comput. Pract. Exp..

[4]  Timothy M. Lenton,et al.  Collaborative study of GENIEfy Earth System Models using scripted database workflows in a Grid-enabled PSE , 2006 .

[5]  Geoffrey Fox,et al.  Special Issue: Workflow in Grid Systems , 2006, Concurr. Comput. Pract. Exp..

[6]  J. McManus,et al.  Collapse and rapid resumption of Atlantic meridional circulation linked to deglacial climate changes , 2004, Nature.

[7]  Mathilde Romberg,et al.  The UNICORE Grid infrastructure , 2002, Sci. Program..

[8]  Sharanya Eswaran,et al.  Adapting and Evaluating Commercial Workflow Engines for e-Science , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[9]  Simon J. Cox,et al.  Bistability of the thermohaline circulation identified through comprehensive 2-parameter sweeps of an efficient climate model , 2004 .

[10]  Jack J. Dongarra,et al.  Recent Developments in Gridsolve , 2006, Int. J. High Perform. Comput. Appl..

[11]  Gregor von Laszewski,et al.  Workflow Concepts of the Java CoG Kit , 2005, Journal of Grid Computing.

[12]  H. L. Miller,et al.  Climate Change 2007: The Physical Science Basis , 2007 .

[13]  Simon J. Cox,et al.  Leveraging Windows Workflow Foundation for Scientific Workflows in Wind Tunnel Applications , 2006, 22nd International Conference on Data Engineering Workshops (ICDEW'06).

[14]  Dharma Shukla,et al.  Essential Windows Workflow Foundation (Microsoft .Net Development Series) , 2006 .

[15]  Alan Bundy,et al.  Proceedings of the UK e-Science All Hands Meeting 2006 , 2006 .

[16]  Douglas Thain,et al.  Distributed computing in practice: the Condor experience , 2005, Concurr. Pract. Exp..

[17]  Jason Maassen,et al.  Programming Scientific and Distributed Workflow with Triana Services , 2004 .

[18]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[19]  Simon J. Cox,et al.  Building Scientific Workflows for Earth System Modelling with Windows Workflow Foundation , 2007, International Conference on Computational Science.

[20]  Chris Sells,et al.  Programming Windows Presentation Foundation , 2005 .

[21]  A. R. Price,et al.  GENIE-M: a new and improved GENIE-1 developed in Minnesota , 2008 .

[22]  Simon J. Cox,et al.  Multiobjective Tuning of Grid-Enabled Earth System Models Using a Non-dominated Sorting Genetic Algorithm (NSGA-II) , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[23]  Simon J. Cox,et al.  Optimization of integrated Earth System Model components using Grid‐enabled data management and computation , 2007, Concurr. Comput. Pract. Exp..

[24]  A. R. Price,et al.  Effects of atmospheric dynamics and ocean resolution on bi-stability of the thermohaline circulation examined using the Grid ENabled Integrated Earth system modelling (GENIE) framework , 2007, Climate Dynamics.

[25]  Corinne Le Quéré,et al.  Climate Change 2013: The Physical Science Basis , 2013 .

[26]  Simon J. Cox,et al.  MyCoG.NET: a multi‐language CoG toolkit , 2007, Concurr. Comput. Pract. Exp..

[27]  David Abramson,et al.  Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid , 2000, Proceedings Fourth International Conference/Exhibition on High Performance Computing in the Asia-Pacific Region.

[28]  Simon J. Cox,et al.  Implementation and utilisation of a Grid-enabled problem solving environment in Matlab , 2005, Future Gener. Comput. Syst..