A practical approach to developing a web-based geospatial workflow composition and execution system

Motivated by lacking the capability of supporting geospatial workflow composition and execution in a Web environment from leading GIS (such as ESRI ArcGIS), we have developed a prototype system by integrating mature open source and commercial software packages in an innovative way. Our prototype system includes a client module for visual and interactive workflow editing based on Ptolemy II (a modeling and design system), a geospatial actor library representing 500+ ArcGIS geoprocessing tools for drag-and-drop-based workflow composition, a middleware as a workflow engine to schedule and execute ArcGIS Geoprocessing tools based on composed geospatial workflows, and, a Web-GIS to visualize original and derived data along a workflow processing pipeline. By reusing the mature software packages, we are able to complete the prototype development within weeks instead of months or years. A site selection problem that involves multiple geospatial operations are used to demonstrate the functionality and features of the prototype system.

[1]  Jianting Zhang,et al.  Using Web Services and Scientific Workflow for Species Distribution Prediction Modeling , 2005, WAIM.

[2]  Giuseppe Pelagatti,et al.  Workflow technology for geo-processing: the missing link , 2011, COM.Geo.

[3]  Edward A. Lee,et al.  The design and application of structured types in Ptolemy II , 2005, 2005 IEEE International Conference on Granular Computing.

[4]  Juliana Freire,et al.  Provenance and scientific workflows: challenges and opportunities , 2008, SIGMOD Conference.

[5]  Philip James,et al.  Semantically-assisted geospatial workflow design , 2007, GIS.

[6]  Jianting Zhang.  Tracking Dynamics of Geospatial Phenomena in Distributed and Heterogeneous Environments Using Scientific Workflow and Web Services Technologies , 2006, 2006 Fifth International Conference on Grid and Cooperative Computing (GCC'06).

[7]  Liping Di,et al.  Geo-processing workflow driven wildfire hot pixel detection under sensor web environment , 2010, Comput. Geosci..

[8]  Gustavo Alonso,et al.  Geo-Opera: Workflow Concepts for Spatial Processes , 1997, SSD.

[9]  Edward A. Lee,et al.  Dataflow process networks , 1995, Proc. IEEE.

[10]  Mathias Weske,et al.  WASA: A Workflow-Based Architecture to Support Scientific Database Applications (Extended Abstract) , 1995, DEXA.

[11]  Edward A. Lee,et al.  Scientific workflow management and the Kepler system , 2006, Concurr. Comput. Pract. Exp..

[12]  Jianting Zhang,et al.  Validating compositions of geospatial processing Web services in a scientific workflow environment , 2005, IEEE International Conference on Web Services (ICWS'05).

[13]  Jack Dongarra,et al.  Problem-solving environments , 2003 .

[14]  Andreas Dengel,et al.  IVIP - A Scientific Workflow System to Support Experts in Spatial Planning of Crop Production , 2008, SSDBM.

[15]  Liping Di,et al.  Semantics-based automatic composition of geospatial Web service chains , 2007, Comput. Geosci..

[16]  Bertram Ludäscher,et al.  A Scientific Workflow Approach to Distributed Geospatial Data Processing using Web Services , 2005, SSDBM.

[17]  Jack Dongarra,et al.  Proceedings of the International Conference on Computational Science, ICCS 2011 , 2011 .

[18]  Liping Di,et al.  GeoPWTManager: a task-oriented web geoprocessing system , 2012, Comput. Geosci..

[19]  Jianting Zhang,et al.  Automatic Transformation from Geospatial Conceptual Workflow to Executable Workflow Using GRASS GIS Command Line Modules in Kepler , 2006, International Conference on Computational Science.

[20]  Rajkumar Buyya,et al.  A taxonomy of scientific workflow systems for grid computing , 2005, SGMD.

[21]  Jing Tao,et al.  Integrating Data Grid and Web Services for E-Science Applications: A Case Study of Exploring Species Distributions , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[22]  Liping Di,et al.  Design and Implementation of GeoBrain Online Analysis System (GeOnAS) , 2008, W2GIS.

[23]  Jianting Zhang,et al.  Ontology-Driven Composition and Validation of Scientific Grid Workflows in Kepler: a Case Study of Hyperspectral Image Processing , 2006, 2006 Fifth International Conference on Grid and Cooperative Computing Workshops.

[24]  Xiaojun Liu,et al.  Ranking and selecting terms for text categorization via SVM discriminate boundary , 2005 .

[25]  Philip James,et al.  Orchestration of Grid-Enabled Geospatial Web Services in Geoscientific Workflows , 2010, IEEE Transactions on Automation Science and Engineering.

[26]  Bertram Ludäscher,et al.  Actor-Oriented Design of Scientific Workflows , 2005, ER.

[27]  Ian J. Taylor,et al.  Workflows and e-Science: An overview of workflow system features and capabilities , 2009, Future Gener. Comput. Syst..

[28]  Liping Di,et al.  GeoPW: Laying Blocks for the Geospatial Processing Web , 2010, Trans. GIS.

[29]  Andrew Terhorst,et al.  Exposing the Kepler Scientific Workflow System as an OGC Web Processing Service , 2010 .