CyberConnector: a service-oriented system for automatically tailoring multisource Earth observation data to feed Earth science models

Feeding multisource Earth observation (EO) data into Earth science models (ESM) remains a daunting challenge. This paper presents a service-oriented approach as an alternative solution. It uses geospatial web services to process the EO data and geoprocessing workflow for automation. Different from existing approaches, it takes advantage of virtual data products (VDP) to release modelers from intensive data processing. It can directly connect ESMs to public EO sources via Cyberinfrastructure. A prototype called CyberConnector is implemented. CyberConnector supports intuitive building of VDP, automatic execution of workflows and effortless retrieval of model-ready input files. We used it to stream multiple datasets to several ESMs including finite-volume coastal ocean model (FVCOM) and cloud-resolving model (CRM). The results show that CyberConnector can truly benefit modelers on time saving and effort minimizing.

[1]  Liping Di,et al.  Semantics-based automatic composition of geospatial Web service chains , 2007, Comput. Geosci..

[2]  Gary N. Geller,et al.  Looking forward: Applying an ecological model web to assess impacts of climate change , 2008 .

[3]  Changsheng Chen,et al.  An Unstructured Grid, Finite-Volume, Three-Dimensional, Primitive Equations Ocean Model: Application to Coastal Ocean and Estuaries , 2003 .

[4]  Lei Hu,et al.  GeoPWProv: Interleaving Map and Faceted Metadata for Provenance Visualization and Navigation , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Aijun Chen,et al.  Use of grid computing for modeling virtual geospatial products , 2009, Int. J. Geogr. Inf. Sci..

[6]  Piero Fraternali,et al.  Tools and approaches for developing data-intensive Web applications: a survey , 1999, CSUR.

[7]  Wojciech W. Grabowski,et al.  Cloud-Resolving Modeling of Tropical Cloud Systems during Phase III of GATE. Part I: Two-Dimensional Experiments. , 1996 .

[8]  Ming-Hsiang Tsou,et al.  Please Scroll down for Article International Journal of Geographical Information Science Developing a Grid-enabled Spatial Web Portal for Internet Giservices and Geospatial Cyberinfrastructure Developing a Grid-enabled Spatial Web Portal for Internet Giservices and Geospatial Cyberinfrastructure , 2022 .

[9]  Christoph Stasch,et al.  Development of sensor web applications with open source software , 2009 .

[10]  Andrew T. Cox,et al.  U.S. IOOS coastal and ocean modeling testbed: Inter‐model evaluation of tides, waves, and hurricane surge in the Gulf of Mexico , 2013 .

[11]  Lei Hu,et al.  A Task Ontology Driven Approach for Live Geoprocessing in a Service‐Oriented Environment , 2012, Trans. GIS.

[12]  Kevin A. Delin,et al.  Sensor web: a new instrument concept , 2001, SPIE OPTO.

[13]  Richard H. Johnson,et al.  Structure and Properties of Madden–Julian Oscillations Deduced from DYNAMO Sounding Arrays , 2013 .

[14]  Dawn J. Wright,et al.  The emergence of spatial cyberinfrastructure , 2011, Proceedings of the National Academy of Sciences.

[15]  Thomas Hess,et al.  Opportunities and risks of software-as-a-service: Findings from a survey of IT executives , 2011, Decis. Support Syst..

[16]  Anne E. Trefethen,et al.  Cyberinfrastructure for e-Science , 2005, Science.

[17]  Mark Gahegan,et al.  Geospatial Cyberinfrastructure: Past, present and future , 2010, Comput. Environ. Urban Syst..

[18]  Jeffery S. Horsburgh,et al.  A first approach to web services for the National Water Information System , 2008, Environ. Model. Softw..

[19]  Michael Kofler.  What Is MySQL , 2004 .

[20]  G. Yu,et al.  Semantic Augmentations for Geospatial Catalogue Service , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[21]  Sunwook Park,et al.  Cloud-Resolving Model Simulations over the ARM SGP , 2007 .

[22]  James A. Hendler,et al.  Agents and the Semantic Web , 2001, IEEE Intell. Syst..

[23]  Anthony M. Castronova,et al.  Modeling water resource systems using a service-oriented computing paradigm , 2011, Environ. Model. Softw..

[24]  Dan Brickley,et al.  Resource Description Framework (RDF) Model and Syntax Specification , 2002 .

[25]  Shaowen Wang.  A CyberGIS Framework for the Synthesis of Cyberinfrastructure, GIS, and Spatial Analysis , 2010 .

[26]  Surya S. Durbha,et al.  Mobile computing and Sensor Web Services for coastal buoys , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[27]  Ick Hoi Kim,et al.  Creating GIS simulation models on a TeraGrid-enabled geospatial web portal: A demonstration of geospatial cyberinfrastructure , 2011 .

[28]  Claudia Bauzer Medeiros,et al.  The Geospatial Semantic Web - Are GIS Catalogs prepared for This? , 2009, WEBIST.

[29]  Xiaoqing Wu,et al.  Comparison of Moist Static Energy and Budget between the GCM-Simulated Madden–Julian Oscillation and Observations over the Indian Ocean and Western Pacific , 2013 .

[30]  Liping Di,et al.  Geo-processing workflow driven wildfire hot pixel detection under sensor web environment , 2010, Comput. Geosci..

[31]  Dumitru Roman,et al.  Model as a Service (MaaS) , 2008 .

[32]  Aijun Chen,et al.  Automation of Customized and Near-Real-Time Vegetation Condition Index Generation Through Cyberinfrastructure-Based Geoprocessing Workflows , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Changsheng Chen,et al.  An Unstructured Grid, Finite-Volume Coastal Ocean Model (FVCOM) System , 2006 .

[34]  David D. Parrish,et al.  NORTH AMERICAN REGIONAL REANALYSIS , 2006 .

[35]  Changsheng Chen,et al.  Mechanism studies of seasonal variability of dissolved oxygen in Mass Bay: A multi-scale FVCOM/UG-RCA application , 2014 .

[36]  Liping Di,et al.  Integrating semantic web technologies and geospatial catalog services for geospatial information discovery and processing in cyberinfrastructure , 2011, GeoInformatica.

[37]  Shaowen Wang,et al.  CyberGIS software: a synthetic review and integration roadmap , 2013, Int. J. Geogr. Inf. Sci..

[38]  Stefano Nativi,et al.  Environmental model access and interoperability: The GEO Model Web initiative , 2013, Environ. Model. Softw..

[39]  Yaxing Wei,et al.  UV-CDAT: Analyzing Climate Datasets from a User's Perspective , 2013, Computing in Science & Engineering.

[40]  C. Long,et al.  Quality-Controlled Upper-Air Sounding Dataset for DYNAMO/CINDY/AMIE: Development and Corrections , 2014 .

[41]  K. Emanuel,et al.  Evaluation of Large-Scale Forcing during TOGA COARE for Cloud-Resolving Models and Single-Column Models , 2000 .

[42]  Nengcheng Chen,et al.  A flexible geospatial sensor observation service for diverse sensor data based on Web service , 2009 .

[43]  Thomas Hess,et al.  Software as a Service , 2008, Wirtschaftsinf..

[44]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[45]  Peter Martinek,et al.  Semantic Execution of BPEL Processes , 2007 .

[46]  Charles N. Long,et al.  Tracking Pulses of the Madden–Julian Oscillation , 2013 .

[47]  Jeffery S. Horsburgh,et al.  An integrated system for publishing environmental observations data , 2009, Environ. Model. Softw..

[48]  Chaowei Phil Yang,et al.  Establishing a sustainable and cross-boundary geospatial cyberinfrastructure to enable polar research , 2011, Comput. Geosci..

[49]  J. Norris,et al.  U.S. Geological Survey Streamgage Operation and Maintenance Cost Evaluation...from the National Streamflow Information Program , 2010 .

[50]  Joel Cutcher-Gershenfeld,et al.  Community-developed geoscience cyberinfrastructure , 2014 .

[51]  Peng Yue,et al.  Geospatial data provenance in Cyberinfrastructure , 2009, 2009 17th International Conference on Geoinformatics.

[52]  Pearl Brereton,et al.  Turning Software into a Service , 2003, Computer.

[53]  Laura Díaz,et al.  Service-oriented applications for environmental models: Reusable geospatial services , 2010, Environ. Model. Softw..

[54]  Tian Zhao,et al.  Towards logic-based geospatial feature discovery and integration using web feature service and geospatial semantic web , 2010, Int. J. Geogr. Inf. Sci..

[55]  Tim Berners-Lee,et al.  The World-Wide Web , 1994, CACM.

[56]  G. L. Potter,et al.  Combining ESGF Data node with its complementary data services at the NASA Center for Climate Simulation , 2014 .

[57]  Frederico T. Fonseca,et al.  The geospa-tial semantic web , 2002 .

[58]  Daniel Atkins,et al.  Revolutionizing Science and Engineering Through Cyberinfrastructure: Report of the National Science Foundation Blue-Ribbon Advisory Panel on Cyberinfrastructure , 2003 .

[59]  D. Randall,et al.  A cloud resolving model as a cloud parameterization in the NCAR Community Climate System Model: Preliminary results , 2001 .

[60]  Christoph Stasch,et al.  Applying OGC sensor web enablement to risk monitoring and disaster management , 2009 .

[61]  Changsheng Chen,et al.  Complexity of the flooding/drying process in an estuarine tidal‐creek salt‐marsh system: An application of FVCOM , 2008 .

[62]  Geoffrey M. Davis,et al.  NetCDF User''s Guide for C , 1997 .

[63]  Laura Díaz,et al.  Managing user-generated information in geospatial cyberinfrastructures , 2011, Future Gener. Comput. Syst..

[64]  Max J. Egenhofer,et al.  Toward the semantic geospatial web , 2002, GIS '02.

[65]  Erik Hazzard,et al.  OpenLayers 2.10 Beginner's Guide , 2011 .

[66]  Remy Baraille,et al.  The HYCOM (HYbrid Coordinate Ocean Model) data assimilative system , 2007 .

[67]  D. Randall,et al.  Simulations of the Atmospheric General Circulation Using a Cloud-Resolving Model as a Superparameterization of Physical Processes , 2005 .

[68]  Xiaoqing Wu,et al.  A review of cloud-resolving model studies of convective processes , 2008 .

[69]  Xiaoqing Wu,et al.  A Comparison of TWP-ICE Observational Data with Cloud-Resolving Model Results , 2012 .

[70]  Haosheng Huang,et al.  Tidal dynamics in the Gulf of Maine and New England Shelf : an application of FVCOM , 2011 .

[71]  Aijun Chen,et al.  BPELPower - A BPEL execution engine for geospatial web services , 2012, Comput. Geosci..