Data Management Challenges in Coastal Applications

Tummala, S. and Kosar, T., 2007. Data Management Challenges in Coastal Applications. Journal of Coastal Research, SI 50 (Proceedings of the 9th International Coastal Symposium), pg – pg. Gold Coast, Australia, ISBN The goal of this paper is to identify the data management challenges in coastal applications such as hurricane track prediction, storm surge modeling and coastal erosion modeling. The problems in managing the data due to different paradigms such as increase in data and computational requirements, conceptual changes in the computational models involved, and changes due to the evolution of objectives of the models are explained. Potential problems in a complete processing cycle that can be solved using automation are enumerated right from the selection of input data to the archival of output data or feeding the output data into a visualization system. Challenges to the user like having to complete the data management operations manually, to learn the underlying complexity of the resources, and to intervene during data placement failures are explained. Specialized tools for data placement and automation of specific tasks and the workflow mechanisms that are being used currently to automate the entire end-to-end cycle of scientific computation are mentioned as a solution to these problems.

[1]  Frederica Darema,et al.  Dynamic data-driven applications systems , 2006, SC.

[2]  Christos Nikolaou,et al.  THETIS: Design of a Data Management and Data Visualization System for Coastal Zone Management of the Mediterranean Sea , 1997, D Lib Mag..

[3]  Ian T. Foster,et al.  Grid information services for distributed resource sharing , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[4]  C. Kesselman,et al.  A Metadata Catalog Service for Data Intensive Applications , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[5]  Greg Goth.  Weather Data Industry on Brink of "Explosion" , 2005, IEEE Distributed Systems Online.

[6]  Carl Kesselman,et al.  What makes workflows work in an opportunistic environment? , 2006, Concurr. Comput. Pract. Exp..

[7]  Carl Kesselman,et al.  Wide area data replication for scientific collaborations , 2005, Int. J. High Perform. Comput. Netw..

[8]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[9]  Eric Gilbert,et al.  Virtual data Grid middleware services for data‐intensive science , 2006, Concurr. Comput. Pract. Exp..

[10]  Wei Zhao,et al.  The Southeastern University Research Association Coastal Ocean Observing and Prediction Program: integrating marine science and information technology , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[11]  Jeff Weber,et al.  Workflow Management in Condor , 2007, Workflows for e-Science, Scientific Workflows for Grids.

[12]  Miron Livny,et al.  Stork: making data placement a first class citizen in the grid , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[13]  Miron Livny,et al.  Condor: a distributed job scheduler , 2001 .

[14]  Richard W. Reynolds,et al.  A Real-Time Global Sea Surface Temperature Analysis , 1988 .

[15]  Daniel S. Katz,et al.  Pegasus: A framework for mapping complex scientific workflows onto distributed systems , 2005, Sci. Program..