Earth Observation Data Processing in Distributed Systems

Earth observation systems have a continuous growth in the user and internal requirements that can be handled nowadays only using distributed systems. These requirements are shortly reviewed in this paper. Huge data-sets management and processing are of special interest, as well as the particularities of the Earth observation data. On the technological side, the focus is put on service-oriented architectures that are facilitating the linkage of data or resources and processing. As proof of concept of current distributed system capabilities, the technological solutions used to build a training platform for Earth observation data processing are exposed and discussed in details.

[1]  Luigi Fusco,et al.  Grid technology for the storage and processing of remote sensing data: description of an application , 2003, SPIE Remote Sensing.

[2]  Luigi Fusco,et al.  Open Grid Services for Envisat and Earth Observation Applications , 2007 .

[3]  Isao Kojima,et al.  Design Principles and IT Overviews of the GEO Grid , 2008, IEEE Systems Journal.

[4]  Joseph C. Coughlan,et al.  Distributed application framework for Earth science data processing , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[5]  Craig Lee,et al.  Remote Sensing Grids: Architecture and Implementation , 2007 .

[6]  Frank B. Schmuck,et al.  GPFS: A Shared-Disk File System for Large Computing Clusters , 2002, FAST.

[7]  Yong Meng Teo,et al.  Distributed geo-rectification of satellite images using Grid computing , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[8]  Gheorghe Paun,et al.  A guide to membrane computing , 2002, Theor. Comput. Sci..

[9]  Ying Luo,et al.  Preliminary Study on Unsupervised Classification of Remotely Sensed Images on the Grid , 2004, International Conference on Computational Science.

[10]  Dana Petcu,et al.  Designing a Grid-Based Training Platform for Earth Observation , 2008, 2008 10th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing.

[11]  Alexander S. Szalay,et al.  Gray's laws: database-centric computing in science , 2009, The Fourth Paradigm.

[12]  Hans Weigand,et al.  Rule-based service composition and service-oriented business rule management , 2008 .

[13]  Matthew T. O'Keefe,et al.  The Global File System: A File System for Shared Disk Storage , 1997 .

[14]  David E. Bernholdt,et al.  Components, the Common Component Architecture, and the Climate/Weather/Ocean Community , 2003 .

[15]  Dorian Gorgan,et al.  Grid Based Training Environment for Earth Observation , 2009, GPC.

[16]  Massimo Cafaro,et al.  A dynamic earth observation system , 2003, Parallel Comput..

[17]  Erhard Rahm,et al.  AGENTWORK: a workflow system supporting rule-based workflow adaptation , 2004, Data Knowl. Eng..

[18]  Yan Ren,et al.  The Architecture of SIG Computing Environment and Its Application to Image Processing , 2005, GCC.

[19]  Edward A. Lee,et al.  CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE Concurrency Computat.: Pract. Exper. 2000; 00:1–7 Prepared using cpeauth.cls [Version: 2002/09/19 v2.02] Taverna: Lessons in creating , 2022 .

[20]  Dana Petcu,et al.  SATELLITE IMAGE PROCESSING ON A GRID-BASED PLATFORM , 2014 .

[21]  D. Petcu,et al.  Remote Sensed Image Processing on Grids for Training in Earth Observation , 2009 .

[22]  Amy Braverman,et al.  GENESIS : The General Earth Science Investigation Suite , 2004 .

[23]  Zsolt Németh,et al.  Workflow enactment based on a chemical metaphor , 2005, Third IEEE International Conference on Software Engineering and Formal Methods (SEFM'05).

[24]  Xuejun Yang,et al.  Services for Parallel Remote-Sensing Image Processing Based on Computational Grid , 2004, GCC Workshops.

[25]  Chein-I Chang,et al.  High Performance Computing in Remote Sensing , 2007, HiPC 2007.

[26]  Dana Petcu,et al.  Challenges of Data Processing for Earth Observation in Distributed Environments , 2009, IDC.

[27]  Tony Hey,et al.  The Fourth Paradigm , 2009 .

[28]  Craig Lee.  An Introduction to Grids for Remote Sensing Applications , 2007 .

[29]  Keith Golden,et al.  Parallel Distributed Application Framework for Earth Science Data Processing , 2003, ScanGIS.

[30]  Daniel S. Katz,et al.  Pegasus: A framework for mapping complex scientific workflows onto distributed systems , 2005, Sci. Program..

[31]  Anthony J. G. Hey,et al.  The Fourth Paradigm: Data-Intensive Scientific Discovery [Point of View] , 2011 .

[32]  Dana Petcu,et al.  Web and Grid services for training in Earth observation , 2009, 2009 IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications.

[33]  Charles L. Forgy,et al.  Rete: a fast algorithm for the many pattern/many object pattern match problem , 1991 .

[34]  Antonio J. Plaza,et al.  AMEEPAR: Parallel Morphological Algorithm for Hyperspectral Image Classification on Heterogeneous Networks of Workstations , 2006, International Conference on Computational Science.