A decision support system for scientists by processing large-scale satellite images on a distributed computing environment

Data-driven research strategy has been widely accepted in many scientific areas. In the strategy, which consists of several processing steps including data collection, processing, analysis and discovery, data processing step is so time-consuming that it delays the overall time of scientific discovery. This also happens in the field of satellite remote sensing. As SeaDAS, a popular software package used for processing satellite remote sensing images, has been initially devised to work on a single site; it is inevitable to take unendurable time for processing massive remote sensing images. To rectify this issue, this article introduces a data-driven analysis system that rapidly processes a massive volume satellite remote sensing images. Unlike the conventional program for remote sensing images, our system is developed by virtue of both a distributed array-based DBMS and a high-throughput computing facility in order to process massive remote sensing images in a parallel and distributed manner. Consequently, it allows scientists to perform their analysis workloads more quickly and efficiently. Through extensive experiments performed with real-world dataset on 10 computing nodes, we show that our system is up to 27.5 times faster than the conventional SeaDAS package.

[1]  J. Campbell Introduction to remote sensing , 1987 .

[2]  Peter G. W. Keen,et al.  Decision support systems: The next decade , 1987, Decis. Support Syst..

[3]  Michael Stonebraker,et al.  The Architecture of SciDB , 2011, SSDBM.

[4]  M. S. Moran,et al.  Reflectance- and radiance-based methods for the in-flight absolute calibration of multispectral sensors , 1987 .

[5]  Yong Bai,et al.  A remote sensing image classification method based on sparse representation , 2016, Multimedia Tools and Applications.

[6]  A. Karr Exploratory Data Mining and Data Cleaning , 2006 .

[7]  Michael Stonebraker,et al.  A Demonstration of SciDB: A Science-Oriented DBMS , 2009, Proc. VLDB Endow..

[8]  Michael S. Scott Morton,et al.  A Framework for Management Information Systems , 2015 .

[9]  Hiroshi Murakami,et al.  The sea surface temperature product algorithm of the Ocean Color and Temperature Scanner (OCTS) and its accuracy , 1998 .

[10]  Julien Michel,et al.  Remote Sensing Processing: From Multicore to GPU , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  T. Bernhardsen Geographic Information Systems: An Introduction , 1999 .

[12]  D. Roy,et al.  An overview of MODIS Land data processing and product status , 2002 .

[13]  J. Estes,et al.  Geographic Information Systems: An Introduction , 1990 .

[14]  Stanford B. Hooker,et al.  An overview of the SeaWiFS project and strategies for producing a climate research quality global ocean bio-optical time series , 2004 .

[15]  Jin-Jang Leou,et al.  Multispectral and multiresolution image fusion using particle swarm optimization , 2011, Multimedia Tools and Applications.

[16]  J. Douglas McCuistion,et al.  From observations to decision support: the new paradigm for satellite data , 2005 .

[17]  C. McClain,et al.  The calibration and validation of SeaWiFS data , 2000 .

[18]  Anthony J. G. Hey,et al.  The Fourth Paradigm: Data-Intensive Scientific Discovery [Point of View] , 2011 .

[19]  Paul G. Brown,et al.  Overview of sciDB: large scale array storage, processing and analysis , 2010, SIGMOD Conference.

[20]  Kerstin Kleese van Dam,et al.  Data-Intensive Science , 2013 .

[21]  R. W. Austin,et al.  Nimbus-7 Coastal Zone Color Scanner: System Description and Initial Imagery , 1980, Science.

[22]  Qian Du,et al.  High Performance Computing for Hyperspectral Remote Sensing , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  David J. DeWitt,et al.  Scientific data management in the coming decade , 2005, SGMD.

[24]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[25]  D. Bates,et al.  Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. , 2003, Archives of internal medicine.

[26]  Tony Hey,et al.  The Fourth Paradigm: Data-Intensive Scientific Discovery , 2009 .

[27]  John R. Jensen,et al.  Introductory Digital Image Processing: A Remote Sensing Perspective , 1986 .

[28]  Alan H. Strahler,et al.  The Moderate Resolution Imaging Spectroradiometer (MODIS): land remote sensing for global change research , 1998, IEEE Trans. Geosci. Remote. Sens..

[29]  Michael F. Goodchild Geographic Information Systems , 2001 .

[30]  Wei-keng Liao,et al.  Scientific Data Management Center for Enabling Technologies , 2011 .

[31]  Christer Carlsson,et al.  Past, present, and future of decision support technology , 2002, Decis. Support Syst..

[32]  Zhihan Lv,et al.  Change detection method for remote sensing images based on an improved Markov random field , 2017, Multimedia Tools and Applications.