Content-based search of earth observation data archives using open-access multitemporal land cover and terrain products

Abstract Public Earth Observation (EO) data archives, e.g., MODIS, Landsat, and Sentinels, are valuable sources of information for a broad range of applications. For decision-supporting applications used in urban planning, land management, and sustainable development, images covering regions similar to the study area are prerequisites for high-accuracy decision making. These desirable images cannot be quickly searched for in the EO data archives via image metadata alone but can be obtained through content-based image retrieval methods. Land cover (LC) information, traditionally obtained through image segmentation or classification processing, is typically used in existing methods. Image processing is time consuming and has various accuracy levels for heterogeneous images, thus decreasing retrieval efficiency and accuracy. Additionally, the monotemporal LC information used has a limited ability to distinguish among confusable regions with different terrain, e.g., forests located on flatlands or mountains, and to obtain regions, e.g., urban regions, with similar growth rates. In this study, we employ free multiple-year 30 m LC products, a terrain product, and the Google Earth Engine (GEE) platform to accurately and efficiently locate the desired heterogeneous moderate spatial resolution images from various public EO data archives. Regions similar to the query region are detected with two-stage similarity calculations: First, monotemporal pixel-based LC and terrain information are used to filter out the most dissimilar regions; second, object-based LC change and terrain information are used to locate similar regions. Then, the desired images covering these detected similar regions are obtained from EO data archives via image metadata, e.g., geographical location and acquisition time. The experimental results of the two representative query regions show that our method can be used to obtain the desired images within several minutes and has higher accuracy than the LandEx method and a simplified method using only monotemporal LC information. The main contribution of our study is to reveal that LC changes and terrain information are helpful for improving the retrieval accuracy achieved from monotemporal LC information alone. Our method has great operability, with no need to perform EO data acquisition, image processing of raw EO images, or management of computational resources. Our method is conducive to making full use of images in various public EO archives to improve the decision making quality of decision-supporting applications.

[1]  Takeo Tadono,et al.  Generation of the 30 M-MESH global digital surface model by alos prism , 2016 .

[2]  Jianya Gong,et al.  Development of a Framework for Stereo Image Retrieval With Both Height and Planar Features , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Tomasz F. Stepinski,et al.  LandEx—A GeoWeb Tool for Query and Retrieval of Spatial Patterns in Land Cover Datasets , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Suming Jin,et al.  A comprehensive change detection method for updating the National Land Cover Database to circa 2011 , 2013 .

[5]  David P. Roy,et al.  The global Landsat archive: Status, consolidation, and direction , 2016 .

[6]  Albert Y. Zomaya,et al.  Remote sensing big data computing: Challenges and opportunities , 2015, Future Gener. Comput. Syst..

[7]  Timothy A. Warner,et al.  A time series of annual land use and land cover maps of China from 1982 to 2013 generated using AVHRR GIMMS NDVI3g data , 2017 .

[8]  Wei Liu,et al.  A Content-Based Remote Sensing Image Change Information Retrieval Model , 2017, ISPRS Int. J. Geo Inf..

[9]  Rasim Latifovic,et al.  Development and assessment of a 250 m spatial resolution MODIS annual land cover time series (2000–2011) for the forest region of Canada derived from change-based updating , 2014 .

[10]  J. Wickham,et al.  Thematic accuracy of the NLCD 2001 land cover for the conterminous United States , 2010 .

[11]  Christian Heipke,et al.  Information from imagery: ISPRS scientific vision and research agenda , 2016 .

[12]  Takeo Tadono,et al.  Generation of High Resolution Global DSM from ALOS PRISM , 2014 .

[13]  Bin Luo,et al.  Alike Scene Retrieval from Land-Cover Products Based on the Label Co-Occurrence Matrix (LCM) , 2017, Remote. Sens..

[14]  Hankui K. Zhang,et al.  Finer resolution observation and monitoring of global land cover: first mapping results with Landsat TM and ETM+ data , 2013 .

[15]  P. Levelt,et al.  ESA's sentinel missions in support of Earth system science , 2012 .

[16]  Marco Quartulli,et al.  A review of EO image information mining , 2012, 1203.0747.

[17]  R. D. Garg,et al.  Evaluation of vertical accuracy of open source Digital Elevation Model (DEM) , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[18]  Limin Yang,et al.  A new generation of the United States National Land Cover Database: Requirements, research priorities, design, and implementation strategies , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[19]  Zhenfeng Shao,et al.  PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrieval , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[20]  Xuezhi Feng,et al.  Accuracy assessment of seven global land cover datasets over China , 2017 .

[21]  Martha C. Anderson,et al.  Free Access to Landsat Imagery , 2008, Science.

[22]  Awais Ahmad,et al.  Real-Time Big Data Analytical Architecture for Remote Sensing Application , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Amel Benazza-Benyahia,et al.  Disparity based stereo image retrieval through univariate and bivariate models , 2015, Signal Process. Image Commun..

[24]  Tomasz F. Stepinski,et al.  Example-Based Retrieval of Alike Land-Cover Scenes From NLCD2006 Database , 2013, IEEE Geoscience and Remote Sensing Letters.

[25]  C. Justice,et al.  High-Resolution Global Maps of 21st-Century Forest Cover Change , 2013, Science.

[26]  Xiaoping Liu,et al.  High-resolution multi-temporal mapping of global urban land using Landsat images based on the Google Earth Engine Platform , 2018 .

[27]  Surya S. Durbha,et al.  Semantics-enabled framework for knowledge discovery from Earth observation data archives , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[28]  J. Wickham,et al.  Completion of the 2001 National Land Cover Database for the conterminous United States , 2007 .

[29]  Jing Luo,et al.  Stereo Image Retrieval Using Height and Planar Visual Word Pairs , 2017, IEEE Geoscience and Remote Sensing Letters.

[30]  Gergely Szabó,et al.  Slope angle and aspect as influencing factors on the accuracy of the SRTM and the ASTER GDEM databases , 2015 .

[31]  Michael Dixon,et al.  Google Earth Engine: Planetary-scale geospatial analysis for everyone , 2017 .

[32]  William J. Emery,et al.  SAR Image Content Retrieval Based on Fuzzy Similarity and Relevance Feedback , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Takeo Tadono,et al.  PRECISE GLOBAL DEM GENERATION BY ALOS PRISM , 2014 .

[34]  Christopher A. Barnes,et al.  Completion of the 2006 National Land Cover Database for the conterminous United States. , 2011 .

[35]  Marco Pastori,et al.  Information mining in remote sensing image archives: system concepts , 2003, IEEE Trans. Geosci. Remote. Sens..

[36]  Steffen Fritz,et al.  Spatial Accuracy Assessment and Integration of Global Land Cover Datasets , 2015, Remote. Sens..

[37]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[38]  Tomasz F. Stepinski,et al.  GeoPAT: A toolbox for pattern-based information retrieval from large geospatial databases , 2015, Comput. Geosci..

[39]  Edzer Pebesma,et al.  Open and scalable analytics of large Earth observation datasets: from scenes to multidimensional arrays using SciDB and GDAL , 2018 .

[40]  Bin Jiang,et al.  Geospatial Big Data Handling Theory and Methods: A Review and Research Challenges , 2015, ArXiv.

[41]  N. Coops,et al.  Satellites: Make Earth observations open access , 2014, Nature.

[42]  Juha Hyyppä,et al.  Comparison of Laser and Stereo Optical, SAR and InSAR Point Clouds from Air- and Space-Borne Sources in the Retrieval of Forest Inventory Attributes , 2015, Remote. Sens..

[43]  Lei Zhang,et al.  An effective hyperspectral image retrieval method using integrated spectral and textural features , 2015 .

[44]  Michael J. Oimoen,et al.  The National Elevation Dataset , 2002 .

[45]  Mihai Datcu,et al.  Earth-Observation Image Retrieval Based on Content, Semantics, and Metadata , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[46]  J. Fry,et al.  Updating the 2001 National Land Cover Database land cover classification to 2006 by using Landsat imagery change detection methods , 2009 .

[47]  Shiyong Cui,et al.  Information Content of Very-High-Resolution SAR Images: Semantics, Geospatial Context, and Ontologies , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[48]  Fabio Terribile,et al.  A Web-based spatial decision supporting system for land management and soil conservation , 2015 .

[49]  Jin Chen,et al.  Global land cover mapping at 30 m resolution: A POK-based operational approach , 2015 .

[50]  Akira Hirano,et al.  Mapping from ASTER stereo image data: DEM validation and accuracy assessment , 2003 .

[51]  Nandin-Erdene Tsendbazar,et al.  Comparative assessment of thematic accuracy of GLC maps for specific applications using existing reference data , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[52]  A. S. Belward,et al.  Who launched what, when and why; trends in global land-cover observation capacity from civilian earth observation satellites , 2015 .

[53]  Manuel Graña,et al.  A Spectral/Spatial CBIR System for Hyperspectral Images , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[54]  Mihai Datcu,et al.  Understanding Heterogeneous EO Datasets: A Framework for Semantic Representations , 2018, IEEE Access.

[55]  Chi-Ren Shyu,et al.  GeoIRIS: Geospatial Information Retrieval and Indexing System—Content Mining, Semantics Modeling, and Complex Queries , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[56]  James D. Wickham,et al.  Thematic accuracy assessment of the 2011 National Land Cover Database (NLCD). , 2017, Remote sensing of environment.

[57]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[58]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[59]  G. Foody,et al.  Generating a series of fine spatial and temporal resolution land cover maps by fusing coarse spatial resolution remotely sensed images and fine spatial resolution land cover maps , 2017 .

[60]  Marinos Kavouras,et al.  An overview of 21 global and 43 regional land-cover mapping products , 2015 .

[61]  Manuel Graña,et al.  An endmember-based distance for content based hyperspectral image retrieval , 2012, Pattern Recognit..

[62]  Antonio J. Plaza,et al.  Recent Developments in High Performance Computing for Remote Sensing: A Review , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[63]  J. Pekel,et al.  High-resolution mapping of global surface water and its long-term changes , 2016, Nature.

[64]  J. Wickham,et al.  Accuracy assessment of NLCD 2006 land cover and impervious surface , 2013 .

[65]  Bicheron Patrice,et al.  GlobCover - Products Description and Validation Report , 2008 .

[66]  Ali Sharifi Remote sensing and decision support systems , 1999 .

[67]  Zhenlong Li,et al.  Big Data and cloud computing: innovation opportunities and challenges , 2017, Int. J. Digit. Earth.

[68]  Peng Gong,et al.  Global land cover mapping using Earth observation satellite data: Recent progresses and challenges , 2015 .

[69]  Le Yu,et al.  Mapping global land cover in 2001 and 2010 with spatial-temporal consistency at 250 m resolution , 2015 .

[70]  Amir Hussain,et al.  A novel decision support system for the interpretation of remote sensing big data , 2018, Earth Science Informatics.

[71]  Shuang Wang,et al.  SAR Images Retrieval Based on Semantic Classification and Region-Based Similarity Measure for Earth Observation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[72]  Suming Jin,et al.  Completion of the 2011 National Land Cover Database for the Conterminous United States – Representing a Decade of Land Cover Change Information , 2015 .

[73]  Martin Herold,et al.  The spatiotemporal form of urban growth: measurement, analysis and modeling , 2003 .