Spatiotemporal Fusion of MODIS and Landsat-7 Reflectance Images via Compressed Sensing

The fusion of remote sensing images with different spatial and temporal resolutions is needed for diverse Earth observation applications. A small number of spatiotemporal fusion methods that use sparse representation appear to be more promising than weighted- and unmixing-based methods in reflecting abruptly changing terrestrial content. However, none of the existing dictionary-based fusion methods consider the downsampling process explicitly, which is the degradation and sparse observation from high-resolution images to the corresponding low-resolution images. In this paper, the downsampling process is described explicitly under the framework of compressed sensing for reconstruction. With the coupled dictionary to constrain the similarity of sparse coefficients, a new dictionary-based spatiotemporal fusion method is built and named compressed sensing for spatiotemporal fusion, for the spatiotemporal fusion of remote sensing images. To deal with images with a high-resolution difference, typically Landsat-7 and Moderate Resolution Imaging Spectrometer (MODIS), the proposed model is performed twice to shorten the gap between the small block size and the large resolution rate. In the experimental procedure, the near-infrared, red, and green bands of Landsat-7 and MODIS are fused with root mean square errors to check the prediction accuracy. It can be concluded from the experiment that the proposed methods can produce higher quality than five state-of-the-art methods, which prove the feasibility of incorporating the downsampling process in the spatiotemporal model under the framework of compressed sensing.

[1]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Hao Wu,et al.  Double Constrained NMF for Hyperspectral Unmixing , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Mingquan Wu,et al.  Use of MODIS and Landsat time series data to generate high-resolution temporal synthetic Landsat data using a spatial and temporal reflectance fusion model , 2012 .

[4]  Yunliang Chen,et al.  Mining association rules in big data with NGEP , 2014, Cluster Computing.

[5]  Xiaoqiang Lu,et al.  MR image super-resolution via manifold regularized sparse learning , 2015, Neurocomputing.

[6]  Yun Zhang,et al.  METHODS FOR IMAGE FUSION QUALITY ASSESSMENT - A REVIEW, COMPARISON AND ANALYSIS , 2008 .

[7]  Xuelong Li,et al.  Intrinsic images using optimization , 2011, CVPR 2011.

[8]  Yi Yu,et al.  Spatial-Aware Collaborative Representation for Hyperspectral Remote Sensing Image Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[9]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[10]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Xuelong Li,et al.  Manifold Regularized Sparse NMF for Hyperspectral Unmixing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Xiangtao Zheng,et al.  Discovering Diverse Subset for Unsupervised Hyperspectral Band Selection , 2017, IEEE Transactions on Image Processing.

[13]  Bo Du,et al.  Target detection based on a dynamic subspace , 2014, Pattern Recognit..

[14]  Xuelong Li,et al.  Exposure Fusion Using Boosting Laplacian Pyramid , 2014, IEEE Transactions on Cybernetics.

[15]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[16]  Bo Huang,et al.  Spatiotemporal Reflectance Fusion via Sparse Representation , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Liangpei Zhang,et al.  An Integrated Framework for the Spatio–Temporal–Spectral Fusion of Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Deyu Meng,et al.  Spatial and Temporal Image Fusion via Regularized Spatial Unmixing , 2015, IEEE Geoscience and Remote Sensing Letters.

[19]  Pingkun Yan,et al.  Alternatively Constrained Dictionary Learning For Image Superresolution , 2014, IEEE Transactions on Cybernetics.

[20]  Baojun Zhao,et al.  Fast and Accurate Spatiotemporal Fusion Based Upon Extreme Learning Machine , 2016, IEEE Geoscience and Remote Sensing Letters.

[21]  Xueming Qian,et al.  Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised Learning , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Baojun Zhao,et al.  Spatiotemporal reflectance fusion based on location regularized sparse representation , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[23]  Albert Y. Zomaya,et al.  Remote sensing big data computing: Challenges and opportunities , 2015, Future Gener. Comput. Syst..

[24]  Xiangtao Zheng,et al.  Remote Sensing Scene Classification by Unsupervised Representation Learning , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Jian Wang,et al.  Modeling and simulation for natural disaster contingency planning driven by high-resolution remote sensing images , 2014, Future Gener. Comput. Syst..

[26]  Joanne C. White,et al.  A new data fusion model for high spatial- and temporal-resolution mapping of forest disturbance based on Landsat and MODIS , 2009 .

[27]  Yulong Wang,et al.  Sparse Coding From a Bayesian Perspective , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Xiang Li,et al.  On the study of fusion techniques for bad geological remote sensing image , 2015, J. Ambient Intell. Humaniz. Comput..

[29]  Michael A. Lefsky,et al.  A flexible spatiotemporal method for fusing satellite images with different resolutions , 2016 .

[30]  Bo Du,et al.  A Discriminative Metric Learning Based Anomaly Detection Method , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[31]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[32]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Xiangtao Zheng,et al.  Joint Dictionary Learning for Multispectral Change Detection , 2017, IEEE Transactions on Cybernetics.

[34]  Xiaolin Zhu,et al.  An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions , 2010 .

[35]  Bo Huang,et al.  Generating High Spatiotemporal Resolution Land Surface Temperature for Urban Heat Island Monitoring , 2013, IEEE Geoscience and Remote Sensing Letters.

[36]  Peijuan Wang,et al.  Fusing Landsat and MODIS Data for Vegetation Monitoring , 2015, IEEE Geoscience and Remote Sensing Magazine.

[37]  Xiaoqiang Lu,et al.  Image quality assessment: A sparse learning way , 2015, Neurocomputing.

[38]  Bo Huang,et al.  Spatiotemporal Satellite Image Fusion Through One-Pair Image Learning , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Liangpei Zhang,et al.  An Error-Bound-Regularized Sparse Coding for Spatiotemporal Reflectance Fusion , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Yong Wang,et al.  Improving the performance of GIS polygon overlay computation with MapReduce for spatial big data processing , 2015, Cluster Computing.

[41]  Lizhe Wang,et al.  Spatiotemporal Fusion of Remote Sensing Images with Structural Sparsity and Semi-Coupled Dictionary Learning , 2016, Remote. Sens..

[42]  Mathew R. Schwaller,et al.  On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectance , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Xiangtao Zheng,et al.  Hyperspectral Image Superresolution by Transfer Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  Gang Liu,et al.  Decomposition tree: a spatio-temporal indexing method for movement big data , 2015, Cluster Computing.

[46]  Ke Lu,et al.  Nonlocal Low-Rank-Based Compressed Sensing for Remote Sensing Image Reconstruction , 2016, IEEE Geoscience and Remote Sensing Letters.

[47]  Xiaohui Huang,et al.  A scalable and fast OPTICS for clustering trajectory big data , 2015, Cluster Computing.

[48]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.