Spatio-Temporal Series Remote Sensing Image Prediction Based on Multi-Dictionary Bayesian Fusion

Contradictions in spatial resolution and temporal coverage emerge from earth observation remote sensing images due to limitations in technology and cost. Therefore, how to combine remote sensing images with low spatial yet high temporal resolution as well as those with high spatial yet low temporal resolution to construct images with both high spatial resolution and high temporal coverage has become an important problem called spatio-temporal fusion problem in both research and practice. A Multi-Dictionary Bayesian Spatio-Temporal Reflectance Fusion Model (MDBFM) has been proposed in this paper. First, multiple dictionaries from regions of different classes are trained. Second, a Bayesian framework is constructed to solve the dictionary selection problem. A pixel-dictionary likehood function and a dictionary-dictionary prior function are constructed under the Bayesian framework. Third, remote sensing images before and after the middle moment are combined to predict images at the middle moment. Diverse shapes and textures information is learned from different landscapes in multi-dictionary learning to help dictionaries capture the distinctions between regions. The Bayesian framework makes full use of the priori information while the input image is classified. The experiments with one simulated dataset and two satellite datasets validate that the MDBFM is highly effective in both subjective and objective evaluation indexes. The results of MDBFM show more precise details and have a higher similarity with real images when dealing with both type changes and phenology changes.

[1]  Joanne C. White,et al.  Generation of dense time series synthetic Landsat data through data blending with MODIS using a spatial and temporal adaptive reflectance fusion model. , 2009 .

[2]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[3]  F. Y. Wu.  The Potts model , 1982 .

[4]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[5]  Xiaolin Zhu,et al.  An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions , 2010 .

[6]  Bo Huang,et al.  Generating High Spatiotemporal Resolution Land Surface Temperature for Urban Heat Island Monitoring , 2013, IEEE Geoscience and Remote Sensing Letters.

[7]  Y. Knyazikhin,et al.  Effect of foliage spatial heterogeneity in the MODIS LAI and FPAR algorithm over broadleaf forests , 2003 .

[8]  Martha C. Anderson,et al.  A data fusion approach for mapping daily evapotranspiration at field scale , 2013 .

[9]  K. Beurs,et al.  Evaluation of Landsat and MODIS data fusion products for analysis of dryland forest phenology , 2012 .

[10]  Mathew R. Schwaller,et al.  On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectance , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Claudia Notarnicola,et al.  Remote Sensing Snow Cover Maps from Modis Images at 250 M Resolution, Part 1: Algorithm Description , 2022 .

[12]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[13]  P. Shi,et al.  Improving the normalized difference built-up index to map urban built-up areas using a semiautomatic segmentation approach , 2009 .

[14]  J. Moreno,et al.  Seasonal variations of leaf area index of agricultural fields retrieved from Landsat data , 2008 .

[15]  Michael A. Lefsky,et al.  A flexible spatiotemporal method for fusing satellite images with different resolutions , 2016 .

[16]  Bo Huang,et al.  Spatiotemporal Reflectance Fusion via Sparse Representation , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Damien Arvor,et al.  Classification of MODIS EVI time series for crop mapping in the state of Mato Grosso, Brazil , 2011 .

[18]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[19]  Joanne C. White,et al.  A new data fusion model for high spatial- and temporal-resolution mapping of forest disturbance based on Landsat and MODIS , 2009 .

[20]  F. Gao,et al.  Generating daily land surface temperature at Landsat resolution by fusing Landsat and MODIS data , 2014 .

[21]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[23]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[24]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[25]  Jin Chen,et al.  Spatiotemporal reflectance blending in a wetland environment , 2015, Int. J. Digit. Earth.

[26]  T Sree Sharmila,et al.  Multi-resolution spatial incorporation for MODIS and LANDSAT image fusion using CSSTARFM , 2016, 2016 IEEE Region 10 Conference (TENCON).