Spatio-temporal resolution enhancement for cloudy thermal sequences

ABSTRACT Many applications require remotely sensed brightness temperature (BT) data acquired with high temporal and spatial resolutions. In this regard, a viable strategy to overtake the physical limitations of space-borne sensors to achieve these data relies on fusing low temporal but high spatial resolution (HSR) data with high temporal but low spatial resolution data. The most promising methods rely on the fusion of spatially interpolated high temporal resolution data with temporally interpolated HSR data. However, the unavoidable presence of cloud masses in the acquired image sequences is often neglected, compromising the functionality and/or the effectiveness of the most of these fusion algorithms. To overcome this problem, a framework combining techniques of temporal smoothing and spatial enhancement is proposed to estimate surface BTs with high spatial and high temporal resolutions even when cloud masses corrupt the scene. Numerical results using real thermal data acquired by the SEVIRI sensor show the ability of the proposed approach to reach better performance than techniques based on either only interpolation or only spatial sharpening, even dealing with missing data due to the presence of cloud masses.

[1]  Paolo Addesso,et al.  Batch Methods for Resolution Enhancement of TIR Image Sequences , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[3]  Terry A. Howell,et al.  A review of downscaling methods for remote sensing-based irrigation management: part I , 2012, Irrigation Science.

[4]  Wenyu Liu,et al.  Sharpening Thermal Imageries: A Generalized Theoretical Framework From an Assimilation Perspective , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Ning Wang,et al.  Evaluation of six land-surface diurnal temperature cycle models using clear-sky in situ and satellite data , 2012 .

[6]  K. Oštir,et al.  Downscaling land surface temperature for urban heat island diurnal cycle analysis , 2012 .

[7]  William P. Kustas,et al.  A vegetation index based technique for spatial sharpening of thermal imagery , 2007 .

[8]  John B. Moore,et al.  Optimal State Estimation , 2006 .

[9]  Qihao Weng Thermal infrared remote sensing for urban climate and environmental studies: Methods, applications, and trends , 2009 .

[10]  Paolo Addesso,et al.  Robustified smoothing for enhancement of thermal image sequences affected by clouds , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[11]  F. Göttsche,et al.  Influence of Land Surface Parameters and Atmosphere on METEOSAT Brightness Temperatures and Generation of Land Surface Temperature Maps by Temporally and Spatially Interpolating Atmospheric Correction , 2001 .

[12]  Mikhail F. Kanevski,et al.  Support-Based Implementation of Bayesian Data Fusion for Spatial Enhancement: Applications to ASTER Thermal Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[13]  Luciano Alparone,et al.  Bi-cubic interpolation for shift-free pan-sharpening , 2013 .

[14]  Guanrong Chen,et al.  Introduction to random signals and applied Kalman filtering, 2nd edn. Robert Grover Brown and Patrick Y. C. Hwang, Wiley, New York, 1992. ISBN 0‐471‐52573‐1, 512 pp., $62.95. , 1992 .

[15]  Y. Kerr,et al.  Disaggregation of MODIS surface temperature over an agricultural area using a time series of Formosat-2 images , 2010 .

[16]  Jocelyn Chanussot,et al.  Contrast and Error-Based Fusion Schemes for Multispectral Image Pansharpening , 2014, IEEE Geoscience and Remote Sensing Letters.

[17]  Paolo Addesso,et al.  Enhancing TIR image resolution via Interacting Sequential Bayesian Estimation , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[18]  David Q. Mayne,et al.  A solution of the smoothing problem for linear dynamic systems , 1966, Autom..

[19]  P. Addesso,et al.  A Class of Cloud Detection Algorithms Based on a MAP-MRF Approach in Space and Time , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[21]  I. D. Feis,et al.  Kalman filter physical retrieval of surface emissivity and temperature from geostationary infrared radiances , 2013 .

[22]  J. Junkins,et al.  Optimal Estimation of Dynamic Systems , 2004 .

[23]  Luciano Alparone,et al.  Spatial resolution enhancement of ASTER thermal bands , 2005, SPIE Remote Sensing.

[24]  J. Muller,et al.  Terrestrial remote sensing science and algorithms planned for EOS/MODIS , 1994 .

[25]  Mohamed-Jalal Fadili,et al.  The Undecimated Wavelet Decomposition and its Reconstruction , 2007, IEEE Transactions on Image Processing.

[26]  Paolo Addesso,et al.  Enhancing TIR image resolution via bayesian smoothing for IRRISAT irrigation management project , 2013, Remote Sensing.

[27]  Robert A. Schowengerdt,et al.  The Nature of Remote Sensing , 2007 .

[28]  Paolo Addesso,et al.  Sequential Bayesian Methods for Resolution Enhancement of TIR Image Sequences , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Van Trees,et al.  Detection, Estimation, and Modulation Theory. Part 1 - Detection, Estimation, and Linear Modulation Theory. , 1968 .

[30]  J. A. Parker,et al.  Comparison of Interpolating Methods for Image Resampling , 1983, IEEE Transactions on Medical Imaging.

[31]  D. Roberts,et al.  Using multiple endmember spectral mixture analysis to retrieve subpixel fire properties from MODIS , 2008 .

[32]  Max A. Viergever,et al.  Quantitative evaluation of convolution-based methods for medical image interpolation , 2001, Medical Image Anal..

[33]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[34]  L. Alparone,et al.  GENERALISED LAPLACIAN PYRAMID-BASED FUSION OF MS + P IMAGE DATA WITH SPECTRAL DISTORTION MINIMISATION , 2002 .

[35]  Terry A. Howell,et al.  A review of potential image fusion methods for remote sensing-based irrigation management: part II , 2012, Irrigation Science.

[36]  I. F. Trigo,et al.  Kalman filter physical retrieval of surface emissivity and temperature from SEVIRI infrared channels: a validation and intercomparison study , 2015 .

[37]  Allard J. W. de Wit,et al.  Crop growth modelling and crop yield forecasting using satellite-derived meteorological inputs , 2008, Int. J. Appl. Earth Obs. Geoinformation.

[38]  Paolo Addesso,et al.  A sequential Bayesian procedure for integrating heterogeneous remotely sensed data for irrigation management , 2012, Remote Sensing.

[39]  Joanne C. White,et al.  A new data fusion model for high spatial- and temporal-resolution mapping of forest disturbance based on Landsat and MODIS , 2009 .

[40]  Martha C. Anderson,et al.  Use of Landsat thermal imagery in monitoring evapotranspiration and managing water resources , 2012 .

[41]  G. Meehl Influence of the land surface in the Asian summer monsoon , 1994 .

[42]  Zoubin Ghahramani,et al.  An Introduction to Hidden Markov Models and Bayesian Networks , 2001, Int. J. Pattern Recognit. Artif. Intell..

[43]  Richard G. Allen,et al.  Satellite-Based Energy Balance for Mapping Evapotranspiration with Internalized Calibration (METRIC)—Model , 2007 .

[44]  Martha C. Anderson,et al.  Estimating subpixel surface temperatures and energy fluxes from the vegetation index-radiometric temperature relationship , 2003 .

[45]  D. Fraser,et al.  The optimum linear smoother as a combination of two optimum linear filters , 1969 .

[46]  Damien Garcia,et al.  Robust smoothing of gridded data in one and higher dimensions with missing values , 2010, Comput. Stat. Data Anal..

[47]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[48]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[49]  A. Gruen,et al.  Operational snow mapping using multitemporal Meteosat SEVIRI imagery , 2007 .

[50]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[51]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[52]  Julien Radoux,et al.  Bayesian Data Fusion for Adaptable Image Pansharpening , 2008, IEEE Transactions on Geoscience and Remote Sensing.