Bayesian fusion of multispectral and hyperspectral images with unknown sensor spectral response

This paper studies a new Bayesian algorithm for fusing hyperspectral and multispectral images. The observed images are related to the high spatial resolution hyperspectral image to be recovered through physical degradations, e.g., spatial and spectral blurring and/or sub-sampling defined by the sensor characteristics. In this work, we assume that the spectral response of the multispectral sensor is unknown as it may not be available in practical applications. The resulting fusion problem is formulated within a Bayesian estimation framework, which is very convenient to model the uncertainty regarding the multispectral sensor characteristics and the scene to be estimated. The high spatial resolution hyperspectral image is then inferred from its posterior distribution. More precisely, to compute the Bayesian estimators associated with this posterior, a Markov chain Monte Carlo algorithm is proposed to generate samples asymptotically distributed according to the distribution of interest. Simulation results demonstrate the efficiency of the proposed fusion method when compared with several state-of-the-art fusion techniques.

[1]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[2]  Guangyi Chen,et al.  Super-Resolution of Hyperspectral Imagery Using Complex Ridgelet Transform , 2012, Int. J. Wavelets Multiresolution Inf. Process..

[3]  Nikolas P. Galatsanos,et al.  Stochastic methods for joint registration, restoration, and interpolation of multiple undersampled images , 2006, IEEE Transactions on Image Processing.

[4]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Aggelos K. Katsaggelos,et al.  Bayesian and regularization methods for hyperparameter estimation in image restoration , 1999, IEEE Trans. Image Process..

[6]  A. Dawid.  Some matrix-variate distribution theory: Notational considerations and a Bayesian application , 1981 .

[7]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Russell C. Hardie,et al.  MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor , 2004, IEEE Transactions on Image Processing.

[9]  Nebiye Musaoglu,et al.  Merging hyperspectral and panchromatic image data: qualitative and quantitative analysis , 2009 .

[10]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[11]  Bin Wang,et al.  Fusion of Hyperspectral and Multispectral Images: A Novel Framework Based on Generalization of Pan-Sharpening Methods , 2014, IEEE Geoscience and Remote Sensing Letters.

[12]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[13]  J. Engels,et al.  Pansharpening of Hyperspectral Images in Urban Areas , 2012 .

[14]  Jean-Yves Tourneret,et al.  Bayesian fusion of hyperspectral and multispectral images , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Josiane Zerubia,et al.  An adaptive Gaussian model for satellite image deblurring , 2004, IEEE Transactions on Image Processing.

[16]  Shaohui Mei,et al.  Unmixing approach for hyperspectral data resolution enhancement using high resolution multispectral image with unknown spectral response function , 2013, 2013 IEEE 8th Conference on Industrial Electronics and Applications (ICIEA).

[17]  Jean-Yves Tourneret,et al.  Bayesian Fusion of Multi-Band Images , 2013, IEEE Journal of Selected Topics in Signal Processing.

[18]  Mathilde Bouriga,et al.  Estimation of covariance matrices based on hierarchical inverse-Wishart priors , 2011, 1106.3203.

[19]  R. Molina,et al.  Variational posterior distribution approximation in Bayesian super resolution reconstruction of multispectral images , 2008 .

[20]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[21]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[22]  Peter J. Liu,et al.  Using Gaussian process regression to denoise images and remove artefacts from microarray data , 2007 .

[23]  Aggelos K. Katsaggelos,et al.  A survey of classical methods and new trends in pansharpening of multispectral images , 2011, EURASIP J. Adv. Signal Process..

[24]  Junta de Regulación,et al.  " " > , 2007 .

[25]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  David J. Fleming.  Effect of relative spectral response on multi-spectral measurements and NDVI from different remote sensing systems , 2006 .

[27]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Pramod K. Varshney,et al.  An Image Fusion Approach Based on Markov Random Fields , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Dimitris G. Manolakis,et al.  Detection algorithms for hyperspectral imaging applications , 2002, IEEE Signal Process. Mag..

[30]  Yifan Zhang,et al.  Noise-Resistant Wavelet-Based Bayesian Fusion of Multispectral and Hyperspectral Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.