Hyperspectral image super-resolution extending: An effective fusion based method without knowing the spatial transformation matrix

Hyperspectral image (HSI) super-resolution, a technique to obtain higher (often spatial) resolution image from the original image, has been extensively studied and applied to lots of fields such as computer vision, remote sensing, etc. Though fusion based method has achieved state-of-the-art result, it always assume the spatial transformation matrix is given in advance, whereas such a matrix is actually unknown in reality. An unsuitable given matrix will deteriorate the superresolution result greatly. To address this issue, we propose a novel fusion based HSI super-resolution method without knowing the spatial transformation matrix. Specifically, we incorporate super-resolution and spatial transformation matrix estimation into a unified framework. We alternately estimate the matrix and the higher spatial resolution HSI. We find that without given the spatial transformation matrix, the proposed method can obtain more accurate reconstruction result compared with other competing methods. Experimental results demonstrate the effectiveness of the proposed method.

[1]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[2]  Ayan Chakrabarti,et al.  Statistics of real-world hyperspectral images , 2011, CVPR 2011.

[3]  José M. Bioucas-Dias,et al.  A variable splitting augmented Lagrangian approach to linear spectral unmixing , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[4]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[5]  Ajmal S. Mian,et al.  Bayesian sparse representation for hyperspectral image super resolution , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Wei Wei,et al.  Cluster Sparsity Field for Hyperspectral Imagery Denoising , 2016, ECCV.

[7]  Arif Mahmood,et al.  Hyperspectral Face Recognition using 3D-DCT and Partial Least Squares , 2013, BMVC.

[8]  Ajmal S. Mian,et al.  Sparse Spatio-spectral Representation for Hyperspectral Image Super-resolution , 2014, ECCV.

[9]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Konrad Schindler,et al.  HYPERSPECTRAL IMAGE FUSION , 2015 .

[12]  Wei Wei,et al.  Exploring Structured Sparsity by a Reweighted Laplace Prior for Hyperspectral Compressive Sensing , 2016, IEEE Transactions on Image Processing.

[13]  Wei Wei,et al.  Dictionary Learning for Promoting Structured Sparsity in Hyperspectral Compressive Sensing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Rob Heylen,et al.  Superresolution of hyperspectral images using spectral unmixing and sparse regularization , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[15]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[16]  Simon J. Godsill,et al.  Multiband Image Fusion Based on Spectral Unmixing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Yasuyuki Matsushita,et al.  High-resolution hyperspectral imaging via matrix factorization , 2011, CVPR 2011.

[18]  Zhi Han,et al.  Super-resolution reconstruction of hyperspectral images via low rank tensor modeling and total variation regularization , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[19]  Jocelyn Chanussot,et al.  Hyperspectral Super-Resolution of Locally Low Rank Images From Complementary Multisource Data , 2014, IEEE Transactions on Image Processing.

[20]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[21]  Konrad Schindler,et al.  Hyperspectral Super-Resolution by Coupled Spectral Unmixing , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).