Super-resolution of hyperspectral image via superpixel-based sparse representation

Abstract In this paper, a novel superpixel-based sparse representation (SSR) model is proposed for hyperspectral image (HSI) super-resolution. Specifically, given a HSI with low spatial resolution and a multispectral image (MSI) with high spatial resolution, the proposed SSR approach first learns a spectral dictionary from HSI and constructs a transformed dictionary corresponding to MSI. Then, the SSR method clusters the MSI into superpixels, whose shape and size can be adaptively adjusted according to the local structures. Since pixels within each superpixel have strong similarities, the SSR method simultaneously decomposes them on the transformed dictionary to generate the corresponding fractional abundance coefficient matrix, which can exploit the similarities within the superpixel to improve the sparse decomposition. Finally, the high resolution hyperspectral image can be reconstructed with the obtained fractional abundance coefficient matrix. Experimental results show that the proposed approach is superior to some well-known HSI super-resolution methods.

[1]  Huan Liu,et al.  Sample-screening MKL method via boosting strategy for hyperspectral image classification , 2016, Neurocomputing.

[2]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[3]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[4]  Zongben Xu,et al.  Spatial and Spectral Image Fusion Using Sparse Matrix Factorization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Qian Du,et al.  Collaborative Representation for Hyperspectral Anomaly Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Rama Chellappa,et al.  Tracking via object reflectance using a hyperspectral video camera , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[7]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[8]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Jintao Li,et al.  Image reconstruction algorithm from compressed sensing measurements by dictionary learning , 2015, Neurocomputing.

[10]  P. Gamba,et al.  Exploiting spectral and spatial information for classifying hyperspectral data in urban areas , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[11]  Yasuyuki Matsushita,et al.  High-resolution hyperspectral imaging via matrix factorization , 2011, CVPR 2011.

[12]  M. F. Baumgardner,et al.  220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pine Test Site 3 , 2015 .

[13]  Qian Du,et al.  Joint Within-Class Collaborative Representation for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Lin Li,et al.  Spectral-spatial hyperspectral image ensemble classification via joint sparse representation , 2016, Pattern Recognit..

[15]  Qi Wang,et al.  Hyperspectral Image Classification via Multitask Joint Sparse Representation and Stepwise MRF Optimization , 2016, IEEE Transactions on Cybernetics.

[16]  Yi Ma,et al.  A non-negative sparse promoting algorithm for high resolution hyperspectral imaging , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Qi Wang,et al.  Hyperspectral Band Selection by Multitask Sparsity Pursuit , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Bo Du,et al.  Joint Sparse Representation and Multitask Learning for Hyperspectral Target Detection , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[20]  Qi Wang,et al.  High quality image resizing , 2014, Neurocomputing.

[21]  Liangpei Zhang,et al.  Joint Collaborative Representation With Multitask Learning for Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Yanfeng Gu,et al.  Hyperspectral target detection via exploiting spatial-spectral joint sparsity , 2015, Neurocomputing.

[23]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[24]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Huan Wang,et al.  On the local correctness of ℓ1-minimization for dictionary learning , 2011, 2014 IEEE International Symposium on Information Theory.

[27]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[28]  Trac D. Tran,et al.  Simultaneous Joint Sparsity Model for Target Detection in Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[29]  Qi Wang,et al.  Learning to resize image , 2014, Neurocomputing.

[30]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification via Multiple-Feature-Based Adaptive Sparse Representation , 2017, IEEE Transactions on Instrumentation and Measurement.

[31]  Kaihua Zhang,et al.  Spatio-spectral fusion of satellite images based on dictionary-pair learning , 2014, Inf. Fusion.

[32]  Liangpei Zhang,et al.  A Nonlocal Weighted Joint Sparse Representation Classification Method for Hyperspectral Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Ajmal S. Mian,et al.  Sparse Spatio-spectral Representation for Hyperspectral Image Super-resolution , 2014, ECCV.

[34]  Bo Du,et al.  Hyperspectral signal unmixing based on constrained non-negative matrix factorization approach , 2016, Neurocomputing.

[35]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.