Deep-learning-based hyperspectral recovery from a single RGB image.

Commercial hyperspectral imaging devices are expensive and tend to suffer from the degradation of spatial, spectral, or temporal resolution. To address these problems, we propose a deep-learning-based method to recover hyperspectral images from a single RGB image. The proposed method learns an end-to-end mapping between an RGB image and corresponding hyperspectral images. Moreover, a customized loss function is proposed to boost the performance. Experimental results on a variety of hyperspectral datasets demonstrate that our proposed method outperforms several state-of-the-art methods in terms of both quantitative measurements and perceptual quality.

[1]  Gozde Bozdagi Akar,et al.  EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Michael W. Kudenov,et al.  Review of snapshot spectral imaging technologies , 2013, Optics and Precision Engineering.

[3]  Henry Arguello,et al.  Compressive Coded Aperture Spectral Imaging: An Introduction , 2014, IEEE Signal Processing Magazine.

[4]  Junchao Zhang,et al.  PFNet: an unsupervised deep network for polarization image fusion. , 2020, Optics letters.

[5]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[6]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[7]  Luca Poletto,et al.  A System for 3D Modeling Frescoed Historical Buildings with Multispectral Texture Information , 2006, Machine Vision and Applications.

[8]  Eustace L. Dereniak,et al.  Hyperspectral imaging for astronomy and space surviellance , 2004, SPIE Optics + Photonics.

[9]  Bruce J. Tromberg,et al.  Face Recognition in Hyperspectral Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..