Hyperspectral image joint super-resolution via implicit neural representation

Hyperspectral image (HSI) joint super-resolution (SR) in both spatial and spectral dimensions is an area of increasing interest in HSI processing. Although recent advances in deep learning (DL) frameworks have greatly improved the performance of joint SR reconstruction, existing methods learn discrete representations of HSI, ignoring real-world signals' continuous nature. In this paper, we propose a joint SR method based on implicit neural representation (INR), which learns local continuous representations of high spatial resolution hyperspectral images from the discrete inputs. Experiments on joint SR demonstrate that our method can achieve superior performance in comparison with state-of-the-art methods.

[1]  L. Gool,et al.  MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstruction , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Jiayi Ma,et al.  Multi-Task Interaction Learning for Spatiospectral Image Super-Resolution , 2022, IEEE Transactions on Image Processing.

[3]  Jiayi Ma,et al.  Deep Unfolding Network for Spatiospectral Image Super-Resolution , 2022, IEEE Transactions on Computational Imaging.

[4]  Xuelong Li,et al.  Exploring the Relationship Between 2D/3D Convolution for Hyperspectral Image Super-Resolution , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Qi Wang,et al.  Mixed 2D/3D Convolutional Network for Hyperspectral Image Super-Resolution , 2020, Remote. Sens..

[6]  Rui Song,et al.  Adaptive Weighted Attention Network with Camera Spectral Sensitivity Prior for Spectral Reconstruction from RGB Images , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Xu Li,et al.  Spatial and Spectral Joint Super-Resolution Using Convolutional Neural Network , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Tieniu Tan,et al.  Meta-SR: A Magnification-Arbitrary Network for Super-Resolution , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[10]  Colm P. O'Donnell,et al.  Hyperspectral imaging – an emerging process analytical tool for food quality and safety control , 2007 .

[11]  A F Goetz,et al.  Imaging Spectrometry for Earth Remote Sensing , 1985, Science.