Infrared long-wave multispectral image reconstruction based on auto-encoder network

Due to the problems of long iteration time and poor image quality in the traditional infrared multispectral image reconstruction method based on compressed sensing(CS), an auto-encoders network based on residuals is proposed. Autoencoders are unsupervised neural networks where the output and input layers share the same number of nodes, and which can reconstruct its own inputs through encoder and decoder functions. using code decoding technique learn from real infrared multispectral image spectrum information, through the fast image reconstruction of auto-encoder, get high quality image. The performance of the method is verified by using multiple infrared multispectral images. The results show that the method has the advantages of high image processing efficiency and high spatial resolution. Compared with the traditional compressed sensing method, the auto-encoder network based on residuals has better effect on infrared multispectral image reconstruction.

[1]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Yunsong Li,et al.  Hyperspectral image reconstruction by deep convolutional neural network for classification , 2017, Pattern Recognit..

[4]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[6]  Jianjun Bai,et al.  High Efficient Deep Feature Extraction and Classification of Spectral-Spatial Hyperspectral Image Using Cross Domain Convolutional Neural Networks , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Himanshu Sharma,et al.  2D-3D CNN Based Architectures for Spectral Reconstruction from RGB Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[9]  Pavan Turaga,et al.  Convolutional Neural Networks for Noniterative Reconstruction of Compressively Sensed Images , 2017, IEEE Transactions on Computational Imaging.

[10]  Pierre Vandergheynst,et al.  Compressive Source Separation: Theory and Methods for Hyperspectral Imaging , 2012, IEEE Transactions on Image Processing.

[11]  Gang Wang,et al.  Spectral-spatial classification of hyperspectral image using autoencoders , 2013, 2013 9th International Conference on Information, Communications & Signal Processing.

[12]  Giljoo Nam,et al.  High-quality hyperspectral reconstruction using a spectral prior , 2017, ACM Trans. Graph..