Patch-Based Residual Networks for Compressively Sensed Hyperspectral Images Restruction

Most traditional compressive sensing (CS) reconstruction methods suffer from the intensive computation caused by iterations. This paper aims at presenting a non-iterative algorithm to reconstruct hyperspectral images (HSI) from patch-based compressively sensed measurements. Our method contains two residual convolutional neural networks. One is reconstruction network for compressive sensing reconstruction and the other is deblocking network for removing the blocky effect, which is caused by patch-based sampling. The reconstruction network can efficiently reconstruct all the bands of HSI jointly, thus the spectral correlation is well preserved. In addition, the deblock performance is enhanced by combining more patches into a larger patch in the deblocking network. Experimental results verify that our method outperforms the state-of-the-art compressive sensing reconstruction methods with patch-based CS measurement.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[3]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[4]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Yin Zhang,et al.  An efficient augmented Lagrangian method with applications to total variation minimization , 2013, Computational Optimization and Applications.

[7]  Richard G. Baraniuk,et al.  From Denoising to Compressed Sensing , 2014, IEEE Transactions on Information Theory.

[8]  Bo Yan,et al.  An efficient deep convolutional neural networks model for compressed image deblocking , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[9]  Ali Mousavi,et al.  Learning to invert: Signal recovery via Deep Convolutional Networks , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Pavan K. Turaga,et al.  ReconNet: Non-Iterative Reconstruction of Images from Compressively Sensed Measurements , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).