COAST: COntrollable Arbitrary-Sampling NeTwork for Compressive Sensing

Recent deep network-based compressive sensing (CS) methods have achieved great success. However, most of them regard different sampling matrices as different independent tasks and need to train a specific model for each target sampling matrix. Such practices give rise to inefficiency in computing and suffer from poor generalization ability. In this paper, we propose a novel COntrollable Arbitrary-Sampling neTwork, dubbed COAST, to solve CS problems of arbitrary-sampling matrices (including unseen sampling matrices) with one single model. Under the optimization-inspired deep unfolding framework, our COAST exhibits good interpretability. In COAST, a random projection augmentation (RPA) strategy is proposed to promote the training diversity in the sampling space to enable arbitrary sampling, and a controllable proximal mapping module (CPMM) and a plug-and-play deblocking (PnP-D) strategy are further developed to dynamically modulate the network features and effectively eliminate the blocking artifacts, respectively. Extensive experiments on widely used benchmark datasets demonstrate that our proposed COAST is not only able to handle arbitrary sampling matrices with one single model but also to achieve state-of-the-art performance with fast speed.

[1]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[2]  Guang-Hong Chen,et al.  Dual energy CT using slow kVp switching acquisition and prior image constrained compressed sensing , 2010, Physics in medicine and biology.

[3]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[4]  Richard G. Baraniuk,et al.  Learned D-AMP: Principled Neural Network based Compressive Image Recovery , 2017, NIPS.

[5]  Guillermo Sapiro,et al.  Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization , 2009, IEEE Transactions on Image Processing.

[6]  Richard G. Baraniuk,et al.  From Denoising to Compressed Sensing , 2014, IEEE Transactions on Information Theory.

[7]  Lawrence Carin,et al.  Exploiting Structure in Wavelet-Based Bayesian Compressive Sensing , 2009, IEEE Transactions on Signal Processing.

[8]  Michael Zibulevsky,et al.  Block-based compressed sensing of images via deep learning , 2017, 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP).

[9]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[11]  Tzyy-Ping Jung,et al.  Compressed Sensing for Energy-Efficient Wireless Telemonitoring of Noninvasive Fetal ECG Via Block Sparse Bayesian Learning , 2012, IEEE Transactions on Biomedical Engineering.

[12]  Xun Xu,et al.  Fully-Convolutional Measurement Network for Compressive Sensing Image Reconstruction , 2017, Neurocomputing.

[13]  Aggelos K. Katsaggelos,et al.  Deep fully-connected networks for video compressive sensing , 2016, Digit. Signal Process..

[14]  Bernard Ghanem,et al.  ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[16]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[17]  Pavan K. Turaga,et al.  Rate-Adaptive Neural Networks for Spatial Multiplexers , 2018, ArXiv.

[18]  Wen Gao,et al.  Video Compressive Sensing Reconstruction via Reweighted Residual Sparsity , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Wen Gao,et al.  CREAM: CNN-REgularized ADMM Framework for Compressive-Sensed Image Reconstruction , 2018, IEEE Access.

[20]  Ali Bilgin,et al.  Compressed sensing using a Gaussian Scale Mixtures model in wavelet domain , 2010, 2010 IEEE International Conference on Image Processing.

[21]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[22]  Yin Zhang,et al.  An efficient augmented Lagrangian method with applications to total variation minimization , 2013, Computational Optimization and Applications.

[23]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[24]  Guangming Shi,et al.  Denoising Prior Driven Deep Neural Network for Image Restoration , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Zhihui Zhu,et al.  Online learning sensing matrix and sparsifying dictionary simultaneously for compressive sensing , 2017, Signal Process..

[27]  Jiwei Chen,et al.  Learning Memory Augmented Cascading Network for Compressed Sensing of Images , 2020, ECCV.

[28]  Seong Joon Oh,et al.  CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[29]  Richard G. Baraniuk,et al.  A deep learning approach to structured signal recovery , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[30]  Sundeep Rangan,et al.  AMP-Inspired Deep Networks for Sparse Linear Inverse Problems , 2016, IEEE Transactions on Signal Processing.

[31]  David Zhang,et al.  Simultaneous Fidelity and Regularization Learning for Image Restoration , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Andrea Farina,et al.  Adaptive Basis Scan by Wavelet Prediction for Single-Pixel Imaging , 2017, IEEE Transactions on Computational Imaging.

[33]  Yibo Xu,et al.  Compressed Domain Image Classification Using a Dynamic-Rate Neural Network , 2020, IEEE Access.

[34]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[35]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[36]  Jian Zhang,et al.  Improved total variation based image compressive sensing recovery by nonlocal regularization , 2012, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[37]  Feng Jiang,et al.  Scalable Convolutional Neural Network for Image Compressed Sensing , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Wuzhen Shi,et al.  Deep networks for compressed image sensing , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[39]  Feng Jiang,et al.  Image Compressed Sensing Using Convolutional Neural Network , 2020, IEEE Transactions on Image Processing.

[40]  Pavan K. Turaga,et al.  ReconNet: Non-Iterative Reconstruction of Images from Compressively Sensed Measurements , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Pavan Turaga,et al.  Convolutional Neural Networks for Noniterative Reconstruction of Compressively Sensed Images , 2017, IEEE Transactions on Computational Imaging.

[42]  Wen Gao,et al.  Image Compressive Sensing Recovery via Collaborative Sparsity , 2012, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[43]  Jian Zhang,et al.  Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization , 2014, Signal Process..

[44]  Symeon Chatzinotas,et al.  Application of Compressive Sensing in Cognitive Radio Communications: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[45]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[46]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[47]  Chun-Liang Li,et al.  One Network to Solve Them All — Solving Linear Inverse Problems Using Deep Projection Models , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[48]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[49]  Rebecca Willett,et al.  Neumann Networks for Linear Inverse Problems in Imaging , 2020, IEEE Transactions on Computational Imaging.

[50]  Wen Gao,et al.  Nonconvex Lp Nuclear Norm based ADMM Framework for Compressed Sensing , 2016, 2016 Data Compression Conference (DCC).

[51]  Bo Liu,et al.  Dual-Path Attention Network for Compressed Sensing Image Reconstruction , 2020, IEEE Transactions on Image Processing.

[52]  Wen Gao,et al.  Optimization-Inspired Compact Deep Compressive Sensing , 2020, IEEE Journal of Selected Topics in Signal Processing.

[53]  Guodong Guo,et al.  Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting , 2020, IEEE Transactions on Multimedia.