iPiano-Net: Nonconvex optimization inspired multi-scale reconstruction network for compressed sensing

Abstract Compressed sensing (CS) aims to precisely reconstruct the original signal from under-sampled measurements, which is a typical ill-posed problem. Solving such a problem is challenging and generally needs to incorporate suitable priors about the underlying signals. Traditionally, these priors are hand-crafted and the corresponding approaches generally have limitations in expressive capacity. In this paper, a nonconvex optimization inspired multi-scale reconstruction network is developed for block-based CS, abbreviated as iPiano-Net, by unfolding the classic iPiano algorithm. In iPiano-Net, a block-wise inertial gradient descent interleaves with an image-level network-inducing proximal mapping to exploit the local block and global content information alternately. Therein, network-inducing proximal operators can be adaptively learned in each module, which can efficiently characterize image priors and improve the modeling capacity of iPiano-Net. Such learned image-level priors can suppress blocky artifacts and noises/corruptions while preserving the global information. Different from existing discriminative CS reconstruction models trained with specific measurement ratios, an effective single model is learned to handle CS reconstruction with several measurement ratios even the unseen ones. Experimental results demonstrate that the proposed approach is substantially superior to previous CS methods in terms of Peak Signal to Noise Ratio (PSNR) and visual quality, especially at low measurement ratios. Meanwhile, it is robust to noise while maintaining comparable execution speed.

[1]  Ehsan Yazdian,et al.  Distributed compressed sensing for despeckling of SAR images , 2018, Digit. Signal Process..

[2]  Yongdong Zhang,et al.  DR2-Net: Deep Residual Reconstruction Network for Image Compressive Sensing , 2017, Neurocomputing.

[3]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[4]  Baoshun Shi,et al.  Multi-scale Cross-path Concatenation Residual Network for Poisson denoising , 2019, IET Image Process..

[5]  Soma Biswas,et al.  Robust image retrieval by cascading a deep quality assessment network , 2020, Signal Process. Image Commun..

[6]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[7]  Marios Savvides,et al.  Proximal Splitting Networks for Image Restoration , 2019, ICIAR.

[8]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[9]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[10]  James E. Fowler,et al.  Block compressed sensing of images using directional transforms , 2009, ICIP.

[11]  Pavan Turaga,et al.  Convolutional Neural Networks for Noniterative Reconstruction of Compressively Sensed Images , 2017, IEEE Transactions on Computational Imaging.

[12]  Guangming Shi,et al.  ROI-CSNet: Compressive sensing network for ROI-aware image recovery , 2019, Signal Process. Image Commun..

[13]  Ye Tian,et al.  Coded diffraction imaging via double sparse regularization model , 2018, Digit. Signal Process..

[14]  James E. Fowler,et al.  Block-Based Compressed Sensing of Images and Video , 2012, Found. Trends Signal Process..

[15]  Richard G. Baraniuk,et al.  Learned D-AMP: Principled Neural Network based Compressive Image Recovery , 2017, NIPS.

[16]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[17]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[18]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[19]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[20]  Wen Gao,et al.  Image Compressive Sensing Recovery via Collaborative Sparsity , 2012, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[21]  Yi Sun,et al.  A deep learning method for image super-resolution based on geometric similarity , 2019, Signal Process. Image Commun..

[22]  Peixian Zhuang,et al.  Compressed Sensing MRI via a Multi-scale Dilated Residual Convolution Network , 2019, Magnetic resonance imaging.

[23]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[24]  Feng Jiang,et al.  Image Compressed Sensing Using Convolutional Neural Network , 2020, IEEE Transactions on Image Processing.

[25]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[26]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[27]  Thomas Brox,et al.  iPiano: Inertial Proximal Algorithm for Nonconvex Optimization , 2014, SIAM J. Imaging Sci..

[28]  Hong Chen,et al.  Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems , 1995, IEEE Trans. Neural Networks.

[29]  S. K. Zavriev,et al.  Heavy-ball method in nonconvex optimization problems , 1993 .

[30]  Lei Zhang,et al.  Waterloo Exploration Database: New Challenges for Image Quality Assessment Models , 2017, IEEE Transactions on Image Processing.

[31]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[32]  Aggelos K. Katsaggelos,et al.  Deep fully-connected networks for video compressive sensing , 2016, Digit. Signal Process..

[33]  Xinbo Gao,et al.  Fusion global and local deep representations with neural attention for aesthetic quality assessment , 2019, Signal Process. Image Commun..

[34]  Lei Zhang,et al.  Image reconstruction with locally adaptive sparsity and nonlocal robust regularization , 2012, Signal Process. Image Commun..

[35]  Richard G. Baraniuk,et al.  From Denoising to Compressed Sensing , 2014, IEEE Transactions on Information Theory.

[36]  Anhong Wang,et al.  DCSN-Cast: Deep compressed sensing network for wireless video multicast , 2019, Signal Process. Image Commun..

[37]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[38]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[39]  Ye Tian,et al.  FASPR: A fast sparse phase retrieval algorithm via the epigraph concept , 2018, Digit. Signal Process..