A novel multi-dictionary framework with global sensing matrix design for compressed sensing

Abstract In this paper, a new compressed sensing (CS) system is proposed to reduce computational burden of dictionary learning and improve reconstruction accuracy. The proposed CS system employs a novel framework which contains multiple dictionaries. In multi-dictionary framework, the whole training dataset is divided into multiple subdatasets for optimizing multiple dictionaries. Dictionary learning process can be accelerated due to the parallel computation and the reduction of training dataset size. Each dictionary can get an image (called snapshot) independently with the same measurements in the image reconstruction process. These snapshots will be fused to be one image with averaging strategy. In order to keep the measurement size of the proposed CS system same as that of traditional CS system and improve reconstruction accuracy, a new method of designing global sensing matrix for multi-dictionary framework is also explored. Experiments demonstrate the effectiveness of new framework and the method to design global sensing matrix. Compared with other CS systems, the proposed CS system shows a superior performance for real images.

[1]  Michael Elad,et al.  Optimized Projections for Compressed Sensing , 2007, IEEE Transactions on Signal Processing.

[2]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[3]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[4]  Saeid Sanei,et al.  A gradient-based alternating minimization approach for optimization of the measurement matrix in compressive sensing , 2012, Signal Process..

[5]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[6]  S. Sahoo,et al.  Dictionary Training for Sparse Representation as Generalization of K-Means Clustering , 2013, IEEE Signal Processing Letters.

[7]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[8]  Miguel R. D. Rodrigues,et al.  Projection Design for Statistical Compressive Sensing: A Tight Frame Based Approach , 2013, IEEE Transactions on Signal Processing.

[9]  Gang Li,et al.  Alternating Optimization of Sensing Matrix and Sparsifying Dictionary for Compressed Sensing , 2015, IEEE Transactions on Signal Processing.

[10]  Feng Wang,et al.  Selection order framework algorithm for compressed sensing , 2017, Signal Process..

[11]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[12]  Gaël Varoquaux,et al.  Dictionary Learning for Massive Matrix Factorization , 2016, ICML.

[13]  Zhihui Zhu,et al.  On joint optimization of sensing matrix and sparsifying dictionary for robust compressed sensing systems , 2018, Digit. Signal Process..

[14]  Zhihui Zhu,et al.  An efficient algorithm for designing projection matrix in compressive sensing based on alternating optimization , 2016, Signal Process..

[15]  Zhihui Zhu,et al.  Global Optimality in Low-Rank Matrix Optimization , 2017, IEEE Transactions on Signal Processing.

[16]  Huang Bai,et al.  A gradient-based approach to optimization of compressed sensing systems , 2017, Signal Process..

[17]  Kjersti Engan,et al.  Frame based signal compression using method of optimal directions (MOD) , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[18]  Guillermo Sapiro,et al.  Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization , 2009, IEEE Transactions on Image Processing.

[19]  Zhihui Zhu,et al.  On Projection Matrix Optimization for Compressive Sensing Systems , 2013, IEEE Transactions on Signal Processing.

[20]  Zhihui Zhu,et al.  An efficient method for robust projection matrix design , 2016, Signal Process..

[21]  Essa Yacoub,et al.  A 3D wavelet fusion approach for the reconstruction of isotropic‐resolution MR images from orthogonal anisotropic‐resolution scans , 2012, Magnetic resonance in medicine.

[22]  Michael Elad,et al.  L1-L2 Optimization in Signal and Image Processing , 2010, IEEE Signal Processing Magazine.

[23]  Miguel R. D. Rodrigues,et al.  On the Use of Unit-Norm Tight Frames to Improve the Average MSE Performance in Compressive Sensing Applications , 2012, IEEE Signal Processing Letters.

[24]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[25]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[26]  Daniel Rueckert,et al.  Multi-atlas segmentation with augmented features for cardiac MR images , 2015, Medical Image Anal..

[27]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[28]  Simon K. Warfield,et al.  A New Sparse Representation Framework for Reconstruction of an Isotropic High Spatial Resolution MR Volume From Orthogonal Anisotropic Resolution Scans , 2017, IEEE Transactions on Medical Imaging.

[29]  Sheng Li,et al.  Block recursive least squares dictionary learning algorithm , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[30]  Xiao Li,et al.  Designing robust sensing matrix for image compression , 2015, IEEE Transactions on Image Processing.

[31]  Liam Kilmartin,et al.  Adaptive Dictionary Reconstruction for Compressed Sensing of ECG Signals , 2017, IEEE Journal of Biomedical and Health Informatics.

[32]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[33]  Xiahai Zhuang,et al.  Multi-scale patch and multi-modality atlases for whole heart segmentation of MRI , 2016, Medical Image Anal..

[34]  Rodrigo C. de Lamare,et al.  Gradient-based algorithm for designing sensing matrix considering real mutual coherence for compressed sensing systems , 2017, IET Signal Process..

[35]  Di Guo,et al.  Fast Multiclass Dictionaries Learning With Geometrical Directions in MRI Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[36]  Yukihiro Nishida,et al.  A method of estimating coding PSNR using quantized DCT coefficients , 2006, IEEE Transactions on Circuits and Systems for Video Technology.