Efficient Projection for Compressed Sensing

Compressed sensing (CS), a joint compression and sensing process, is a emerging field of activity in which the signal is sampled and simultaneously compressed at a greatly reduced rate. In CS, the projection matrix is chosen at random which would lead to inefficient performance of CS. Recently, an optimized projection (OP) was chosen such that it leads to better coherence of the effective dictionary, leading substantially better CS reconstruction performance. This is the only recent work related to the optimization of projection matrix, but the major drawback of this approach is that its algorithm is an iterative and high complexity one. It is considered that an efficient and lightweight algorithm for designing projection matrix would usefully supplement and enhance the performance of CS. In this paper, we propose an algorithm to obtain such an projection matrix called efficient projection (EP) which is designed in such a way that the new projected dictionary will have the structure as much similar as the original dictionary. For this purpose, we use multidimensional scaling (MDS) technique which helps to find a low-dimensional new projected dictionary such that the pairwise distances between new atoms in this new projected dictionary match as well as possible the original atoms in original dictionary. This leads to a solution for EP which is very simple and can be obtained by doing singular value decomposition of original dictionary. The experiments show the novelty of our approach when it can gain a comparative performance with a very low complexity compared to that of OP.

[1]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[2]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[3]  Michael Elad,et al.  Optimized Projections for Compressed Sensing , 2007, IEEE Transactions on Signal Processing.

[4]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[5]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[6]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[7]  Alfred O. Hero,et al.  Distributed weighted-multidimensional scaling for node localization in sensor networks , 2006, TOSN.

[8]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Yaakov Tsaig,et al.  Extensions of compressed sensing , 2006, Signal Process..

[10]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[11]  Steven W. Zucker,et al.  Greedy Basis Pursuit , 2007, IEEE Transactions on Signal Processing.

[12]  Richard G. Baraniuk,et al.  An Architecture for Compressive Imaging , 2006, 2006 International Conference on Image Processing.

[13]  Rémi Gribonval,et al.  Sparse representations in unions of bases , 2003, IEEE Trans. Inf. Theory.

[14]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[15]  Emmanuel J. Candès,et al.  Quantitative Robust Uncertainty Principles and Optimally Sparse Decompositions , 2004, Found. Comput. Math..

[16]  Trevor F. Cox,et al.  Metric multidimensional scaling , 2000 .

[17]  Anthony J. Kearsley,et al.  The Solution of the Metric STRESS and SSTRESS Problems in Multidimensional Scaling Using Newton's Method , 1995 .