Optimized sampling distribution based on nonparametric learning for improved compressive sensing performance

A new learning approach for optimizing CS sampling distribution was introduced.The distribution is based on learning statistical properties of past measurements.Experiments performed with fluorescence microscopy and laser range measurements.Results consistently show significantly improved compressive sensing performance. In this work, an optimized nonparametric learning approach for obtaining the data-guided sampling distribution is proposed, where a probability density function (pdf) is learned in a nonparametric manner based on past measurements from similar types of signals. This learned sampling distribution is then used to better optimize the sampling process based on the underlying signal characteristics. A realization of this stochastic learning approach for compressive sensing of imaging data is introduced via a stochastic Monte Carlo optimization strategy to learn a nonparametric sampling distribution based on visual saliency. Experiments were performed using different types of signals such as fluorescence microscopy images and laser range measurements. Results show that the proposed optimized sampling method which is based on nonparametric stochastic learning outperforms significantly the previously proposed approach. The proposed method is achieves higher reconstruction signal to noise ratios at the same compression rates across all tested types of signals.

[1]  David A. Clausi,et al.  Sparse Reconstruction of Breast MRI Using Homotopic $L_0$ Minimization in a Regional Sparsified Domain , 2013, IEEE Transactions on Biomedical Engineering.

[2]  David A. Clausi,et al.  Saliency-guided compressive sensing approach to efficient laser range measurement , 2013, J. Vis. Commun. Image Represent..

[3]  Siddhartha Chib,et al.  Accept–reject Metropolis–Hastings sampling and marginal likelihood estimation , 2005 .

[4]  Michael Elad,et al.  On the Uniqueness of Nonnegative Sparse Solutions to Underdetermined Systems of Equations , 2008, IEEE Transactions on Information Theory.

[5]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Isidora Stankovic,et al.  Recovery of Images with Missing Pixels using a Gradient Compressive Sensing Algorithm , 2014, ArXiv.

[7]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[8]  David V. Anderson,et al.  Compressive Sensing on a CMOS Separable-Transform Image Sensor , 2010, Proceedings of the IEEE.

[9]  Ying Yu,et al.  Saliency-Based Compressive Sampling for Image Signals , 2010, IEEE Signal Processing Letters.

[10]  R. Castro Adaptive sensing performance lower bounds for sparse estimation and testing , 2012 .

[11]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[12]  Robert D. Nowak,et al.  Sequentially designed compressed sensing , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[13]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[14]  Michael Elad,et al.  A generalized uncertainty principle and sparse representation in pairs of bases , 2002, IEEE Trans. Inf. Theory.

[15]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[16]  Alexander Wong,et al.  Homotopic, non-local sparse reconstruction of optical coherence tomography imagery. , 2012, Optics express.

[17]  Christophe Andrieu,et al.  A tutorial on adaptive MCMC , 2008, Stat. Comput..

[18]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[19]  Alexander Wong,et al.  Energy-guided learning approach to compressive FD-OCT. , 2013, Optics express.

[20]  Alexander Wong,et al.  Compressive fluorescence microscopy using saliency-guided sparse reconstruction ensemble fusion. , 2012, Optics express.

[21]  Pierre Vandergheynst,et al.  On Variable Density Compressive Sampling , 2011, IEEE Signal Processing Letters.

[22]  W. Gilks Markov Chain Monte Carlo , 2005 .

[23]  Michael Riffle,et al.  The Yeast Resource Center Public Image Repository: A large database of fluorescence microscopy images , 2010, BMC Bioinformatics.

[24]  Emmanuel J. Candès,et al.  On the Fundamental Limits of Adaptive Sensing , 2011, IEEE Transactions on Information Theory.

[25]  Michael Elad,et al.  A wide-angle view at iterated shrinkage algorithms , 2007, SPIE Optical Engineering + Applications.

[26]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[27]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[28]  Ljubiša Stanković,et al.  Adaptive Variable Step Algorithm for Missing Samples Recovery in Sparse Signals , 2013, IET Signal Process..

[29]  Xiaolin Tian,et al.  Self-adaptive structured image sensing , 2012 .

[30]  Luc Cournoyer,et al.  The NRCC three-dimensional image data files , 1988 .

[31]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[32]  Zhongmin Wang,et al.  Variable density compressed image sampling , 2009, 2009 17th European Signal Processing Conference.

[33]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[34]  Xiaohua Zhang,et al.  Self-adaptive sampling rate assignment and image reconstruction via combination of structured sparsity and non-local total variation priors , 2014, Digit. Signal Process..

[35]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.

[36]  David A. Clausi,et al.  Multi-Scale Saliency-Guided Compressive Sensing Approach to Efficient Robotic Laser Range Measurements , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[37]  David A. Clausi,et al.  Saliency-guided compressive fluorescence microscopy , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.