Ieee Transactions on Signal Processing Task-driven Adaptive Statistical Compressive Sensing of Gaussian Mixture Models Ieee Transactions on Signal Processing 2

A framework for adaptive and non-adaptive statistical compressive sensing is developed, where a statistical model replaces the standard sparsity model of classical compressive sensing. We propose within this framework optimal task-specific sensing protocols specifically and jointly designed for classification and reconstruction. A two-step adaptive sensing paradigm is developed, where online sensing is applied to detect the signal class in the first step, followed by a reconstruction step adapted to the detected class and the observed samples. The approach is based on information theory, here tailored for Gaussian mixture models (GMMs), where an information-theoretic objective relationship between the sensed signals and a representation of the specific task of interest is maximized. Experimental results using synthetic signals, Landsat satellite attributes, and natural images of different sizes and with different noise levels show the improvements achieved using the proposed framework when compared to more standard sensing protocols. The underlying formulation can be applied beyond GMMs, at the price of higher mathematical and computational complexity.

[1]  Robert D. Nowak,et al.  Distilled sensing: selective sampling for sparse signal recovery , 2009, AISTATS.

[2]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[3]  Mark A Neifeld,et al.  Recognition using information-optimal adaptive feature-specific imaging. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Ronald A. DeVore,et al.  Deterministic constructions of compressed sensing matrices , 2007, J. Complex..

[5]  E.J. Candes Compressive Sampling , 2022 .

[6]  A. Robert Calderbank,et al.  A fast reconstruction algorithm for deterministic compressive sensing using second order reed-muller codes , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[7]  Guillermo Sapiro,et al.  Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization , 2009, IEEE Transactions on Image Processing.

[8]  P. Armitage Sequential Analysis with More than Two Alternative Hypotheses, and its Relation to Discriminant Function Analysis , 1950 .

[9]  David B. Dunson,et al.  Compressive Sensing on Manifolds Using a Nonparametric Mixture of Factor Analyzers: Algorithm and Performance Bounds , 2010, IEEE Transactions on Signal Processing.

[10]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[11]  Guillermo Sapiro,et al.  Statistical Compressed Sensing of Gaussian Mixture Models , 2011, IEEE Transactions on Signal Processing.

[12]  Amit Ashok,et al.  Object reconstruction from adaptive compressive measurements in feature-specific imaging. , 2010, Applied optics.

[13]  Zoran Nenadic,et al.  Information Discriminant Analysis: Feature Extraction with an Information-Theoretic Objective , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  P. Schönemann,et al.  A generalized solution of the orthogonal procrustes problem , 1966 .

[15]  Amir Averbuch,et al.  Adaptive Compressed Image Sensing Using Dictionaries , 2012, SIAM J. Imaging Sci..

[16]  Amit Ashok,et al.  Compressive imaging system design using task-specific information. , 2008, Applied optics.

[17]  Guillermo Sapiro,et al.  Online Adaptive Statistical Compressed Sensing of Gaussian Mixture Models , 2011, ArXiv.

[18]  Guillermo Sapiro,et al.  Adapted statistical compressive sensing: Learning to sense gaussian mixture models , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  A. Robert Calderbank,et al.  How to focus the discriminative power of a dictionary , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  E. Candès,et al.  People Hearing Without Listening : ” An Introduction To Compressive Sampling , 2007 .

[21]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[22]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[23]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.

[24]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[25]  S. Mallat A wavelet tour of signal processing , 1998 .

[26]  Daniel Pérez Palomar,et al.  Gradient of mutual information in linear vector Gaussian channels , 2006, IEEE Transactions on Information Theory.

[27]  Richard G. Baraniuk,et al.  The smashed filter for compressive classification and target recognition , 2007, Electronic Imaging.

[28]  Deanna Needell,et al.  Uniform Uncertainty Principle and Signal Recovery via Regularized Orthogonal Matching Pursuit , 2007, Found. Comput. Math..

[29]  Michael Elad,et al.  Optimized Projections for Compressed Sensing , 2007, IEEE Transactions on Signal Processing.

[30]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[31]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[32]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing, 2nd Edition , 1999 .

[33]  Mukund Padmanabhan,et al.  Maximizing information content in feature extraction , 2005, IEEE Transactions on Speech and Audio Processing.

[35]  Minh N. Do,et al.  A Theory for Sampling Signals from a Union of Subspaces , 2022 .

[36]  Robert D. Nowak,et al.  Adaptive sensing for sparse recovery , 2012, Compressed Sensing.

[37]  Yonina C. Eldar,et al.  Sensing Matrix Optimization for Block-Sparse Decoding , 2010, IEEE Transactions on Signal Processing.

[38]  Sudhakar Prasad Certain Relations between Mutual Information and Fidelity of Statistical Estimation , 2010, ArXiv.

[39]  Akram Aldroubi,et al.  Sequential adaptive compressed sampling via Huffman codes , 2008, ArXiv.

[40]  Jarvis Haupt,et al.  Adaptive Sensing for Sparse Signal Recovery , 2009, 2009 IEEE 13th Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop.

[41]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[42]  Henry Stark,et al.  Probability, Random Processes, and Estimation Theory for Engineers , 1995 .

[43]  Mike E. Davies,et al.  Sampling Theorems for Signals From the Union of Finite-Dimensional Linear Subspaces , 2009, IEEE Transactions on Information Theory.

[44]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[45]  Gabriel Peyré,et al.  Best Basis Compressed Sensing , 2007, IEEE Transactions on Signal Processing.

[46]  Mark A Neifeld,et al.  Adaptive feature-specific imaging: a face recognition example. , 2008, Applied optics.

[47]  Robert D. Nowak,et al.  Distilled Sensing: Adaptive Sampling for Sparse Detection and Estimation , 2010, IEEE Transactions on Information Theory.

[48]  Moshe Zakai,et al.  Some relations between mutual information and estimation error in Wiener space , 2006 .