Projection Matrix Optimization for Sparse Signals in Structured Noise

We consider the problem of estimating a signal which has been corrupted with structured noise. When the signal of interest accepts a sparse representation, only a small number of measurements are required to retain all the information. The measurements are mapped to a lower dimensional space through a projection matrix. We propose a method to optimize the design of this matrix where the objective is not only to reduce the amount of data to be processed but also to reject the undesired signal components. As a result, we reduce the computation time and the error on the estimation of the unknown parameters of the sparse model, with respect to the uncompressed data. The proposed method has tunable parameters that can affect its performance. Optimal tuning would require a comprehensive study of parameter variations and options. To avoid this learning burden, we also introduce a variant of the algorithm that is free from tuning, without significant loss of performance. Using synthetic data, we analyze the performance of the proposed algorithms and their robustness against errors in the model parameters. Additionally, we illustrate the performance of the method through a radar application using real clutter data with a still target and with a synthetic moving target.

[1]  E.J. Candes.  Compressive Sampling , 2022 .

[2]  Di Wu,et al.  Reachability analysis of uncertain systems using bounded-parameter Markov decision processes , 2008, Artif. Intell..

[3]  A. Robert Calderbank,et al.  Communications-Inspired Projection Design with Application to Compressive Sensing , 2012, SIAM J. Imaging Sci..

[4]  Gongguo Tang,et al.  Performance Analysis of Sparse Recovery Based on Constrained Minimal Singular Values , 2010, IEEE Transactions on Signal Processing.

[5]  Kristine L. Bell,et al.  A Bayesian approach to robust adaptive beamforming , 2000, IEEE Trans. Signal Process..

[6]  Lijun Zhang,et al.  Safety Verification for Probabilistic Hybrid Systems , 2010, Eur. J. Control.

[7]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[8]  Calin Belta,et al.  A probabilistic approach for control of a stochastic system from LTL specifications , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[9]  Louis L. Scharf,et al.  Signal processing applications of oblique projection operators , 1994, IEEE Trans. Signal Process..

[10]  Mahesh Viswanathan,et al.  Model-Checking Markov Chains in the Presence of Uncertainties , 2006, TACAS.

[11]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[12]  Radha Jagadeesan,et al.  Metrics for labelled Markov processes , 2004, Theor. Comput. Sci..

[13]  Stephan Merz,et al.  Model Checking , 2000 .

[14]  Paulo Tabuada,et al.  Linear Time Logic Control of Discrete-Time Linear Systems , 2006, IEEE Transactions on Automatic Control.

[15]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001 .

[16]  P. Stoica,et al.  On the concentrated stochastic likelihood function in array signal processing , 1995 .

[17]  George J. Pappas,et al.  Approximations of Stochastic Hybrid Systems , 2009, IEEE Transactions on Automatic Control.

[18]  Taolue Chen,et al.  On the complexity of model checking interval-valued discrete time Markov chains , 2013, Inf. Process. Lett..

[19]  C. Belta,et al.  Formal analysis of Piecewise Affine systems under parameter uncertainty with application to gene networks , 2008, 2008 American Control Conference.

[20]  Calin Belta,et al.  A Fully Automated Framework for Control of Linear Systems from Temporal Logic Specifications , 2008, IEEE Transactions on Automatic Control.

[21]  Carlos H. Muravchik,et al.  Enhanced Sparse Bayesian Learning via Statistical Thresholding for Signals in Structured Noise , 2013, IEEE Transactions on Signal Processing.

[22]  Robert Givan,et al.  Bounded-parameter Markov decision processes , 2000, Artif. Intell..

[23]  Alexandros G. Dimakis,et al.  Optimal deterministic compressed sensing matrices , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  Jie Chen,et al.  Theoretical Results on Sparse Representations of Multiple-Measurement Vectors , 2006, IEEE Transactions on Signal Processing.

[25]  John Lygeros,et al.  Bisimulation for General Stochastic Hybrid Systems , 2005, HSCC.

[26]  Alessandro Abate,et al.  Formula-free finite abstractions for linear temporal verification of stochastic hybrid systems , 2013, HSCC '13.

[27]  Eric Vanden-Eijnden,et al.  Markovian milestoning with Voronoi tessellations. , 2009, The Journal of chemical physics.

[28]  S. Shankar Sastry,et al.  Markov Set-Chains as Abstractions of Stochastic Hybrid Systems , 2008, HSCC.

[29]  M. Hurtado,et al.  Sparse modeling for polarimetric radar , 2011, 2011 IEEE Statistical Signal Processing Workshop (SSP).

[30]  Carlos H. Muravchik,et al.  Electromagnetic source imaging for sparse cortical activation patterns , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[31]  L. M. Bujorianu,et al.  Approximate Abstractions of Stochastic Hybrid Systems , 2008 .

[32]  Martin Leucker,et al.  Don't Know in Probabilistic Systems , 2006, SPIN.

[33]  David P. Wipf,et al.  A New View of Automatic Relevance Determination , 2007, NIPS.

[34]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[35]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[36]  Joost-Pieter Katoen,et al.  Approximate Model Checking of Stochastic Hybrid Systems , 2010, Eur. J. Control.

[37]  Aleksandar Dogandzic,et al.  Double overrelaxation thresholding methods for sparse signal reconstruction , 2010, 2010 44th Annual Conference on Information Sciences and Systems (CISS).

[38]  Bhaskar D. Rao,et al.  An affine scaling methodology for best basis selection , 1999, IEEE Trans. Signal Process..

[39]  S. Kay,et al.  Optimal Signal Design for Detection of Gaussian Point Targets in Stationary Gaussian Clutter/Reverberation , 2007, IEEE Journal of Selected Topics in Signal Processing.

[40]  Simon Haykin,et al.  A coherent dual-polarized radar for studying the ocean environment , 1991, IEEE Trans. Geosci. Remote. Sens..

[41]  Lev V. Utkin,et al.  Computing System Reliability Given Interval-Valued Characteristics of the Components , 2005, Reliab. Comput..

[42]  Calin Belta,et al.  MDP optimal control under temporal logic constraints , 2011, IEEE Conference on Decision and Control and European Control Conference.

[43]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Michael Elad,et al.  Optimized Projections for Compressed Sensing , 2007, IEEE Transactions on Signal Processing.

[45]  Yonina C. Eldar,et al.  Sensing Matrix Optimization for Block-Sparse Decoding , 2010, IEEE Transactions on Signal Processing.

[46]  James Worrell,et al.  An Algorithm for Quantitative Verification of Probabilistic Transition Systems , 2001, CONCUR.

[47]  D.R. Fuhrmann.  One-step optimal measurement selection for linear gaussian estimation problems , 2007, 2007 International Waveform Diversity and Design Conference.

[48]  S. Kay.  Fundamentals of statistical signal processing: estimation theory , 1993 .

[49]  Bengt Jonsson,et al.  A logic for reasoning about time and reliability , 1990, Formal Aspects of Computing.

[50]  T. Henzinger,et al.  Model-Checking ω-Regular Properties of Interval Markov Chains , 2008 .

[51]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[52]  Calin Belta,et al.  Approximate Markovian abstractions for linear stochastic systems , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[53]  Henrik Ejersbo Jensen,et al.  Reachability Analysis of Probabilistic Systems by Successive Refinements , 2001, PAPM-PROBMIV.

[54]  Calin Belta,et al.  Temporal Logic Motion Planning and Control With Probabilistic Satisfaction Guarantees , 2012, IEEE Transactions on Robotics.

[55]  Marta Z. Kwiatkowska,et al.  Probabilistic symbolic model checking with PRISM: a hybrid approach , 2004, International Journal on Software Tools for Technology Transfer.

[56]  Justin Ziniel,et al.  Fast bayesian matching pursuit , 2008, 2008 Information Theory and Applications Workshop.

[57]  Lijun Zhang,et al.  Game-based Abstraction and Controller Synthesis for Probabilistic Hybrid Systems , 2011, 2011 Eighth International Conference on Quantitative Evaluation of SysTems.

[58]  H. Vincent Poor,et al.  Measurement Matrix Design for Compressive Sensing–Based MIMO Radar , 2011, IEEE Transactions on Signal Processing.

[59]  Improving detection performance of compressed sensing by orthogonal projection , 2013, 2013 14th International Radar Symposium (IRS).

[60]  George J. Pappas,et al.  Discrete abstractions of hybrid systems , 2000, Proceedings of the IEEE.

[61]  Calin Belta,et al.  Formal Analysis of Discrete-Time Piecewise Affine Systems , 2010, IEEE Transactions on Automatic Control.

[62]  Joost-Pieter Katoen,et al.  The Ins and Outs of the Probabilistic Model Checker MRMC , 2009, 2009 Sixth International Conference on the Quantitative Evaluation of Systems.

[63]  Farrokh Marvasti,et al.  Deterministic Construction of Binary, Bipolar, and Ternary Compressed Sensing Matrices , 2009, IEEE Transactions on Information Theory.

[64]  E. Krogager.  New decomposition of the radar target scattering matrix , 1990 .

[65]  Guillermo Sapiro,et al.  Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization , 2009, IEEE Transactions on Image Processing.

[66]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[67]  Joost-Pieter Katoen,et al.  Three-Valued Abstraction for Continuous-Time Markov Chains , 2007, CAV.

[68]  Arye Nehorai,et al.  Polarimetric Detection of Targets in Heavy Inhomogeneous Clutter , 2008, IEEE Transactions on Signal Processing.

[69]  Kim Guldstrand Larsen,et al.  Specification and refinement of probabilistic processes , 1991, [1991] Proceedings Sixth Annual IEEE Symposium on Logic in Computer Science.

[70]  Arjan van der Schaft,et al.  Bisimulation for Communicating Piecewise Deterministic Markov Processes (CPDPs) , 2005, HSCC.

[71]  Gang Li,et al.  Projection matrix optimization for block-sparse compressive sensing , 2013, 2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013).

[72]  Guillermo Sapiro,et al.  Adapted statistical compressive sensing: Learning to sense gaussian mixture models , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[73]  Damjan Skulj,et al.  Discrete time Markov chains with interval probabilities , 2009, Int. J. Approx. Reason..

[74]  Alessandro Abate,et al.  Adaptive Gridding for Abstraction and Verification of Stochastic Hybrid Systems , 2011, 2011 Eighth International Conference on Quantitative Evaluation of SysTems.

[75]  Joost-Pieter Katoen,et al.  Three-valued abstraction for probabilistic systems , 2012, J. Log. Algebraic Methods Program..

[76]  Sungyoung Lee,et al.  Efficient Projection for Compressed Sensing , 2008, Seventh IEEE/ACIS International Conference on Computer and Information Science (icis 2008).

[77]  Joost-Pieter Katoen,et al.  Quantitative automata model checking of autonomous stochastic hybrid systems , 2011, HSCC '11.