Constrained likelihood ratios for detecting sparse signals in highly noisy 3D data

We propose a method aimed at detecting weak, sparse signals in highly noisy three-dimensional (3D) data. 3D data sets usually combine two spatial directions x and y (e.g. image or video frame dimensions) with an additional direction λ (e.g. temporal, spectral or energy dimension). Such data most often suffer from information leakage caused by the acquisition system's point spread functions, which may be different and variable in the three dimensions. The proposed test is based on dedicated 3D dictionaries, and exploits both the sparsity of the data along the λ direction and the information spread in the three dimensions. Numerical results are shown in the context of astrophysical hyperspectral data, for which the proposed 3D model substantially improves over 1D detection approaches.

[1]  Jean-Jacques Fuchs,et al.  The Generalized Likelihood Ratio Test and the Sparse Representations Approach , 2010, ICISP.

[2]  Brian M. Sadler,et al.  Subspace compressive detection for sparse signals , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  D. Manolakis,et al.  Detection algorithms for hyperspectral imaging applications: a signal processing perspective , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[4]  Robert D. Nowak,et al.  Compressive Sampling for Signal Detection , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[5]  David Mary,et al.  Sparsity-based composite detection tests. application to astrophysical hyperspectral data , 2011, 2011 19th European Signal Processing Conference.

[6]  Matthew Malloy,et al.  Sequential analysis in high-dimensional multiple testing and sparse recovery , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[7]  E. Candès,et al.  Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism , 2010, 1007.1434.

[8]  Jean-Jacques Fuchs,et al.  On sparse representations in arbitrary redundant bases , 2004, IEEE Transactions on Information Theory.

[9]  Michael E. Tipping.  The Relevance Vector Machine , 1999, NIPS.

[10]  Jianqing Fan.  Test of Significance Based on Wavelet Thresholding and Neyman's Truncation , 1996 .

[11]  James Theiler,et al.  Detection of spectrally sparse anomalies in hyperspectral imagery , 2012, 2012 IEEE Southwest Symposium on Image Analysis and Interpretation.

[12]  A. Asensio Ramos,et al.  Signal detection for spectroscopy and polarimetry , 2012 .

[13]  Er-Wei Bai,et al.  A new physics-based method for detecting weak nuclear signals via spectral decomposition , 2012 .

[14]  Sanjib Basu.  Bayesian hypotheses testing using posterior density ratios , 1996 .

[15]  David Mary,et al.  Detection Tests Using Sparse Models, With Application to Hyperspectral Data , 2013, IEEE Transactions on Signal Processing.

[16]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[17]  David Mary,et al.  Restoration of Astrophysical Spectra With Sparsity Constraints: Models and Algorithms , 2011, IEEE Journal of Selected Topics in Signal Processing.

[18]  David Mary,et al.  Minimax sparse detection based on one-class classifiers , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Waheed U. Bajwa,et al.  Finite Frames for Sparse Signal Processing , 2013 .

[20]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[21]  Stephen E. Fienberg,et al.  Testing Statistical Hypotheses , 2005 .

[22]  Jean-Luc Starck,et al.  Source detection using a 3D sparse representation: application to the Fermi gamma-ray space telescope , 2009, 0904.3299.

[23]  Brian M. Sadler,et al.  Compressive matched subspace detection , 2009, 2009 17th European Signal Processing Conference.

[24]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[25]  Gary A. Shaw,et al.  Hyperspectral Image Processing for Automatic Target Detection Applications , 2003 .

[26]  David Mary,et al.  Processing MUSE hyperspectral data: Denoising, deconvolution and detection of astrophysical sources , 2012 .

[27]  Dimitris G. Manolakis,et al.  Is there a best hyperspectral detection algorithm? , 2009, Defense + Commercial Sensing.

[28]  Tuan Vo-Dinh.  A hyperspectral imaging system for in vivo optical diagnostics , 2004, IEEE Engineering in Medicine and Biology Magazine.

[29]  D. Donoho,et al.  Higher criticism for detecting sparse heterogeneous mixtures , 2004, math/0410072.

[30]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[31]  David Mary,et al.  PDR and LRMAP detection tests applied to massive hyperspectral data , 2011, 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[32]  S. Kay.  Fundamentals of statistical signal processing: estimation theory , 1993 .

[33]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.