Detection of the Number of Signals by Signal Subspace Matching

We present a novel and computationally simple solution to the problem of detecting the number of signals, which is applicable to both white and colored noise, and to a very small number of samples. The solution is based on a novel and non-asymptotic goodness-of-fit metric, referred to as signal subspace matching (SSM), which is aimed at matching a model-based signal subspace to its sampled-data-based counterpart. We form a set of hypothesized signal subspace models, with the $k$-th model being a projection matrix composed of the $k$ leading eigenvectors of the sample-covariance matrix. This set of hypothesized models is compared to their sampled-data-based counterpart – a projection matrix constructed from the sampled data – via the SSM metric, and the model minimizing this metric is selected. We show that this solution involves the principal angles between the column span of the model and the column span of the model. We prove the consistency of this solution for the high signal-to-noise-ratio limit and for the large-sample limit. The large-sample consistency is shown to be conditioned on the signal-to-noise ratio (SNR) being higher than a a certain threshold. Simulation results, demonstrating the performance of the solution for both colored and white noise, are included.

[1]  M. Bartlett TESTS OF SIGNIFICANCE IN FACTOR ANALYSIS , 1950 .

[2]  Wenyuan Xu,et al.  Analysis of the performance and sensitivity of eigendecomposition-based detectors , 1995, IEEE Trans. Signal Process..

[3]  Abdelhak M. Zoubir,et al.  Source detection in the presence of nonuniform noise , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Kon Max Wong,et al.  On information theoretic criteria for determining the number of signals in high resolution array processing , 1990, IEEE Trans. Acoust. Speech Signal Process..

[5]  B. Carlson Covariance matrix estimation errors and diagonal loading in adaptive arrays , 1988 .

[6]  Lei Huang,et al.  Source Enumeration Via MDL Criterion Based on Linear Shrinkage Estimation of Noise Subspace Covariance Matrix , 2013, IEEE Transactions on Signal Processing.

[7]  Alan Edelman,et al.  Sample Eigenvalue Based Detection of High-Dimensional Signals in White Noise Using Relatively Few Samples , 2007, IEEE Transactions on Signal Processing.

[8]  D. Lawley TESTS OF SIGNIFICANCE FOR THE LATENT ROOTS OF COVARIANCE AND CORRELATION MATRICES , 1956 .

[9]  Zhi-Dong Bai,et al.  On rates of convergence of efficient detection criteria in signal processing with white noise , 1989, IEEE Trans. Inf. Theory.

[10]  Louis L. Scharf,et al.  Subspace Averaging and Order Determination for Source Enumeration , 2019, IEEE Transactions on Signal Processing.

[11]  Sajid Javed,et al.  Robust Subspace Learning: Robust PCA, Robust Subspace Tracking, and Robust Subspace Recovery , 2017, IEEE Signal Processing Magazine.

[12]  Jean-Jacques Fuchs Estimation of the number of signals in the presence of unknown correlated sensor noise , 1992, IEEE Trans. Signal Process..

[13]  Abd-Krim Seghouane,et al.  A small sample model selection criterion based on Kullback's symmetric divergence , 2004, IEEE Transactions on Signal Processing.

[14]  James P. Reilly,et al.  Detection of the number of signals: a predicted eigen-threshold approach , 1991, IEEE Trans. Signal Process..

[15]  Hsien-Tsai Wu,et al.  Source number estimators using transformed Gerschgorin radii , 1995, IEEE Trans. Signal Process..

[16]  Alfred M. Bruckstein,et al.  The resolution of overlapping echos , 1985, IEEE Trans. Acoust. Speech Signal Process..

[17]  Alfred O. Hero,et al.  Detection of the Number of Signals Using the Benjamini-Hochberg Procedure , 2007, IEEE Transactions on Signal Processing.

[18]  Björn E. Ottersten,et al.  Sensor array processing based on subspace fitting , 1991, IEEE Trans. Signal Process..

[19]  Thomas Kailath,et al.  ESPRIT-estimation of signal parameters via rotational invariance techniques , 1989, IEEE Trans. Acoust. Speech Signal Process..

[20]  Ralph Otto Schmidt,et al.  A signal subspace approach to multiple emitter location and spectral estimation , 1981 .

[21]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[22]  James P. Reilly,et al.  Detection of the number of signals in noise with banded covariance matrices , 1996 .

[23]  Alma Eguizabal,et al.  Source Enumeration in the Presence of Colored Noise , 2019, IEEE Signal Processing Letters.

[24]  Abdelhak M. Zoubir,et al.  Generalized Bayesian Information Criterion for Source Enumeration in Array Processing , 2013, IEEE Transactions on Signal Processing.

[25]  Z. Bai,et al.  On detection of the number of signals when the noise covariance matrix is arbitrary , 1986 .

[26]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[27]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[28]  Boaz Nadler,et al.  Non-Parametric Detection of the Number of Signals: Hypothesis Testing and Random Matrix Theory , 2009, IEEE Transactions on Signal Processing.

[29]  Abdelhak M. Zoubir,et al.  Detection of sources using bootstrap techniques , 2002, IEEE Trans. Signal Process..

[30]  Bin He,et al.  Estimation of Number of Independent Brain Electric Sources From the Scalp EEGs , 2006, IEEE Transactions on Biomedical Engineering.

[31]  Mohammad Reza Aref,et al.  Statistical Performance Analysis of MDL Source Enumeration in Array Processing , 2009, IEEE Transactions on Signal Processing.

[32]  Tülay Adali,et al.  Estimating the number of independent components for functional magnetic resonance imaging data , 2007, Human brain mapping.

[33]  Petar M. Djuric,et al.  Asymptotic MAP criteria for model selection , 1998, IEEE Trans. Signal Process..

[34]  M. Viberg,et al.  Two decades of array signal processing research: the parametric approach , 1996, IEEE Signal Process. Mag..

[35]  Hong Wang,et al.  On the theoretical performance of a class of estimators of the number of narrow-band sources , 1987, IEEE Trans. Acoust. Speech Signal Process..

[36]  Abdelhak M. Zoubir,et al.  Flexible Detection Criterion for Source Enumeration in Array Processing , 2013, IEEE Transactions on Signal Processing.

[37]  Douglas B. Williams,et al.  Counting the degrees of freedom when using AIC and MDL to detect signals , 1994, IEEE Trans. Signal Process..

[38]  Lei Huang,et al.  Source Enumeration for High-Resolution Array Processing Using Improved Gerschgorin Radii Without Eigendecomposition , 2008, IEEE Transactions on Signal Processing.

[39]  Boaz Nadler,et al.  Nonparametric Detection of Signals by Information Theoretic Criteria: Performance Analysis and an Improved Estimator , 2010, IEEE Transactions on Signal Processing.

[40]  Harry L. Van Trees,et al.  Optimum Array Processing: Part IV of Detection, Estimation, and Modulation Theory , 2002 .

[41]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[42]  G. Fleury,et al.  A Gerschgorin-Kullback criterion for source number detection in nonuniform noise and small samples , 2004, Processing Workshop Proceedings, 2004 Sensor Array and Multichannel Signal.

[43]  Hagit Messer,et al.  On the use of order statistics for improved detection of signals by the MDL criterion , 2000, IEEE Trans. Signal Process..

[44]  J. Cavanaugh A large-sample model selection criterion based on Kullback's symmetric divergence , 1999 .

[45]  Lei Huang,et al.  Bayesian Information Criterion for Source Enumeration in Large-Scale Adaptive Antenna Array , 2016, IEEE Transactions on Vehicular Technology.

[46]  Thomas Kailath,et al.  Detection of signals by information theoretic criteria , 1985, IEEE Trans. Acoust. Speech Signal Process..

[47]  Petre Stoica,et al.  Detection tests for array processing in unknown correlated noise fields , 1997, IEEE Trans. Signal Process..

[48]  Phillip A. Regalia,et al.  On the behavior of information theoretic criteria for model order selection , 2001, IEEE Trans. Signal Process..

[49]  H. Akaike A new look at the statistical model identification , 1974 .

[50]  Hagit Messer,et al.  Submitted to Ieee Transactions on Signal Processing Detection of Signals by Information Theoretic Criteria: General Asymptotic Performance Analysis , 2022 .

[51]  Andrea Giorgetti,et al.  Model Order Selection Based on Information Theoretic Criteria: Design of the Penalty , 2015, IEEE Transactions on Signal Processing.

[52]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[53]  Ilan Ziskind,et al.  Maximum likelihood localization of multiple sources by alternating projection , 1988, IEEE Trans. Acoust. Speech Signal Process..

[54]  Ignacio Santamaria,et al.  Source Enumeration in Non-White Noise and Small Sample Size via Subspace Averaging , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[55]  Douglas B. Williams,et al.  Using the sphericity test for source detection with narrow-band passive arrays , 1990, IEEE Trans. Acoust. Speech Signal Process..

[56]  Z. Bai,et al.  On detection of the number of signals in presence of white noise , 1985 .