Asymptotically Optimal Truncated Multivariate Gaussian Hypothesis Testing With Application to Consensus Algorithms

In the interest of complexity reduction or to facilitate efficient distributed computation using consensus, truncated versions of the optimal hypothesis test are considered for a canonical multivariate Gaussian problem with L observations. The truncated tests employ correlation terms involving any given observation. The focus is on cases with a large L such that significant efficiency results with a truncation rule, k as a function of L, which increases very slowly with L. A key result provides sufficient conditions on truncation rules and sequences of hypothesis testing problems which provide no loss in deflection performance as L approaches infinity when compared to the optimal detector. The set of asymptotically optimal truncation rules satisfying these sufficient conditions varies with the scaling behavior of the difficulty of the hypothesis testing problem with L. Several popular classes of system and process models, including observations from wide-sense stationary limiting processes as L→∞ after the mean is subtracted, are used as illustrative classes of examples to demonstrate the sufficient conditions are not overly restrictive. In these examples, significant truncation can be employed even when the difficulty of the hypothesis testing problem scales in the least favorable manner, putting the most stringent conditions on the truncation rule. In all the cases considered, numerical results imply the fixed-false-alarm-rate detection probability of the truncated detector converges to the detection probability of the optimal detector for our asymptotically optimal truncation in terms of deflection.

[1]  J. Tabrikian,et al.  Target Detection and Localization Using MIMO Radars and Sonars , 2006, IEEE Transactions on Signal Processing.

[2]  H. Vincent Poor,et al.  Neyman-Pearson Detection of Gauss-Markov Signals in Noise: Closed-Form Error Exponent and Properties , 2005, ISIT.

[3]  Venugopal V. Veeravalli,et al.  How Dense Should a Sensor Network Be for Detection With Correlated Observations? , 2006, IEEE Transactions on Information Theory.

[4]  William F. Moss,et al.  Decay rates for inverses of band matrices , 1984 .

[5]  P. Bickel,et al.  Regularized estimation of large covariance matrices , 2008, 0803.1909.

[6]  Charles E. Heckler,et al.  Applied Multivariate Statistical Analysis , 2005, Technometrics.

[7]  Soummya Kar,et al.  Gossip Algorithms for Distributed Signal Processing , 2010, Proceedings of the IEEE.

[8]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[9]  A. Chindapol,et al.  A Kronecker product improvement to PCA for space time adaptive processing , 2000, Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers (Cat. No.00CH37154).

[10]  H. Vincent Poor,et al.  Neyman-pearson detection of gauss-Markov signals in noise: closed-form error exponentand properties , 2005, IEEE Transactions on Information Theory.

[11]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[12]  Christine M. Anderson-Cook,et al.  Book review: quantitative risk management: concepts, techniques and tools, revised edition, by A.F. McNeil, R. Frey and P. Embrechts. Princeton University Press, 2015, ISBN 978-0-691-16627-8, xix + 700 pp. , 2017, Extremes.

[13]  U. Grenander,et al.  Toeplitz Forms And Their Applications , 1958 .

[14]  Wen J. Li,et al.  Distributed Detection in Wireless Sensor Networks Using A Multiple Access Channel , 2007, IEEE Transactions on Signal Processing.

[15]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[16]  Charles W. Therrien,et al.  Properties of Separable Covariance Matrices and Their Associated Gaussian Random Processes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  M. Genton Separable approximations of space‐time covariance matrices , 2007 .

[18]  H. Vincent Poor,et al.  Optimal and suboptimal detection of Gaussian signals in noise: asymptotic relative efficiency , 2005, SPIE Optics + Photonics.

[19]  Masanobu Shinozuka,et al.  Neumann Expansion for Stochastic Finite Element Analysis , 1988 .

[20]  C. Baker Optimum Quadratic Detection of a Random Vector in Gaussian Noise , 1966 .

[21]  W. Eric L. Grimson,et al.  Adaptive Segmentation of MRI Data , 1995, CVRMed.

[22]  L.J. Cimini,et al.  MIMO Radar with Widely Separated Antennas , 2008, IEEE Signal Processing Magazine.

[23]  Miao He,et al.  A Dependency Graph Approach for Fault Detection and Localization Towards Secure Smart Grid , 2011, IEEE Transactions on Smart Grid.

[24]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[25]  Lang Tong,et al.  Malicious Data Attacks on the Smart Grid , 2011, IEEE Transactions on Smart Grid.

[26]  M. Sherman Spatial Statistics and Spatio-Temporal Data: Covariance Functions and Directional Properties , 2010 .

[27]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[28]  H. Vincent Poor,et al.  An introduction to signal detection and estimation (2nd ed.) , 1994 .

[29]  Kaigui Bian,et al.  Robust Distributed Spectrum Sensing in Cognitive Radio Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[30]  H. Poor,et al.  A reduced‐complexity quadratic structure for the detection of stochastic signals , 1985 .

[31]  Jonathan M. Nichols,et al.  An Isserlis’ Theorem for Mixed Gaussian Variables: Application to the Auto-Bispectral Density , 2009 .

[32]  B. Picinbono On deflection as a performance criterion in detection , 1995 .