Sequential testing of sorted and transformed data as an efficient way to implement long GLRTs

It is often required to detect a long weak signal in Gaussian noise, and frequently, the exact form of that signal is parameterized but not known. A bank of matched filters provides an appropriate detector. However, in some practical applications, there are very many matched filters, and most are quite long. The consequent computational needs may render the classical bank-of-filters approach infeasibly expensive. One example, and our original motivation, is the detection of chirp gravitational waves by an Earth-based interferometer. In this paper, we provide a computational approach to this problem via sequential testing. Since the sequential tests to be used are not for constant signals, we develop the theory in terms of average sample number (ASN) for this case. Specifically, we propose two easily calculable expressions for the ASN: one a bound and the other an approximation. The sequential approach does yield moderate computational savings, but we find that by preprocessing the data using short/medium fast Fourier transforms (FFTs) and an appropriate sorting of these FFT outputs such that the most informative samples are entered to a sequential test first, quite high numerical efficiency can be realized. The idea is simple but appears to be quite successful: Examples are presented in which the computational load is reduced by several orders of magnitude. The FFT is an example of an energy-agglomerating transform, but of course, there are many others. The point here is that the transform need not match the sought signal exactly in the sense that all energy becomes confined to a single sample; it is enough that the energy becomes concentrated, and the more concentrated the better.

[1]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[2]  B. S. Sathyaprakash,et al.  A Comparison of search templates for gravitational waves from binary inspiral , 2001 .

[3]  F. A. Jenet,et al.  Detection of variable frequency signals using a fast chirp transform , 2000 .

[4]  Shuang Chen,et al.  The entropy of ordered sequences and order statistics , 1990, IEEE Trans. Inf. Theory.

[5]  H. Vincent Poor,et al.  Asymptotic efficiencies of truncated sequential tests , 1982, IEEE Trans. Inf. Theory.

[6]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[7]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[8]  Peter Willett,et al.  Sequential detection of almost-harmonic signals , 2003, IEEE Trans. Signal Process..

[9]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[10]  H. Vincent Poor,et al.  An introduction to signal detection and estimation (2nd ed.) , 1994 .

[11]  R. Chandramouli,et al.  A generalized sequential sign detector for binary hypothesis testing , 1998, IEEE Signal Processing Letters.

[12]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[13]  Thomas A. Prince,et al.  A method for the detection of gravitational waves from inspiralling compact binaries using a fast chirp transform , 2002 .

[14]  E. Lehmann Testing Statistical Hypotheses , 1960 .

[15]  C. C. Craig,et al.  A First Course in Mathematical Statistics , 1947 .

[16]  Marco Lops,et al.  Non-parametric detection of typical gravitational waves signals , 1995 .

[17]  Norbert Schmitz,et al.  Comment on 'Optimality of the sequential probability ratio test for nonstationary observations' by Y. Liu and S.D. Blostein , 1995, IEEE Trans. Inf. Theory.

[18]  Sawasd Tantaratana,et al.  Comparison of the SPRT and the sequential linear detector in autoregressive noise , 1985, IEEE Trans. Inf. Theory.

[19]  Steven D. Blostein,et al.  Optimality of the sequential probability ratio test for nonstationary observations , 1992, IEEE Trans. Inf. Theory.

[20]  Maurizio Longo,et al.  Regular ArticleA Real-Time Parallel Application:: The Detection of Gravitational Waves by a Network of Heterogeneous Workstations☆ , 1998 .

[21]  Peter Willett,et al.  Detection of hidden Markov model transient signals , 2000, IEEE Trans. Aerosp. Electron. Syst..

[22]  Boaz Porat,et al.  A course in digital signal processing , 1996 .

[23]  P. Willett,et al.  Hough transform for long chirp detection , 2002 .

[24]  Peter Willett,et al.  The Hough transform for long chirp detection , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[25]  John S. Sadowsky,et al.  A dependent data extension of Wald's identity and its application to sequential test performance computation , 1989, IEEE Trans. Inf. Theory.

[26]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[27]  Langford B. White,et al.  Sinusoid detection using a sequential DFT test , 1999, 1999 Information, Decision and Control. Data and Information Fusion Symposium, Signal Processing and Communications Symposium and Decision and Control Symposium. Proceedings (Cat. No.99EX251).

[28]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part II: Accurate asymptotic expansions for the expected sample size , 2000, IEEE Trans. Inf. Theory.

[29]  B. Sathyaprakash,et al.  Choice of filters for the detection of gravitational waves from coalescing binaries. , 1991, Physical review. D, Particles and fields.

[30]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[31]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part I: Asymptotic optimality , 1999, IEEE Trans. Inf. Theory.

[32]  P. J. Huber A Robust Version of the Probability Ratio Test , 1965 .

[33]  Lobo,et al.  Estimation of the parameters of the gravitational-wave signal of a coalescing binary system. , 1993, Physical review. D, Particles and fields.

[34]  Michael J. Longo,et al.  A Real-Time Parallel Application , 1998 .