Effective Sampling Rates for Signal Detection; or Can the Gaussian Model be Salvaged?

The usual justification for talking about signal-to-noise ratio is in terms of a Gaussian model. This model can be treated either by means of information theory or by means of (earlier) methods of statistical inference. In either case the justification is often achieved by assuming that sampling is done at the Nyquist rate. This justification collapses if we are given a record of finite duration, since the sampling theorem is then inapplicable. In fact the Gaussian model itself collapses since it leads to the absurd conclusion that an infinite amount of information can be obtained in a finite time. But the mathematical convenience of the Gaussian model cannot be lightly brushed aside. The intention of this paper is primarily to try to salvage the Gaussian model by assuming that there is an effective sampling rate that cannot be exceeded. This rate could be slower or faster than the Nyquist rate. If an inefficient, but pleasantly simple statistic (the “power statistic”) is used, then there is less point in sampling faster than the Nyquist rate. For the reader's convenience, some material on spectral analysis and other matters is collected together in the Appendices. Most of it could be found, explicitly or implicitly, in previous literature. The notion of interaction for weight of evidence, and its relationship to spectral analysis, is explained in Appendix 6, and does not seem to have been previously published.

[1]  Irving John Good,et al.  Some Terminology and Notation in Information Theory , 1956 .

[2]  David S. Slepian,et al.  Some comments on the detection of Gaussian signals in Gaussian noise , 1958, IRE Trans. Inf. Theory.

[3]  William J. McGill Multivariate information transmission , 1954, Trans. IRE Prof. Group Inf. Theory.

[4]  J. Doob Time Series and Harmonic Analysis , 1949 .

[5]  I. J. Good,et al.  A Paradox Concerning Rate of Information: Corrections and Additions , 1959, Inf. Control..

[6]  A. C. Aitken Determinants and matrices , 1940 .

[7]  D. Middleton,et al.  Detection and Extraction of Signals in Noise from the Point of View of Statistical Decision Theory. I , 1955 .

[8]  W. J. McGill Multivariate information transmission , 1954, Trans. IRE Prof. Group Inf. Theory.

[9]  Harry Nyquist Certain Topics in Telegraph Transmission Theory , 1928 .

[10]  W. Huggins A Phase Principle for Complex‐Frequency Analysis and Its Implications in Auditory Theory , 1952 .

[11]  J. Doob Stochastic processes , 1953 .

[12]  Peter Whittle,et al.  Hypothesis Testing in Time Series Analysis. , 1951 .

[13]  Harald Cramer,et al.  On the Theory of Stationary Random Processes , 1940 .

[14]  U. Grenander,et al.  Statistical analysis of stationary time series , 1957 .

[15]  I. Good,et al.  On the inversion of circulant matrices. , 1950, Biometrika.

[16]  L. J. Savage,et al.  Probability and the weighing of evidence , 1951 .

[17]  I. J. Good,et al.  A Paradox Concerning Rate of Information , 1958, Inf. Control..

[18]  R. Courant,et al.  Methods of Mathematical Physics , 1962 .

[19]  P. Whittle The Analysis of Multiple Stationary Time Series , 1953 .

[20]  E. C. Titchmarsh,et al.  The theory of functions , 1933 .

[21]  T. Teichmann,et al.  The Measurement of Power Spectra , 1960 .

[22]  H. Nyquist,et al.  Certain Topics in Telegraph Transmission Theory , 1928, Transactions of the American Institute of Electrical Engineers.

[23]  W. G. Cochran,et al.  The distribution of quadratic forms in a normal system, with applications to the analysis of covariance , 1934, Mathematical Proceedings of the Cambridge Philosophical Society.