Separating signal from noise

Suppose that a sequence of numbers $x_n$ (a `signal') is transmitted through a noisy channel. The receiver observes a noisy version of the signal with additive random fluctuations, $x_n + \xi_n$, where $\xi_n$ is a sequence of independent standard Gaussian random variables. Suppose further that the signal is known to come from some fixed space of possible signals. Is it possible to fully recover the transmitted signal from its noisy version? Is it possible to at least detect that a non-zero signal was transmitted? In this paper we consider the case in which signals are infinite sequences and the recovery or detection are required to hold with probability one. We provide conditions on the signal space for checking whether detection or recovery are possible. We also analyze in detail several examples including spaces of Fourier transforms of measures, spaces with fixed amplitudes and the space of almost periodic functions. Many of our examples exhibit critical phenomena, in which a sharp transition is made from a regime in which recovery is possible to a regime in which even detection is impossible.

[1]  D. Donoho,et al.  Higher criticism for detecting sparse heterogeneous mixtures , 2004, math/0410072.

[2]  J. Kahane.  Some Random Series of Functions , 1985 .

[3]  S. Kakutani.  On Equivalence of Infinite Product Measures , 1948 .

[4]  H. Weyl.  Über die Gleichverteilung von Zahlen mod. Eins , 1916 .

[5]  Karl Petersen.  Ergodic Theory , 1983 .

[6]  L. A. Shepp,et al.  Conditions for absolute continuity between a certain pair of probability measures , 1970 .

[7]  Mikko Alava,et al.  Branching Processes , 2009, Encyclopedia of Complexity and Systems Science.

[8]  E. Candès,et al.  Searching for a trail of evidence in a maze , 2007, math/0701668.

[9]  M. Sion.  On general minimax theorems , 1958 .

[10]  S. Montgomery-Smith.  The distribution of Rademacher sums , 1990 .

[11]  M. Talagrand.  The Generic Chaining , 2005 .

[12]  Russell Lyons,et al.  A Simple Path to Biggins’ Martingale Convergence for Branching Random Walk , 1998, math/9803100.

[13]  Yu. I. Ingster,et al.  Nonparametric Goodness-of-Fit Testing Under Gaussian Models , 2002 .

[14]  R. Durrett.  Probability: Theory and Examples , 1993 .

[15]  Harry Furstenberg,et al.  Disjointness in ergodic theory, minimal sets, and a problem in diophantine approximation , 1967, Mathematical systems theory.

[16]  Y. Katznelson.  An Introduction to Harmonic Analysis: Interpolation of Linear Operators , 1968 .

[17]  A. Kechris.  Classical descriptive set theory , 1987 .

[18]  J. Biggins,et al.  Martingale convergence in the branching random walk , 1977, Journal of Applied Probability.

[19]  P. Heywood.  Trigonometric Series , 1968, Nature.

[20]  Harry Furstenberg,et al.  Recurrence in Ergodic Theory and Combinatorial Number Theory , 2014 .

[21]  H. Vincent Poor,et al.  Minimum Energy to Send $k$ Bits Through the Gaussian Channel With and Without Feedback , 2011, IEEE Transactions on Information Theory.

[22]  N. Wiener,et al.  Almost Periodic Functions , 1932, The Mathematical Gazette.

[23]  Larry A Shepp,et al.  Distinguishing a Sequence of Random Variables from a Translate of Itself , 1965 .