The role of lookahead in estimation under Gaussian noise

We consider mean squared estimation of a continuous-time signal corrupted by additive white Gaussian noise. We investigate the trade-off between lookahead and estimation-loss under this model. We study the class of continuous-time stationary Gauss-Markov processes (Ornstein-Uhlenbeck processes) as channel inputs, and explicitly characterize the behavior of the minimum mean squared error (MMSE) with finite lookahead and signal-to-noise ratio (SNR). The MMSE with lookahead is shown to converge exponentially rapidly to the non-causal error, with the exponent being the reciprocal of the non-causal error. We extend our results to mixtures of Ornstein-Uhlenbeck processes, and use the insight gained to present lower and upper bounds on the MMSE with lookahead for a class of stationary Gaussian input processes, whose spectrum can be expressed as a mixture of Ornstein-Uhlenbeck spectra.

[1]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .

[2]  J. L. Jackson,et al.  LINEAR FILTER OPTIMIZATION WITH GAME THEORY CONSIDERATIONS , 1955 .

[3]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[4]  Shlomo Shamai,et al.  On information, estimation and lookahead , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[5]  J. Doob,et al.  The Brownian Movement and Stochastic Equations , 1942 .

[6]  B. Øksendal.  Stochastic differential equations : an introduction with applications , 1987 .

[7]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .

[8]  R. Mazo.  On the theory of brownian motion , 1973 .

[9]  T. Duncan.  ON THE CALCULATION OF MUTUAL INFORMATION , 1970 .

[10]  G. Uhlenbeck,et al.  On the Theory of the Brownian Motion , 1930 .

[11]  Lothar Jentsch,et al.  UEBER EINE KLASSE SINGULAERER INTEGRALGLEICHUNGEN MIT ZWEI FESTSTEHENDEN SINGULARITAETEN , 1988 .

[12]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series, with Engineering Applications , 1949 .

[13]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[14]  P. Mazur.  On the theory of brownian motion , 1959 .

[15]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[16]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[17]  Ben-Zion Bobrovsky,et al.  Fixed lag smoothing of scalar diffusions. Part I. The filtering-smoothing equation , 1996 .