An innovations approach to least-squares estimation--Part II: Linear smoothing in additive white noise

The innovations approach to linear least-squares approximation problems is first to "whiten" the observed data by a causal and invertible operation, and then to treat the resulting simpler white-noise observations problem. This technique was successfully used by Bode and Shannon to obtain a simple derivation of the classical Wiener filtering problem for stationary processes over a semi-infinite interval. Here we shall extend the technique to handle nonstationary continuous-time processes over finite intervals. In Part I we shall apply this method to obtain a simple derivation of the Kalman-Bucy recursive filtering formulas (for both continuous-time and discrete-time processes) and also some minor generalizations thereof.

[1]  H. W. Bode,et al.  A Simplified Derivation of Linear Least Square Smoothing and Prediction Theory , 1950, Proceedings of the IRE.

[2]  L. Zadeh,et al.  An Extension of Wiener's Theory of Prediction , 1950 .

[3]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[4]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[5]  A. N. Kolmogorov,et al.  Interpolation and extrapolation of stationary random sequences. , 1962 .

[6]  H. Rauch.  Solutions to the linear smoothing problem , 1963 .

[7]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[8]  Henry Cox,et al.  On the estimation of state variables and parameters for noisy dynamic systems , 1964 .

[9]  A. Bryson,et al.  Linear filtering for time-varying systems using measurements containing colored noise , 1965 .

[10]  Richard J. Leake.  Duality condition established in the frequency domain (Corresp.) , 1965, IEEE Trans. Inf. Theory.

[11]  James S. Meditch.  Optimal fixed-point continuous linear smoothing , 1966 .

[12]  David Q. Mayne,et al.  A solution of the smoothing problem for linear dynamic systems , 1966, Autom..

[13]  H. Bueckner.  ON A CLASS OF SINGULAR INTEGRAL EQUATIONS , 1966 .

[14]  J. Meditch.  Orthogonal Projection and Discrete Optimal Linear Smoothing , 1967 .

[15]  Peter L. Falb,et al.  Infinite-Dimensional Filtering: The Kalman-Bucy Filter in Hilbert Space , 1967, Inf. Control..

[16]  Sheldon S. L. Chang.  Optimum filtering and control of randomly sampled systems , 1967 .

[17]  Jacques-Louis Lions,et al.  State Estimation for Infinite-Dimensional Systems , 1967, J. Comput. Syst. Sci..

[18]  J. S. Meditch.  On Optimal Fixed Point Linear Smoothing , 1967 .

[19]  H. Kwakernaak,et al.  Optimal filtering in linear systems with time delays , 1967, IEEE Transactions on Automatic Control.

[20]  James S. Meditch.  On Optimal Linear Smoothing Theory , 1967, Inf. Control..

[21]  L. D. Collins.  Realizable whitening filters and state-variable realizations , 1968 .

[22]  T. Kailath.  Application of a Resolvent Identity to a Linear Smoothing Problem , 1969 .

[23]  Thomas Kailath,et al.  A general likelihood-ratio formula for random signals in Gaussian noise , 1969, IEEE Trans. Inf. Theory.