Approximation and Limit Results for Nonlinear Filters Over an Infinite Time Interval

This paper is concerned with approximations to nonlinear filtering problems that are of interest over a very long time interval. Since the optimal filter can rarely be constructed, one needs to compute with numerically feasible approximations. The signal model can be a jump-diffusion or just a process that is approximated by a jump-diffusion. The observation noise can be either white or of wide bandwidth. The observations can be taken in either discrete or continuous time. The cost of interest is the pathwise error per unit time over a long time interval. It is shown under quite reasonable conditions on the approximating filter and the signal and noise processes that (as time, bandwidth, process, and filter approximation, etc.) go to their limit in any way at all, the limit of the pathwise average costs per unit time is just what one would get if the approximating processes were replaced by their ideal values and the optimal filter were used. Analogous results are obtained (with appropriate scaling) if the observations are taken in discrete time, and the sampling interval also goes to zero. For these cases, the approximating filter is a numerical approximation to the optimal filter for the presumed limit (signal, observation noise) problem.

[1]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[2]  R. Rishel Necessary and Sufficient Dynamic Programming Conditions for Continuous Time Stochastic Optimal Control , 1970 .

[3]  H. Kunita Asymptotic behavior of the nonlinear filtering errors of Markov processes , 1971 .

[4]  H. Kunita,et al.  Stochastic differential equations for the non linear filtering problem , 1972 .

[5]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[6]  G. Papanicolaou,et al.  Stability and Control of Stochastic Systems with Wide-band Noise Disturbances. I , 1978 .

[7]  Harold J. Kushner,et al.  Jump-Diffusion Approximations for Ordinary Differential Equations with Wide-Band Random Right Hand Sides, , 1979 .

[8]  Robert J. Elliott,et al.  Stochastic calculus and applications , 1984, IEEE Transactions on Automatic Control.

[9]  Harold J. Kushner,et al.  Approximation and Weak Convergence Methods for Random Processes , 1984 .

[10]  Harold J. Kushner,et al.  Approximate and limit results for nonlinear filters with wide bandwith observation noise , 1986 .

[11]  T. Kurtz Approximation of Population Processes , 1987 .

[12]  L. Stettner On invariant measures of filtering processes , 1989 .

[13]  H. Kushner Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems , 1990 .

[14]  L. F. Martins,et al.  Limit theorems for pathwise average cost per unit time problems for controlled queues in heavy traffic , 1993 .

[15]  D. Ocone,et al.  Asymptotic Stability of the Optimal Filter with Respect toIts Initial Condition , 1996 .

[16]  Laurent Mevel,et al.  Geometric Ergodicity in Hidden Markov Models , 1996 .

[17]  A. Budhiraja,et al.  Exponential stability of discrete-time filters for bounded observation noise , 1997 .

[18]  R. Atar,et al.  Exponential stability for nonlinear filtering , 1997 .

[19]  R. Atar Exponential stability for nonlinear filtering of diffusion processes in a noncompact domain , 1998 .

[20]  H. Kushner,et al.  Robustness of Nonlinear Filters Over the Infinite Time Interval , 1998 .

[21]  D. Ocone Asymptotic stability of beneš filters , 1999 .

[22]  H. Kushner Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[23]  Laurent Mevel,et al.  Exponential Forgetting and Geometric Ergodicity in Hidden Markov Models , 2000, Math. Control. Signals Syst..