A Bayesian robust Kalman smoothing framework for state-space models with uncertain noise statistics

The classical Kalman smoother recursively estimates states over a finite time window using all observations in the window. In this paper, we assume that the parameters characterizing the second-order statistics of process and observation noise are unknown and propose an optimal Bayesian Kalman smoother (OBKS) to obtain smoothed estimates that are optimal relative to the posterior distribution of the unknown noise parameters. The method uses a Bayesian innovation process and a posterior-based Bayesian orthogonality principle. The optimal Bayesian Kalman smoother possesses the same forward-backward structure as that of the ordinary Kalman smoother with the ordinary noise statistics replaced by their effective counterparts. In the first step, the posterior effective noise statistics are computed. Then, using the obtained effective noise statistics, the optimal Bayesian Kalman filter is run in the forward direction over the window of observations. The Bayesian smoothed estimates are obtained in the backward step. We validate the performance of the proposed robust smoother in the target tracking and gene regulatory network inference problems.

[1]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[2]  H. Rauch Solutions to the linear smoothing problem , 1963 .

[3]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[4]  J. Meditch Orthogonal Projection and Discrete Optimal Linear Smoothing , 1967 .

[5]  James S. Meditch On Optimal Linear Smoothing Theory , 1967, Inf. Control..

[6]  T. Kailath,et al.  An innovations approach to least-squares estimation--Part II: Linear smoothing in additive white noise , 1968 .

[7]  D. Fraser,et al.  The optimum linear smoother as a combination of two optimum linear filters , 1969 .

[8]  A. Sage,et al.  Sensitivity analysis of discrete filtering and smoothing algorithms , 1969 .

[9]  R. Mehra On the identification of variances and adaptive Kalman filtering , 1970 .

[10]  H. Akaike,et al.  Comment on "An innovations approach to least-squares estimation, part I: Linear filtering in additive white noise" , 1970 .

[11]  B. Tapley,et al.  Adaptive sequential estimation with unknown noise statistics , 1976 .

[12]  H. Poor On robust wiener filtering , 1980 .

[13]  H. Poor,et al.  Minimax state estimation for linear stochastic systems with noise uncertainty , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[14]  V. Poor,et al.  Minimax state estimation for linear stochastic systems with noise uncertainty , 1981 .

[15]  H. Vincent Poor,et al.  On minimax robustness: A general approach and applications , 1984, IEEE Trans. Inf. Theory.

[16]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[17]  Edward R. Dougherty,et al.  Bayesian robust optimal linear filters , 2001, Signal Process..

[18]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[19]  Seiichi Nakamori,et al.  Fixed-interval smoothing problem from uncertain observations with correlated signal and noise , 2004, Appl. Math. Comput..

[20]  Edward R. Dougherty,et al.  Design and Analysis of Robust Binary Filters in the Context of a Prior Distribution for the States of Nature , 2004, Journal of Mathematical Imaging and Vision.

[21]  S. Nakamori,et al.  Design of a fixed-interval smoother using covariance information based on the innovations approach in linear discrete-time stochastic systems , 2006 .

[22]  Seiichi Nakamori,et al.  Design of fixed-lag smoother using covariance information based on innovations approach in linear discrete-time stochastic systems , 2007, Appl. Math. Comput..

[23]  Edward R. Dougherty,et al.  Inference of Noisy Nonlinear Differential Equation Models for Gene Regulatory Networks Using Genetic Programming and Kalman Filtering , 2008, IEEE Transactions on Signal Processing.

[24]  François Desbouvries,et al.  On Bayesian Fixed-Interval Smoothing Algorithms , 2008, IEEE Transactions on Automatic Control.

[25]  A. Doucet,et al.  Smoothing algorithms for state–space models , 2010 .

[26]  Nicolas Chopin,et al.  SMC2: an efficient algorithm for sequential analysis of state space models , 2011, 1101.1528.

[27]  Robin J. Evans,et al.  Fundamentals of Object Tracking , 2011 .

[28]  Wei Wang,et al.  $H_{\infty}$ Fixed-Interval Smoothing Estimation for Time-Delay Systems , 2013, IEEE Transactions on Signal Processing.

[29]  Edward R. Dougherty,et al.  Optimal classifiers with minimum expected error within a Bayesian framework - Part I: Discrete and Gaussian models , 2013, Pattern Recognit..

[30]  Anthony N. Pettitt,et al.  A Sequential Monte Carlo Algorithm to Incorporate Model Uncertainty in Bayesian Sequential Design , 2014 .

[31]  Edward R. Dougherty,et al.  Incorporation of Biological Pathway Knowledge in the Construction of Priors for Optimal Bayesian Classification , 2014, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[32]  Edward R. Dougherty,et al.  Intrinsically Optimal Bayesian Robust Filtering , 2014, IEEE Transactions on Signal Processing.

[33]  Hongwei Liu,et al.  Radar detection during tracking with constant track false alarm rate , 2014, 2014 International Radar Conference.

[34]  Jason L. Williams,et al.  Marginal multi-bernoulli filters: RFS derivation of MHT, JIPDA, and association-based member , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[35]  Mónica F. Bugallo,et al.  Sequential Monte Carlo methods under model uncertainty , 2016, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[36]  Edward R. Dougherty,et al.  Bayesian Regression With Network Prior: Optimal Bayesian Filtering Perspective , 2016, IEEE Transactions on Signal Processing.

[37]  Luca Martino,et al.  Cooperative parallel particle filters for online model selection and applications to urban mobility , 2015, Digit. Signal Process..

[38]  Roozbeh Dehghannasiri,et al.  Intrinsically Bayesian Robust Kalman Filter: An Innovation Process Approach , 2017, IEEE Transactions on Signal Processing.

[39]  J. Míguez,et al.  Nested particle filters for online parameter estimation in discrete-time state-space Markov models , 2013, Bernoulli.

[40]  Edward R. Dougherty,et al.  Optimal Bayesian Kalman Filtering With Prior Update , 2018, IEEE Transactions on Signal Processing.

[41]  Edward R. Dougherty,et al.  Intrinsically Bayesian robust Karhunen-Loève compression , 2018, Signal Process..