Robust Filtering Through Coherent Lower Previsions

The classical filtering problem is re-examined to take into account imprecision in the knowledge about the probabilistic relationships involved. Imprecision is modeled in this paper by closed convex sets of probabilities. We derive a solution of the state estimation problem under such a framework that is very general: it can deal with any closed convex set of probability distributions used to characterize uncertainty in the prior, likelihood, and state transition models. This is made possible by formulating the theory directly in terms of coherent lower previsions, that is, of the lower envelopes of the expectations obtained from the set of distributions. The general solution is specialized to two particular classes of coherent lower previsions. The first consists of a family of Gaussian distributions whose means are only known to belong to an interval. The second is the so-called linear-vacuous mixture model, which is a family made of convex combinations of a known nominal distribution (e.g., a Gaussian) with arbitrary distributions. For the latter case, we empirically compare the proposed estimator with the Kalman filter. This shows that our solution is more robust to the presence of modelling errors in the system and that, hence, appears to be a more realistic approach than the Kalman filter in such a case.

[1]  James C. Spa Estimation via Markov Chain Monte Carlo , 2002 .

[2]  James C. Spall The Kantorovich inequality for error analysis of the Kalman filter with unknown noise distributions , 1995, Autom..

[3]  G. Choquet Theory of capacities , 1954 .

[4]  Wei-Shen Wang,et al.  Robust Estimation of Parametric Yield under Limited Descriptions of Uncertainty , 2006, 2006 IEEE/ACM International Conference on Computer Aided Design.

[5]  Erik Quaeghebeur,et al.  Lower and Upper Covariance , 2008, SMPS.

[6]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[7]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[8]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[9]  Gert de Cooman,et al.  Multiple model tracking by imprecise markov trees , 2009, 2009 12th International Conference on Information Fusion.

[10]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[11]  Marco Zaffalon,et al.  Reliable hidden Markov model filtering through coherent lower previsions , 2009, 2009 12th International Conference on Information Fusion.

[12]  Jitendra Tugnait Detection and estimation for abruptly changing systems , 1981, CDC 1981.

[13]  G. Cooman,et al.  Lower previsions induced by multi-valued mappings , 2005 .

[14]  J. Berger,et al.  Ranges of posterior measures for priors with unimodal contaminations , 1989 .

[15]  Krishna R. Pattipati,et al.  A Unified View of State Estimation in Switching Environments , 1983, 1983 American Control Conference.

[16]  W. Stirling,et al.  Set-valued Filtering And Smoothing , 1988, Twenty-Second Asilomar Conference on Signals, Systems and Computers.

[17]  B. M. Hill,et al.  Theory of Probability , 1990 .

[18]  Enrique Miranda,et al.  A survey of the theory of coherent lower previsions , 2008, Int. J. Approx. Reason..

[19]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[20]  Erik Quaeghebeur Lower & upper covariance , 2009 .

[21]  P. Walley,et al.  A survey of concepts of independence for imprecise probabilities , 2000 .

[22]  L. M. M.-T. Theory of Probability , 1929, Nature.

[23]  G. Cooman,et al.  IMPRECISE MARKOV CHAINS AND THEIR LIMIT BEHAVIOR , 2008, Probability in the Engineering and Informational Sciences.

[24]  Branko Ristic,et al.  Kalman Filter and Joint Tracking and Classification in the TBM framework , 2004 .

[25]  Fazil A. Aliev,et al.  Evaluation of convergence rate in the central limit theorem for the Kalman filter , 1999, IEEE Trans. Autom. Control..

[26]  Gert de Cooman,et al.  Epistemic irrelevance in credal nets: The case of imprecise Markov trees , 2010, Int. J. Approx. Reason..

[27]  Branko Ristic,et al.  Kalman filter and joint tracking and classification based on belief functions in the TBM framework , 2007, Inf. Fusion.

[28]  Gert de Cooman,et al.  Marginal extension in the theory of coherent lower previsions , 2007, Int. J. Approx. Reason..

[29]  J. L. Maryak,et al.  Use of the Kalman filter for inference in state-space models with unknown noise distributions , 1996, IEEE Transactions on Automatic Control.

[30]  Scott Ferson,et al.  Constructing Probability Boxes and Dempster-Shafer Structures , 2003 .

[31]  I. Olkin,et al.  Probability in the Engineering and Informational Sciences , 2013 .

[32]  P. Walley Statistical Reasoning with Imprecise Probabilities , 1990 .

[33]  R. Martin,et al.  Robust bayesian estimation for the linear model and robustifying the Kalman filter , 1977 .

[34]  M. Nussbaum De Finetti, B.: Theory of Probability. John Wiley & Sons, London‐New York‐Sydney‐Toronto 1974. XIX, 300 S., £7,50 , 1975 .

[35]  Wynn C. Stirling,et al.  Nonlinear Filtering of Convex Sets of Probability Distributions , 2002, ISIPTA.

[36]  Uwe D. Hanebeck,et al.  Nonlinear Bayesian estimation with convex sets of probability densities , 2008, 2008 11th International Conference on Information Fusion.

[37]  Fan Wang,et al.  Robust steady-state filtering for systems with deterministic and stochastic uncertainties , 2003, IEEE Trans. Signal Process..