Bayesian Identification of Non-Linear State Space Models: Part II Error Analysis

Abstract In the last two decades, several methods based on sequential Monte Carlo (SMC) and Markov chain Monte Carlo (MCMC) have been proposed for Bayesian identification of stochastic non-linear state-space models (SSMs). It is well known that the performance of these simulation based identification methods depends on the numerical approximations used in their design. We propose the use of posterior Cramer-Rao lower bound (PCRLB) as a mean square error (MSE) bound. Using PCRLB, a systematic procedure is developed to analyse the estimates delivered by Bayesian identification methods in terms of bias, MSE, and efficiency. The efficacy and utility of the proposed approach is illustrated through a numerical example.

[1]  Niclas Bergman.  Posterior Cramér-Rao Bounds for Sequential Estimation , 2001, Sequential Monte Carlo Methods in Practice.

[2]  H. V. Trees.  Detection, Estimation, And Modulation Theory , 2001 .

[3]  Biao Huang,et al.  Bayesian identification of non-linear state-space models: Part I- Input design , 2013 .

[4]  Carlos H. Muravchik,et al.  Posterior Cramer-Rao bounds for discrete-time nonlinear filtering , 1998, IEEE Trans. Signal Process..

[5]  Brett Ninness,et al.  Bayesian system identification via Markov chain Monte Carlo techniques , 2010, Autom..

[6]  Arnaud Doucet,et al.  A Bayesian approach to joint tracking and identification of geometric shapes in video sequences , 2010, Image Vis. Comput..

[7]  Biao Huang,et al.  On simultaneous on-line state and parameter estimation in non-linear state-space models , 2013 .

[8]  P. Spreij.  Probability and Measure , 1996 .

[9]  T. Raghavan,et al.  Nonnegative Matrices and Applications , 1997 .

[10]  R. B. Gopaluni,et al.  Parameter estimation in nonlinear chemical and biological processes with unmeasured variables from small data sets , 2011 .

[11]  R. Bhushan Gopaluni,et al.  Performance assessment, diagnosis, and optimal selection of non-linear state filters ☆ , 2014 .

[12]  J. Geweke,et al.  Bayesian estimation of state-space models using the Metropolis-Hastings algorithm within Gibbs sampling , 2001 .

[13]  Elaine Martin,et al.  Particle filters for state and parameter estimation in batch processes , 2005 .

[14]  Arnaud Doucet,et al.  An overview of sequential Monte Carlo methods for parameter estimation in general state-space models , 2009 .

[15]  P. Moral.  Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[16]  Václav Peterka,et al.  Bayesian system identification , 1979, Autom..

[17]  W. P. M. H. Heemels,et al.  A Bayesian approach to identification of hybrid systems , 2004, IEEE Transactions on Automatic Control.