On System Identification of Nonlinear State-Space Models Based on Variational Bayes: Multimodal Distribution Case

In this paper, we propose a parameter estimation method for nonlinear state-space models based on the variational Bayes. It is shown that the variational posterior distribution of the hidden states is equivalent the probability estimated by a nonlinear smoother of an augmented nonlinear state-space model. This enables us to obtain the variational posterior distribution of the hidden states by implementing a variety of existing nonlinear filtering and smoothing algorithms. By employing a Gaussian mixture distribution as a candidate probability density function of the hidden states, we propose an algorithm to compute multimodal posterior distributions which are not able to be handled by the existing results.

[1]  Mark Campbell,et al.  Smoothing Algorithm for Nonlinear Systems Using Gaussian Mixture Models , 2015 .

[2]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[3]  George E. P. Box,et al.  Sampling and Bayes' inference in scientific modelling and robustness , 1980 .

[4]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[5]  Zoubin Ghahramani,et al.  Learning Nonlinear Dynamical Systems Using an EM Algorithm , 1998, NIPS.

[6]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[7]  Mark E. Campbell,et al.  Discrete and Continuous, Probabilistic Anticipation for Autonomous Robots in Urban Environments , 2010, IEEE Transactions on Robotics.

[8]  Karl J. Friston,et al.  Variational Bayesian identification and prediction of stochastic nonlinear dynamic causal models , 2009, Physica D. Nonlinear phenomena.

[9]  David Barber,et al.  Unified Inference for Variational Bayesian Linear Gaussian State-Space Models , 2006, NIPS.

[10]  Ba-Ngu Vo,et al.  Closed-Form Solutions to Forward–Backward Smoothing , 2012, IEEE Transactions on Signal Processing.

[11]  Juha Karhunen,et al.  An Unsupervised Ensemble Learning Method for Nonlinear Dynamic State-Space Models , 2002, Neural Computation.

[12]  Hagai Attias,et al.  Inferring Parameters and Structure of Latent Variable Models by Variational Bayes , 1999, UAI.

[13]  P. Diaconis,et al.  Conjugate Priors for Exponential Families , 1979 .