Computationally Efficient Bayesian Learning of Gaussian Process State Space Models

Gaussian processes allow for flexible specification of prior assumptions of unknown dynamics in state space models. We present a procedure for efficient Bayesian learning in Gaussian process state space models, where the representation is formed by projecting the problem onto a set of approximate eigenfunctions derived from the prior covariance structure. Learning under this family of models can be conducted using a carefully crafted particle MCMC algorithm. This scheme is computationally efficient and yet allows for a fully Bayesian treatment of the problem. Compared to conventional system identification tools or existing learning methods, we show competitive performance and reliable quantification of uncertainties in the model.

[1]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[2]  Roger Frigola,et al.  Bayesian Time Series Learning with Gaussian Processes , 2015 .

[3]  Andreas Ruttor,et al.  Approximate Gaussian process inference for the drift of stochastic differential equations , 2013, NIPS 2013.

[4]  Carl E. Rasmussen,et al.  Gaussian Processes for Data-Efficient Learning in Robotics and Control , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Carl E. Rasmussen,et al.  State-Space Inference and Learning with Gaussian Processes , 2010, AISTATS.

[6]  Marc Peter Deisenroth,et al.  Expectation Propagation in Gaussian Process Dynamical Systems , 2012, NIPS.

[7]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[8]  Carl E. Rasmussen,et al.  Variational Gaussian Process State-Space Models , 2014, NIPS.

[9]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[10]  Fredrik Lindsten,et al.  Estimation of linear systems using a Gibbs sampler , 2012 .

[11]  Arno Solin,et al.  Expectation maximization based parameter estimation by sigma-point and particle smoothing , 2014, 17th International Conference on Information Fusion (FUSION).

[12]  Simo Särkkä,et al.  On convergence and accuracy of state-space approximations of squared exponential covariance functions , 2014, 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[13]  Neil D. Lawrence,et al.  Latent Force Models , 2009, AISTATS.

[14]  Carl E. Rasmussen,et al.  Identification of Gaussian Process State-Space Models with Particle Stochastic Approximation EM , 2013, ArXiv.

[15]  Fredrik Lindsten,et al.  Particle gibbs with ancestor sampling , 2014, J. Mach. Learn. Res..

[16]  Carl E. Rasmussen,et al.  Sparse Spectrum Gaussian Process Regression , 2010, J. Mach. Learn. Res..

[17]  Biao Huang,et al.  Identification of Hammerstein systems without explicit parameterisation of non-linearity , 2009, Int. J. Control.

[18]  Zoubin Ghahramani,et al.  Learning Nonlinear Dynamical Systems Using an EM Algorithm , 1998, NIPS.

[19]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[20]  David J. Fleet,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Gaussian Process Dynamical Model , 2007 .

[21]  Lennart Ljung,et al.  Nonlinear black-box modeling in system identification: a unified overview , 1995, Autom..

[22]  Carl E. Rasmussen,et al.  Bayesian Inference and Learning in Gaussian Process State-Space Models with Particle MCMC , 2013, NIPS.

[23]  Nicolas Chopin,et al.  SMC2: an efficient algorithm for sequential analysis of state space models , 2011, 1101.1528.

[24]  L. Tierney.  Markov Chains for Exploring Posterior Distributions , 1994 .

[25]  Carl E. Rasmussen,et al.  Robust Filtering and Smoothing with Gaussian Processes , 2012, IEEE Transactions on Automatic Control.

[26]  Neil D. Lawrence,et al.  Variational Gaussian Process Dynamical Systems , 2011, NIPS.

[27]  Neil D. Lawrence,et al.  Recurrent Gaussian Processes , 2015, ICLR.

[28]  Ruey S. Tsay,et al.  Analysis of Financial Time Series , 2005 .