Integrated pre-processing for Bayesian nonlinear system identification with Gaussian processes

We introduce GP-FNARX: a new model for nonlinear system identification based on a nonlinear autoregressive exogenous model (NARX) with filtered regressors (F) where the nonlinear regression problem is tackled using sparse Gaussian processes (GP). We integrate data pre-processing with system identification into a fully automated procedure that goes from raw data to an identified model. Both pre-processing parameters and GP hyper-parameters are tuned by maximizing the marginal likelihood of the probabilistic model. We obtain a Bayesian model of the system's dynamics which is able to report its uncertainty in regions where the data is scarce. The automated approach, the modeling of uncertainty and its relatively low computational cost make of GP-FNARX a good candidate for applications in robotics and adaptive control.

[1]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[2]  Václav Peterka,et al.  Bayesian system identification , 1979, Autom..

[3]  Christoph Ament,et al.  Sparse Gaussian Processes with Uncertain Inputs for Multi-Step Ahead Prediction , 2012 .

[4]  Alex Simpkins,et al.  System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf] , 2012, IEEE Robotics & Automation Magazine.

[5]  Daniel E. Rivera,et al.  System identification: A Wiener-Hammerstein benchmark , 2012 .

[6]  Johan A. K. Suykens,et al.  Wiener-Hammerstein Benchmark , 2009 .

[7]  Carl E. Rasmussen,et al.  A Unifying View of Sparse Approximate Gaussian Process Regression , 2005, J. Mach. Learn. Res..

[8]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[9]  Fredrik Lindsten,et al.  Estimation of linear systems using a Gibbs sampler , 2012 .

[10]  Carl E. Rasmussen,et al.  State-Space Inference and Learning with Gaussian Processes , 2010, AISTATS.

[11]  Zoubin Ghahramani,et al.  Sparse Gaussian Processes using Pseudo-inputs , 2005, NIPS.

[12]  Thomas B. Schön,et al.  System identification of nonlinear state-space models , 2011, Autom..

[13]  David Barber,et al.  Unified Inference for Variational Bayesian Linear Gaussian State-Space Models , 2006, NIPS.

[14]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[15]  Agathe Girard,et al.  Dynamic systems identification with Gaussian processes , 2005 .