Visualizing States of Time-Series Data by Autoregressive Gaussian Process Dynamical Models

Gaussian process dynamical models (GPDMs) are used for nonlinear dimensionality reduction in time series by means of Gaussian process priors. An extension of GPDMs is proposed for visualizing the states of time series. The conventional GPDM approach associates a state with an observation value. Therefore, observations changing over time cannot be represented by a single state. Consequently, the resulting visualization of state transition is difficult to understand, as states change when the observation values change. To overcome this issue, autoregressive GPDMs, called ARGPDMs, are proposed. They associate a state with a vector autoregressive (VAR) model. Therefore, observations changing over time can be represented by a single state. The resulting visualization is easier to understand, as states change only when the VAR model changes. We demonstrate experimentally that the ARGPDM approach provides better visualization compared with conventional GPDMs.

[1]  Rini Akmeliawati,et al.  Gaussian Process Dynamical Models for hand gesture interpretation in Sign Language , 2011, Pattern Recognit. Lett..

[2]  David J. Fleet,et al.  3D People Tracking with Gaussian Process Dynamical Models , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[4]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[5]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[6]  David J. Fleet,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Gaussian Process Dynamical Model , 2007 .

[7]  Jing Wang,et al.  Multiple Human Tracking Using Particle Filter with Gaussian Process Dynamical Model , 2008, EURASIP J. Image Video Process..

[8]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[9]  Martin Fodslette Meiller.  A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning , 1993 .

[10]  Nizar Bouguila,et al.  Generating Video Textures by PPCA and Gaussian Process Dynamical Model , 2009, CIARP.

[11]  Neil D. Lawrence,et al.  Gaussian Process Latent Variable Models for Visualisation of High Dimensional Data , 2003, NIPS.

[12]  George E. P. Box,et al.  Time Series Analysis: Box/Time Series Analysis , 2008 .

[13]  David J. Fleet,et al.  Gaussian Process Dynamical Models , 2005, NIPS.

[14]  Chang‐Jin Kim,et al.  State-Space Models with Regime-Switching: Classical and Gibbs Sampling Approaches with Applications , 1999 .