Time-series classification using mixed-state dynamic Bayesian networks

We present a novel mixed-state dynamic Bayesian network (DBN) framework for modeling and classifying time-series data such as object trajectories. A hidden Markov model (HMM) of discrete actions is coupled with a linear dynamical system (LDS) model of continuous trajectory motion. This combination allows us to model both the discrete and continuous causes of trajectories such as human gestures. The model is derived using a rich theoretical corpus from the Bayesian network literature. This allows us to use an approximate structured variational inference technique to solve the otherwise intractable inference of action and system states. Using the same DBN framework we show how to learn the mixed-state model parameters from data. Experiments show that with high statistical confidence the mixed-state DBNs perform favorably when compared to decoupled HMM/LDS models on the task of recognizing human gestures made with a computer mouse.

[1]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[2]  H. Rauch.  Solutions to the linear smoothing problem , 1963 .

[3]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[4]  R. Hathaway.  Another interpretation of the EM algorithm for mixture distributions , 1986 .

[5]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[6]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[7]  Radford M. Neal.  A new view of the EM algorithm that justifies incremental and other variants , 1993 .

[8]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[9]  Geoffrey E. Hinton,et al.  Switching State-Space Models , 1996 .

[10]  Zoubin Ghahramani,et al.  Learning Dynamic Bayesian Networks , 1997, Summer School on Neural Networks.

[11]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Michael I. Jordan.  Learning in Graphical Models , 1999, NATO ASI Series.

[13]  Michael I. Jordan,et al.  An Introduction to Variational Methods for Graphical Models , 1999, Machine-mediated learning.

[14]  Zoubin Ghahramani,et al.  A Unifying Review of Linear Gaussian Models , 1999, Neural Computation.

[15]  Vladimir Pavlovic,et al.  Dynamic bayesian networks for information fusion with applications to human-computer interfaces , 1999 .