Learning to recognize time series: combining ARMA models with memory-based learning

For a given time series observation sequence, we can estimate the parameters of the autoregression moving average (ARMA) model, thereby representing a potentially long time series by a limited dimensional vector. In many applications, these parameter vectors will be separable into different groups, due to the different underlying mechanisms that generate differing time series. We can then use classification algorithms to predict the class of a new, uncategorized time series. For the purposes of a highly autonomous system, our approach to this classification uses memory-based learning and intensive cross-validation for feature and kernel selection. In an example application, we distinguish between driving data of a skilled, sober driver vs. a drunk driver, by calculating the ARMA model for the respective time series. In this paper, we first give a brief introduction to the theory of time series. We then discuss in detail our approach to time series recognition, using the ARMA model, and finish with experimental results.

[1]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[2]  H. Akaike Autoregressive model fitting for control , 1971 .

[3]  Miss A.O. Penney (b) , 1974, The New Yale Book of Quotations.

[4]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[5]  H. Akaike Canonical Correlation Analysis of Time Series and the Use of an Information Criterion , 1976 .

[6]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[7]  David S. Stoffer,et al.  Estimation and Identification of Space-Time ARMAX Models in the Presence of Missing Data , 1986 .

[8]  R. Kohn,et al.  Estimation, Prediction, and Interpolation for ARIMA Models with Missing Data , 1986 .

[9]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[10]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[11]  Howell Tong,et al.  Non-Linear Time Series , 1990 .

[12]  Blake Hannaford,et al.  Hidden Markov Model Analysis of Force/Torque Information in Telemanipulation , 1991, Int. J. Robotics Res..

[13]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[14]  B. Moor,et al.  On the Use of the Singular Value Decomposition in Identification and Signal Processing , 1991 .

[15]  Dana H. Ballard,et al.  Recognizing teleoperated manipulations , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[16]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[17]  Lee A. Feldkamp,et al.  Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks , 1994, IEEE Trans. Neural Networks.

[18]  Barry L. Kalman,et al.  Time Variability While Training a Parallel Neural Net Network , 1995 .

[19]  Michèle Basseville,et al.  Detection of Abrupt Changes: Theory and Applications. , 1995 .

[20]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[21]  Frank Dellaert,et al.  Recognizing emotion in speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[22]  Yangsheng Xu,et al.  Human control strategy: abstraction, verification, and replication , 1997 .