Dynamical SVM for Time Series Classification

We present a method for classifying multidimensional time series using concepts from nonlinear dynamical systems theory. Our contribution is an extension of support vector machines (SVM) that controls a nonlinear dynamical system. We use a chain of coupled Rossler oscillators with diffusive coupling to model highly nonlinear and chaotic time series. The optimization procedure involves alternating between using the sequential minimal optimization algorithm to solve the standard SVM dual problem and computing the solution of the ordinary differential equations defining the dynamical system. Empirical comparisons with kernel-based methods for time series classification on real data sets demonstrate the effectiveness of our approach.

[1]  Tomoko Matsui,et al.  A Kernel for Time Series Based on Global Alignments , 2006, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[2]  Li Wei,et al.  Fast time series classification using numerosity reduction , 2006, ICML.

[3]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[4]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[5]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[6]  D. Ruelle,et al.  Ergodic theory of chaos and strange attractors , 1985 .

[7]  O. Rössler An equation for continuous chaos , 1976 .

[8]  E. Ott Chaos in Dynamical Systems: Contents , 1993 .

[9]  Parlitz,et al.  Experimental observation of phase synchronization. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  Marco Cuturi,et al.  Fast Global Alignment Kernels , 2011, ICML.

[11]  Alexander J. Smola,et al.  Binet-Cauchy Kernels on Dynamical Systems and its Application to the Analysis of Dynamic Scenes , 2007, International Journal of Computer Vision.

[12]  Claus Bahlmann,et al.  Online handwriting recognition with support vector machines - a kernel approach , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[13]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[14]  Shigeki Sagayama,et al.  Dynamic Time-Alignment Kernel in Support Vector Machine , 2001, NIPS.

[15]  Arnaud Doucet,et al.  Autoregressive Kernels For Time Series , 2011, 1101.0673.

[16]  E. Ott Chaos in Dynamical Systems: Contents , 2002 .

[17]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos , 2024 .