Learning with Coherence Patterns in Multivariate Time-series Data via Dynamic Mode Decomposition

Understanding complex dynamics in the real world is a fundamental problem in various engineering and scientific fields. Dynamic mode decomposition (DMD) has attracted attention recently as a prominent way to obtain global modal descriptions of nonlinear dynamical processes from data without requiring explicit prior knowledge about the underlying systems. In this paper, we propose a novel learning method for multivariate time-series data involving complex dynamics using coherence patterns among attributes extracted by DMD. To this end, we develop kernels defined with Grassmann subspaces spanned by dynamic modes which are calculated by DMD and represent coherence patters among attributes with respect to the estimated modal dynamics. To incorporate information in labels attached to a set of time-series sequences, we employ a supervised embedding step in the DMD procedure. We illustrate and investigate the empirical performance of the proposed method using real-world data.

[1]  Yasuo Tabei,et al.  Bayesian Dynamic Mode Decomposition , 2017, IJCAI.

[2]  Lior Wolf,et al.  Learning over Sets using Kernel Principal Angles , 2003, J. Mach. Learn. Res..

[3]  Joshua L. Proctor,et al.  Discovering dynamic patterns from infectious disease data using dynamic mode decomposition , 2015, International health.

[4]  Gene H. Golub,et al.  Numerical methods for computing angles between linear subspaces , 1971, Milestones in Matrix Computation.

[5]  Daniel D. Lee,et al.  Grassmann discriminant analysis: a unifying view on subspace-based learning , 2008, ICML '08.

[6]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[7]  Bingni W. Brunton,et al.  Extracting spatial–temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition , 2014, Journal of Neuroscience Methods.

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[10]  Bernhard Schölkopf,et al.  Measuring Statistical Dependence with Hilbert-Schmidt Norms , 2005, ALT.

[11]  Clarence W. Rowley,et al.  A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition , 2014, Journal of Nonlinear Science.

[12]  Zohreh Azimifar,et al.  Supervised principal component analysis: Visualization, classification and regression on subspaces and submanifolds , 2011, Pattern Recognit..

[13]  Keisuke Fujii,et al.  Metric on Nonlinear Dynamical Systems with Perron-Frobenius Operators , 2018, NeurIPS.

[14]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[15]  Naoya Takeishi,et al.  Learning Koopman Invariant Subspaces for Dynamic Mode Decomposition , 2017, NIPS.

[16]  Ker-Chau Li,et al.  On Principal Hessian Directions for Data Visualization and Dimension Reduction: Another Application of Stein's Lemma , 1992 .

[17]  Steven L. Brunton,et al.  On dynamic mode decomposition: Theory and applications , 2013, 1312.0041.

[18]  Michael I. Jordan,et al.  Regression on manifolds using kernel dimension reduction , 2007, ICML '07.

[19]  Heni Ben Amor,et al.  Dynamic Mode Decomposition for perturbation estimation in human robot interaction , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[20]  B. R. Noack,et al.  A hierarchy of low-dimensional models for the transient and post-transient cylinder wake , 2003, Journal of Fluid Mechanics.

[21]  Peter J. Schmid,et al.  Sparsity-promoting dynamic mode decomposition , 2012, 1309.4165.

[22]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[23]  Keisuke Fujii,et al.  Koopman Spectral Kernels for Comparing Complex Dynamics: Application to Multiagent Sport Plays , 2017, ECML/PKDD.

[24]  Mark N. Glauser,et al.  Stochastic estimation and proper orthogonal decomposition: Complementary techniques for identifying structure , 1994 .

[25]  Yoshinobu Kawahara,et al.  Dynamic Mode Decomposition with Reproducing Kernels for Koopman Spectral Analysis , 2016, NIPS.

[26]  Liwei Wang,et al.  Subspace distance analysis with application to adaptive Bayesian algorithm for face recognition , 2006, Pattern Recognit..

[27]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[28]  Yoshihiko Susuki,et al.  Nonlinear Koopman modes and power system stability assessment without models , 2014, 2014 IEEE PES General Meeting | Conference & Exposition.