Koopman Spectral Kernels for Comparing Complex Dynamics: Application to Multiagent Sport Plays

Understanding the complex dynamics in the real-world such as in multi-agent behaviors is a challenge in numerous engineering and scientific fields. Spectral analysis using Koopman operators has been attracting attention as a way of obtaining a global modal description of a nonlinear dynamical system, without requiring explicit prior knowledge. However, when applying this to the comparison or classification of complex dynamics, it is necessary to incorporate the Koopman spectra of the dynamics into an appropriate metric. One way of implementing this is to design a kernel that reflects the dynamics via the spectra. In this paper, we introduced Koopman spectral kernels to compare the complex dynamics by generalizing the Binet-Cauchy kernel to nonlinear dynamical systems without specifying an underlying model. We applied this to strategic multiagent sport plays wherein the dynamics can be classified, e.g., by the success or failure of the shot. We mapped the latent dynamic characteristics of multiple attacker-defender distances to the feature space using our kernels and then evaluated the scorability of the play by using the features in different classification models.

[1]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[2]  Yoshihiko Susuki,et al.  Nonlinear Koopman modes and power system stability assessment without models , 2014, 2014 IEEE PES General Meeting | Conference & Exposition.

[3]  Daniel D. Lee,et al.  Grassmann discriminant analysis: a unifying view on subspace-based learning , 2008, ICML '08.

[4]  Peter J. Schmid,et al.  Sparsity-promoting dynamic mode decomposition , 2012, 1309.4165.

[5]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[6]  B. O. Koopman,et al.  Hamiltonian Systems and Transformation in Hilbert Space. , 1931, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Steven L. Brunton,et al.  On dynamic mode decomposition: Theory and applications , 2013, 1312.0041.

[8]  L. Sirovich Turbulence and the dynamics of coherent structures. I. Coherent structures , 1987 .

[9]  Zoubin Ghahramani,et al.  Learning Nonlinear Dynamical Systems Using an EM Algorithm , 1998, NIPS.

[10]  Nan Jiang,et al.  Spectral Learning of Predictive State Representations with Insufficient Statistics , 2015, AAAI.

[11]  Andrew C. Miller Possession Sketches : Mapping NBA Strategies , 2017 .

[12]  R. Zemel,et al.  Classifying NBA Offensive Plays Using Neural Networks , 2016 .

[13]  Yasuo Tabei,et al.  Bayesian Dynamic Mode Decomposition , 2017, IJCAI.

[14]  Yuji Yamamoto,et al.  Mutual and asynchronous anticipation and action in sports as globally competitive and locally coordinative dynamics , 2015, Scientific Reports.

[15]  Matthew Goldman,et al.  Live by the Three, Die by the Three? The Price of Risk in the NBA , 2013 .

[16]  John D. Lafferty,et al.  Diffusion Kernels on Graphs and Other Discrete Input Spaces , 2002, ICML.

[17]  M. Tomasello,et al.  Shared intentionality. , 2007, Developmental science.

[18]  Julien Tailleur,et al.  How Far from Equilibrium Is Active Matter? , 2016, Physical review letters.

[19]  Clarence W. Rowley,et al.  A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition , 2014, Journal of Nonlinear Science.

[20]  I. Couzin,et al.  Effective leadership and decision-making in animal groups on the move , 2005, Nature.

[21]  Bart De Moor,et al.  Subspace angles between ARMA models , 2002, Syst. Control. Lett..

[22]  H. Kashima,et al.  Kernels for graphs , 2004 .

[23]  Clarence W. Rowley,et al.  Variants of Dynamic Mode Decomposition: Boundary Condition, Koopman, and Fourier Analyses , 2012, J. Nonlinear Sci..

[24]  Bruce A. Draper,et al.  Illumination Face Spaces Are Idiosyncratic , 2006, IPCV.

[25]  Lior Wolf,et al.  Learning over Sets using Kernel Principal Angles , 2003, J. Mach. Learn. Res..

[26]  Gene H. Golub,et al.  Matrix computations , 1983 .

[27]  Mark N. Glauser,et al.  Stochastic estimation and proper orthogonal decomposition: Complementary techniques for identifying structure , 1994 .

[28]  Edwin Hutchins,et al.  The technology of team navigation , 1990 .

[29]  Yoshinobu Kawahara,et al.  Dynamic Mode Decomposition with Reproducing Kernels for Koopman Spectral Analysis , 2016, NIPS.

[30]  Richard J. Martin A metric for ARMA processes , 2000, IEEE Trans. Signal Process..

[31]  K. Fujii,et al.  Resilient help to switch and overlap hierarchical subsystems in a small human group , 2016, Scientific Reports.

[32]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[33]  Bingni W. Brunton,et al.  Extracting spatial–temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition , 2014, Journal of Neuroscience Methods.

[34]  Alexander J. Smola,et al.  Binet-Cauchy Kernels on Dynamical Systems and its Application to the Analysis of Dynamic Scenes , 2007, International Journal of Computer Vision.

[35]  L. Sirovich Turbulence and the dynamics of coherent structures. II. Symmetries and transformations , 1987 .