Bayesian Dynamic Mode Decomposition with Variational Matrix Factorization

Dynamic mode decomposition (DMD) and its extensions are data-driven methods that have substantially contributed to our understanding of dynamical systems. However, because DMD and most of its extensions are deterministic, it is difficult to treat probabilistic representations of parameters and predictions. In this work, we propose a novel formulation of a Bayesian DMD model. Our Bayesian DMD model is consistent with the procedure of standard DMD, which is to first determine the subspace of observations, and then compute the modes on that subspace. Variational matrix factorization makes it possible to realize a fully-Bayesian scheme of DMD. Moreover, we derive a Bayesian DMD model for incomplete data, which demonstrates the advantage of probabilistic modeling. Finally, both of nonlinear simulated and real-world datasets are used to illustrate the potential of the proposed method.

[1]  Attila Kertész-Farkas,et al.  HuGaDB: Human Gait Database for Activity Recognition from Wearable Inertial Sensor Networks , 2017, AIST.

[2]  Keisuke Fujii,et al.  Dynamic mode decomposition in vector-valued reproducing kernel Hilbert spaces for extracting dynamical structure among observables , 2018, Neural Networks.

[3]  Steven L. Brunton,et al.  Applied Koopman Theory for Partial Differential Equations and Data-Driven Modeling of Spatio-Temporal Systems , 2018, Complex..

[4]  Peter J. Schmid,et al.  Sparsity-promoting dynamic mode decomposition , 2012, 1309.4165.

[5]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[6]  W. Cotton,et al.  Storm and Cloud Dynamics , 1992 .

[7]  Steven L. Brunton,et al.  On dynamic mode decomposition: Theory and applications , 2013, 1312.0041.

[8]  S. Joe Qin,et al.  Dynamic-Inner Partial Least Squares for Dynamic Data Modeling , 2015 .

[9]  Kumpati S. Narendra,et al.  Control of nonlinear dynamical systems using neural networks: controllability and stabilization , 1993, IEEE Trans. Neural Networks.

[10]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[11]  Yasuo Tabei,et al.  Bayesian Dynamic Mode Decomposition , 2017, IJCAI.

[12]  Steven L. Brunton,et al.  Dynamic mode decomposition - data-driven modeling of complex systems , 2016 .

[13]  Shinichi Nakajima,et al.  Global analytic solution of fully-observed variational Bayesian matrix factorization , 2013, J. Mach. Learn. Res..

[14]  Sean Gerrish,et al.  Black Box Variational Inference , 2013, AISTATS.

[15]  Yoshinobu Kawahara,et al.  Dynamic Mode Decomposition with Reproducing Kernels for Koopman Spectral Analysis , 2016, NIPS.

[16]  G. Vallis Atmospheric and Oceanic Fluid Dynamics: Fundamentals and Large-Scale Circulation , 2017 .

[17]  Earl H. Dowell,et al.  Eigenmode analysis in unsteady aerodynamics - Reduced-order models , 1995 .

[18]  R. Wooding The multivariate distribution of complex normal variables , 1956 .

[19]  Dustin Tran,et al.  Automatic Differentiation Variational Inference , 2016, J. Mach. Learn. Res..

[20]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[21]  Shinichi Nakajima,et al.  Theoretical Analysis of Bayesian Matrix Factorization , 2011, J. Mach. Learn. Res..

[22]  Clarence W. Rowley,et al.  A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition , 2014, Journal of Nonlinear Science.

[23]  A. Chatterjee An introduction to the proper orthogonal decomposition , 2000 .

[24]  Akinori Yamanaka,et al.  Data assimilation for massive autonomous systems based on a second-order adjoint method. , 2016, Physical review. E.

[25]  Guillaume Bouchard,et al.  Fast Variational Bayesian Inference for Non-Conjugate Matrix Factorization Models , 2012, AISTATS.

[26]  Yew Jin Lim Variational Bayesian Approach to Movie Rating Prediction , 2007 .

[27]  Soledad Le Clainche Martínez,et al.  Higher Order Dynamic Mode Decomposition , 2017, SIAM J. Appl. Dyn. Syst..

[28]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[29]  Hideyuki Suzuki,et al.  Theory of hybrid dynamical systems and its applications to biological and medical systems , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[30]  Matthew O. Williams,et al.  A kernel-based method for data-driven koopman spectral analysis , 2016 .

[31]  D. Waal,et al.  Matrix‐Valued Distributions , 2006 .

[32]  S. Joe Qin,et al.  A novel dynamic PCA algorithm for dynamic data modeling and process monitoring , 2017 .

[33]  J. Magnus,et al.  The Commutation Matrix: Some Properties and Applications , 1979 .

[34]  S. Brunton,et al.  Discovering governing equations from data by sparse identification of nonlinear dynamical systems , 2015, Proceedings of the National Academy of Sciences.

[35]  D. D. Kosambi Statistics in Function Space , 2016 .