Sketching Methods for Dynamic Mode Decomposition in Spherical Shallow Water Equations

Dynamic mode decomposition (DMD) is an emerging methodology that has recently attracted computational scientists working on nonintrusive reduced order modeling. One of the major strengths that DMD possesses is having ground theoretical roots from the Koopman approximation theory. Indeed, DMD may be viewed as the data-driven realization of the famous Koopman operator. Nonetheless, the stable implementation of DMD incurs computing the singular value decomposition of the input data matrix. This, in turn, makes the process computationally demanding for high dimensional systems. In order to alleviate this burden, we develop a framework based on sketching methods, wherein a sketch of a matrix is simply another matrix which is significantly smaller, but still sufficiently approximates the original system. Such sketching or embedding is performed by applying random transformations, with certain properties, on the input matrix to yield a compressed version of the initial system. Hence, many of the expensive computations can be carried out on the smaller matrix, thereby accelerating the solution of the original problem. We conduct numerical experiments conducted using the spherical shallow water equations as a prototypical model in the context of geophysical flows. The performance of several sketching approaches is evaluated for capturing the range and co-range of the data matrix. The proposed sketching-based framework can accelerate various portions of the DMD algorithm, compared to classical methods that operate directly on the raw input data. This eventually leads to substantial computational gains that are vital for digital twinning of high dimensional systems.

[1]  Dimitri N. Mavris,et al.  Randomized Algorithms for Non-Intrusive Parametric Reduced Order Modeling , 2020 .

[2]  Weiwei Zhang,et al.  An improved criterion to select dominant modes from dynamic mode decomposition , 2017 .

[3]  Volkan Cevher,et al.  Streaming Low-Rank Matrix Approximation with an Application to Scientific Simulation , 2019, SIAM J. Sci. Comput..

[4]  Volkan Cevher,et al.  Sketchy Decisions: Convex Low-Rank Matrix Optimization with Optimal Storage , 2017, AISTATS.

[5]  Alessandro Alla,et al.  Randomized model order reduction , 2016, Adv. Comput. Math..

[6]  Ionel Michael Navon,et al.  The method of dynamic mode decomposition in shallow water and a swirling flow problem , 2017 .

[7]  Lin Zhou,et al.  Dynamic mode decomposition of forced spatially developed transitional jets , 2015 .

[8]  Peter J. Schmid,et al.  Parametrized data-driven decomposition for bifurcation analysis, with application to thermo-acoustically unstable systems , 2015 .

[9]  J. Sørensen,et al.  Mutual inductance instability of the tip vortices behind a wind turbine , 2014, Journal of Fluid Mechanics.

[10]  D. A. Bistrian,et al.  Randomized dynamic mode decomposition for nonintrusive reduced order modelling , 2016, 1611.04884.

[11]  Peter J. Schmid,et al.  Sparsity-promoting dynamic mode decomposition , 2012, 1309.4165.

[12]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[13]  The Shallow Water Model , 2012 .

[14]  Parviz Moin,et al.  Reduced-order representation of near-wall structures in the late transitional boundary layer , 2014, Journal of Fluid Mechanics.

[15]  P. Swarztrauber,et al.  A standard test set for numerical approximations to the shallow water equations in spherical geometry , 1992 .

[16]  Steven L. Brunton,et al.  On dynamic mode decomposition: Theory and applications , 2013, 1312.0041.

[17]  Scott T. M. Dawson,et al.  Model Reduction for Flow Analysis and Control , 2017 .

[18]  David P. Woodruff Sketching as a Tool for Numerical Linear Algebra , 2014, Found. Trends Theor. Comput. Sci..

[19]  A. Quarteroni,et al.  Reduced Basis Methods for Partial Differential Equations: An Introduction , 2015 .

[20]  Yong Li,et al.  Numerical simulations of Rossby–Haurwitz waves , 2000 .

[21]  Steven L. Brunton,et al.  Dynamic mode decomposition - data-driven modeling of complex systems , 2016 .

[22]  B. R. Noack Turbulence, Coherent Structures, Dynamical Systems and Symmetry , 2013 .

[23]  Hisaichi Shibata,et al.  Dynamic mode decomposition using a Kalman filter for parameter estimation , 2018, AIP Advances.

[24]  Steven L. Brunton,et al.  Randomized Dynamic Mode Decomposition , 2017, SIAM J. Appl. Dyn. Syst..

[25]  Steven L. Brunton,et al.  Robust principal component analysis for modal decomposition of corrupt fluid flows , 2019, Physical Review Fluids.

[26]  C. Farhat,et al.  Interpolation Method for Adapting Reduced-Order Models and Application to Aeroelasticity , 2008 .

[27]  Steven L. Brunton,et al.  Compressive Sensing and Low-Rank Libraries for Classification of Bifurcation Regimes in Nonlinear Dynamical Systems , 2013, SIAM J. Appl. Dyn. Syst..

[28]  Bingni W. Brunton,et al.  Centering Data Improves the Dynamic Mode Decomposition , 2019, SIAM J. Appl. Dyn. Syst..

[29]  Clarence W. Rowley,et al.  A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition , 2014, Journal of Nonlinear Science.

[30]  Clarence W. Rowley,et al.  De-biasing the dynamic mode decomposition for applied Koopman spectral analysis of noisy datasets , 2015, Theoretical and Computational Fluid Dynamics.

[31]  Francis X. Giraldo,et al.  Analysis of the Turkel-Zwas Scheme for the Two-Dimensional Shallow Water Equations in Spherical Coordinates , 1997 .

[32]  N. Ohno,et al.  Application of dynamic mode decomposition to rotating structures in detached linear plasmas , 2020, Physics of Plasmas.

[33]  Bernd R. Noack,et al.  Model reduction using Dynamic Mode Decomposition , 2014 .

[34]  Steven L. Brunton,et al.  Multiresolution Dynamic Mode Decomposition , 2015, SIAM J. Appl. Dyn. Syst..

[35]  Michael W. Mahoney Randomized Algorithms for Matrices and Data , 2011, Found. Trends Mach. Learn..

[36]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[37]  Steven L. Brunton,et al.  Streaming GPU Singular Value and Dynamic Mode Decompositions , 2016, ArXiv.

[38]  Madeleine Udell,et al.  Why Are Big Data Matrices Approximately Low Rank? , 2017, SIAM J. Math. Data Sci..

[39]  Ionel Michael Navon,et al.  On linear and nonlinear aspects of dynamic mode decomposition , 2016 .

[40]  Steven L. Brunton,et al.  Compressed dynamic mode decomposition for background modeling , 2015, Journal of Real-Time Image Processing.

[41]  Clarence W. Rowley,et al.  Dynamic mode decomposition for large and streaming datasets , 2014, 1406.7187.

[42]  F. Guéniat,et al.  A dynamic mode decomposition approach for large and arbitrarily sampled systems , 2015 .

[43]  L. Sirovich Turbulence and the dynamics of coherent structures. I. Coherent structures , 1987 .

[44]  Taku Nonomura,et al.  Extended-Kalman-filter-based dynamic mode decomposition for simultaneous system identification and denoising , 2018, PloS one.

[45]  Uri Shaham,et al.  Dynamic Mode Decomposition , 2013 .

[46]  Clarence W. Rowley,et al.  Variants of Dynamic Mode Decomposition: Boundary Condition, Koopman, and Fourier Analyses , 2012, J. Nonlinear Sci..

[47]  Vassilios Theofilis,et al.  Modal Analysis of Fluid Flows: An Overview , 2017, 1702.01453.

[48]  Dan S. Henningson,et al.  Reduced-order models for flow control: balanced models and Koopman modes , 2010 .

[49]  P. Schmid,et al.  Applications of the dynamic mode decomposition , 2011 .

[50]  Mehdi Ghommem,et al.  pyROM: A computational framework for reduced order modeling , 2019, J. Comput. Sci..

[51]  D. A. Bistrian,et al.  Efficiency of randomised dynamic mode decomposition for reduced order modelling , 2018 .

[52]  N. Benjamin Erichson,et al.  Randomized low-rank Dynamic Mode Decomposition for motion detection , 2015, Comput. Vis. Image Underst..

[53]  Clarence W. Rowley,et al.  Online dynamic mode decomposition for time-varying systems , 2017, SIAM J. Appl. Dyn. Syst..