Compressive Sensing and Low-Rank Libraries for Classification of Bifurcation Regimes in Nonlinear Dynamical Systems

We show that for complex nonlinear systems, model reduction and compressive sensing strategies can be combined to great advantage for classifying, projecting, and reconstructing the relevant low-dimensional dynamics. ${L}_2$-based dimensionality reduction methods such as the proper orthogonal decomposition are used to construct separate modal libraries and Galerkin models based on data from a number of bifurcation regimes. These libraries are then concatenated into an overcomplete library, and ${L}_1$-sparse representation in this library from a few noisy measurements results in correct identification of the bifurcation regime. This technique provides an objective and general framework for classifying the bifurcation parameters and, therefore, the underlying dynamics and stability. After classifying the bifurcation regime, it is possible to employ a low-dimensional Galerkin model, only on modes relevant to that bifurcation value. These methods are demonstrated on the complex Ginzburg--Landau equation usin...

[1]  B. R. Noack,et al.  A hierarchy of low-dimensional models for the transient and post-transient cylinder wake , 2003, Journal of Fluid Mechanics.

[2]  José M. Vega,et al.  Construction of Bifurcation Diagrams Using POD on the Fly , 2014, SIAM J. Appl. Dyn. Syst..

[3]  Hanchao Qi,et al.  Invariance of principal components under low-dimensional random projection of the data , 2012, 2012 19th IEEE International Conference on Image Processing.

[4]  B. R. Noack,et al.  On the need for a nonlinear subscale turbulence term in POD models as exemplified for a high-Reynolds-number flow over an Ahmed body , 2013, Journal of Fluid Mechanics.

[5]  Clarence W. Rowley,et al.  Model Reduction for fluids, Using Balanced Proper Orthogonal Decomposition , 2005, Int. J. Bifurc. Chaos.

[6]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[7]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[8]  J. Nathan Kutz,et al.  Classification of birefringence in mode-locked fiber lasers using machine learning and sparse representation. , 2014, Optics express.

[9]  Wen-Xu Wang,et al.  Predicting catastrophes in nonlinear dynamical systems by compressive sensing. , 2011, Physical review letters.

[10]  L. Sirovich Turbulence and the dynamics of coherent structures. I. Coherent structures , 1987 .

[11]  G. Karniadakis,et al.  Efficient sensor placement for ocean measurements using low-dimensional concepts , 2009 .

[12]  Charbel Farhat,et al.  The GNAT method for nonlinear model reduction: Effective implementation and application to computational fluid dynamics and turbulent flows , 2012, J. Comput. Phys..

[13]  B. R. Noack Turbulence, Coherent Structures, Dynamical Systems and Symmetry , 2013 .

[14]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[15]  Charbel Farhat,et al.  Adaptation of POD-based Aeroelastic ROMs for Varying Mach Number and Angle of Attack: Application to a Complete F-16 Configuration , 2005 .

[16]  Arpit Agarwal,et al.  Statistical Field Estimation for Complex Coastal Regions and Archipelagos , 2011 .

[17]  Michael B. Wakin,et al.  Sketched SVD: Recovering Spectral Features from Compressive Measurements , 2012, ArXiv.

[18]  Kelly Cohen,et al.  Low-dimensional modelling of a transient cylinder wake using double proper orthogonal decomposition , 2008, Journal of Fluid Mechanics.

[19]  Mark N. Glauser,et al.  Towards practical flow sensing and control via POD and LSE based low-dimensional tools , 2004 .

[20]  Laurent Cordier,et al.  Control of the cylinder wake in the laminar regime by Trust-Region methods and POD Reduced Order Models , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[21]  R. Kosut,et al.  Efficient measurement of quantum dynamics via compressive sensing. , 2009, Physical review letters.

[22]  J. Kutz,et al.  Compressive Sensing Based Machine Learning Strategy For Characterizing The Flow Around A Cylinder With Limited Pressure Measurements , 2013 .

[23]  Pramod K. Varshney,et al.  Physics Based Compressive Sensing Approach Applied to Airfoil Data Collection and Analysis , 2012 .

[24]  L. Goddard Information Theory , 1962, Nature.

[25]  Bernd R. Noack,et al.  Cluster-based reduced-order modelling of a mixing layer , 2013, Journal of Fluid Mechanics.

[26]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[27]  H. Sompolinsky,et al.  Compressed sensing, sparsity, and dimensionality in neuronal information processing and data analysis. , 2012, Annual review of neuroscience.

[28]  L. Sirovich Turbulence and the dynamics of coherent structures. II. Symmetries and transformations , 1987 .

[29]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[30]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  J. Nathan Kutz,et al.  Data-Driven Modeling & Scientific Computation: Methods for Complex Systems & Big Data , 2013 .

[32]  L. Gladden,et al.  Exploring the origins of turbulence in multiphase flow using compressed sensing MRI. , 2012, Physical review letters.

[33]  David L. Donoho,et al.  The Optimal Hard Threshold for Singular Values is 4/sqrt(3) , 2013, 1305.5870.

[34]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[35]  C. W. Gear,et al.  Equation-Free, Coarse-Grained Multiscale Computation: Enabling Mocroscopic Simulators to Perform System-Level Analysis , 2003 .

[36]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[37]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[38]  José M. Vega,et al.  On the use of POD-based ROMs to analyze bifurcations in some dissipative systems , 2012 .

[39]  S. Osher,et al.  Sparse dynamics for partial differential equations , 2012, Proceedings of the National Academy of Sciences.

[40]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[41]  Steven L. Brunton,et al.  Self-Tuning Fiber Lasers , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[42]  Massimo Fornasier,et al.  Compressive Sensing , 2015, Handbook of Mathematical Methods in Imaging.

[43]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[44]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[45]  Edgar Knobloch,et al.  Transient spatio-temporal chaos in the complex Ginzburg–Landau equation on long domains , 2010 .

[46]  Ryan F. Schmit,et al.  Improvements in low dimensional tools for flow-structure interaction problems: Using global POD , 2003 .

[47]  David G. Stork,et al.  Pattern Classification , 1973 .

[48]  Andrew J. Majda,et al.  Quantifying Bayesian filter performance for turbulent dynamical systems through information theory , 2014 .

[49]  D. Donoho,et al.  The Optimal Hard Threshold for Singular Values is 4 / √ 3 , 2013 .

[50]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[51]  James E. Fowler,et al.  Compressive-Projection Principal Component Analysis , 2009, IEEE Transactions on Image Processing.

[52]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[53]  Earl H. Dowell,et al.  Stabilization of projection-based reduced order models of the Navier–Stokes , 2012 .

[54]  Andrew J. Majda,et al.  Information theory, model error, and predictive skill of stochastic models for complex nonlinear systems , 2012 .

[55]  Lance J. Nelson,et al.  Compressive sensing as a paradigm for building physics models , 2013 .

[56]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[57]  J. Lumley Stochastic tools in turbulence , 1970 .