Sparse nonnegative dynamic mode decomposition

Dynamic mode decomposition (DMD) is a method to extract coherent modes from nonlinear dynamical systems. In this paper, we propose an extension of DMD, sparse nonnegative DMD, which generates a nonlinear and sparse modal representation of dynamics. In particular, this makes DMD more suitable for video processing. We reformulate DMD as a block-multiconvex optimization problem to impose constraints and regularizations directly on the structures of the estimated dynamic modes. We introduce the results of experiments with synthetic data and a surveillance video dataset and show that sparse nonnegative DMD can extract part-based dynamic modes from video streams.

[1]  P. Goulart,et al.  Optimal mode decomposition for unsteady flows , 2013, Journal of Fluid Mechanics.

[2]  Michael A. Saunders,et al.  Proximal Newton-Type Methods for Minimizing Composite Functions , 2012, SIAM J. Optim..

[3]  Brendt Wohlberg,et al.  Fast principal component pursuit via alternating minimization , 2013, 2013 IEEE International Conference on Image Processing.

[4]  Steven L. Brunton,et al.  Compressed dynamic mode decomposition for background modeling , 2015, Journal of Real-Time Image Processing.

[5]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[6]  P. Schmid,et al.  Applications of the dynamic mode decomposition , 2011 .

[7]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[8]  Yoshihiko Susuki,et al.  Nonlinear Koopman modes and power system stability assessment without models , 2014, 2014 IEEE PES General Meeting | Conference & Exposition.

[9]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[10]  Bingni W. Brunton,et al.  Extracting spatial–temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition , 2014, Journal of Neuroscience Methods.

[11]  Steven L. Brunton,et al.  Multi-resolution Dynamic Mode Decomposition for Foreground/Background Separation and Object Tracking , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[12]  Cédric Herzet,et al.  Optimal low-rank Dynamic Mode Decomposition , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  I. Mezić,et al.  Analysis of Fluid Flows via Spectral Properties of the Koopman Operator , 2013 .

[14]  Clarence W. Rowley,et al.  Characterizing and correcting for the effect of sensor noise in the dynamic mode decomposition , 2014, Experiments in Fluids.

[15]  Peter J. Schmid,et al.  Sparsity-promoting dynamic mode decomposition , 2012, 1309.4165.

[16]  Heni Ben Amor,et al.  Estimation of perturbations in robotic behavior using dynamic mode decomposition , 2015, Adv. Robotics.

[17]  Clarence W. Rowley,et al.  A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition , 2014, Journal of Nonlinear Science.

[18]  I. Mezić.  Spectral Properties of Dynamical Systems, Model Reduction and Decompositions , 2005 .

[19]  Joshua L. Proctor,et al.  Discovering dynamic patterns from infectious disease data using dynamic mode decomposition , 2015, International health.

[20]  Dong Tian,et al.  Robust low rank dynamic mode decomposition for compressed domain crowd and traffic flow analysis , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[21]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[22]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[23]  Steven L. Brunton,et al.  On dynamic mode decomposition: Theory and applications , 2013, 1312.0041.

[24]  Yoshihiko Susuki,et al.  A prony approximation of Koopman Mode Decomposition , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[25]  Igor Mezic,et al.  Ergodic Theory, Dynamic Mode Decomposition, and Computation of Spectral Properties of the Koopman Operator , 2016, SIAM J. Appl. Dyn. Syst..

[26]  Wotao Yin,et al.  A Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and Completion , 2013, SIAM J. Imaging Sci..

[27]  Clarence W. Rowley,et al.  Variants of Dynamic Mode Decomposition: Boundary Condition, Koopman, and Fourier Analyses , 2012, J. Nonlinear Sci..

[28]  Yoshinobu Kawahara,et al.  Dynamic Mode Decomposition with Reproducing Kernels for Koopman Spectral Analysis , 2016, NIPS.